-- Logs begin at Tue 2022-09-13 05:58:03 UTC, end at Tue 2022-09-13 06:50:53 UTC. -- Sep 13 06:22:54.005197 dv-cinder-856385-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 13 06:22:54.013830 dv-cinder-856385-1-smb devstack@keystone.service[81452]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 13 06:22:54.015949 dv-cinder-856385-1-smb devstack@keystone.service[81452]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 06:22:54 2022] *** Sep 13 06:22:54.015949 dv-cinder-856385-1-smb devstack@keystone.service[81452]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 06:22:54.015949 dv-cinder-856385-1-smb devstack@keystone.service[81452]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 06:22:54.015949 dv-cinder-856385-1-smb devstack@keystone.service[81452]: nodename: dv-cinder-856385-1-smb Sep 13 06:22:54.015949 dv-cinder-856385-1-smb devstack@keystone.service[81452]: machine: x86_64 Sep 13 06:22:54.015949 dv-cinder-856385-1-smb devstack@keystone.service[81452]: clock source: unix Sep 13 06:22:54.015949 dv-cinder-856385-1-smb devstack@keystone.service[81452]: pcre jit disabled Sep 13 06:22:54.015949 dv-cinder-856385-1-smb devstack@keystone.service[81452]: detected number of CPU cores: 4 Sep 13 06:22:54.015949 dv-cinder-856385-1-smb devstack@keystone.service[81452]: current working directory: / Sep 13 06:22:54.015949 dv-cinder-856385-1-smb devstack@keystone.service[81452]: detected binary path: /usr/bin/uwsgi-core Sep 13 06:22:54.015949 dv-cinder-856385-1-smb devstack@keystone.service[81452]: your processes number limit is 47680 Sep 13 06:22:54.015949 dv-cinder-856385-1-smb devstack@keystone.service[81452]: your memory page size is 4096 bytes Sep 13 06:22:54.015949 dv-cinder-856385-1-smb devstack@keystone.service[81452]: detected max file descriptor number: 2048 Sep 13 06:22:54.015949 dv-cinder-856385-1-smb devstack@keystone.service[81452]: lock engine: pthread robust mutexes Sep 13 06:22:54.016875 dv-cinder-856385-1-smb devstack@keystone.service[81452]: thunder lock: enabled Sep 13 06:22:54.016875 dv-cinder-856385-1-smb devstack@keystone.service[81452]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 13 06:22:54.016875 dv-cinder-856385-1-smb devstack@keystone.service[81452]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 06:22:54.055785 dv-cinder-856385-1-smb devstack@keystone.service[81452]: Python main interpreter initialized at 0x55a109d779c0 Sep 13 06:22:54.055785 dv-cinder-856385-1-smb devstack@keystone.service[81452]: python threads support enabled Sep 13 06:22:54.055785 dv-cinder-856385-1-smb devstack@keystone.service[81452]: your server socket listen backlog is limited to 100 connections Sep 13 06:22:54.055785 dv-cinder-856385-1-smb devstack@keystone.service[81452]: your mercy for graceful operations on workers is 90 seconds Sep 13 06:22:54.056112 dv-cinder-856385-1-smb devstack@keystone.service[81452]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 06:22:54.056195 dv-cinder-856385-1-smb devstack@keystone.service[81452]: *** Operational MODE: preforking *** Sep 13 06:22:54.056456 dv-cinder-856385-1-smb devstack@keystone.service[81452]: *** uWSGI is running in multiple interpreter mode *** Sep 13 06:22:54.056456 dv-cinder-856385-1-smb devstack@keystone.service[81452]: spawned uWSGI master process (pid: 81452) Sep 13 06:22:54.056641 dv-cinder-856385-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 13 06:22:54.057698 dv-cinder-856385-1-smb devstack@keystone.service[81452]: spawned uWSGI worker 1 (pid: 81460, cores: 1) Sep 13 06:22:54.057698 dv-cinder-856385-1-smb devstack@keystone.service[81452]: spawned uWSGI worker 2 (pid: 81461, cores: 1) Sep 13 06:22:54.057698 dv-cinder-856385-1-smb devstack@keystone.service[81452]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 06:22:58.328841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:22:58.328841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: from cryptography.utils import int_from_bytes Sep 13 06:22:58.329645 dv-cinder-856385-1-smb devstack@keystone.service[81460]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:22:58.329645 dv-cinder-856385-1-smb devstack@keystone.service[81460]: from cryptography.utils import int_from_bytes Sep 13 06:22:58.330096 dv-cinder-856385-1-smb devstack@keystone.service[81461]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:22:58.330096 dv-cinder-856385-1-smb devstack@keystone.service[81461]: from cryptography.utils import int_from_bytes Sep 13 06:22:58.330233 dv-cinder-856385-1-smb devstack@keystone.service[81460]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 06:22:58.330233 dv-cinder-856385-1-smb devstack@keystone.service[81460]: from cryptography.utils import int_from_bytes Sep 13 06:22:58.378856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 06:22:58.379019 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 06:22:58.379107 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 06:22:58.379181 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 06:22:58.379246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] command line args: [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 06:22:58.379305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] command line args: [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 06:22:58.379478 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 06:22:58.379580 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 06:22:58.379658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ================================================================================ {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 06:22:58.379735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ================================================================================ {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 06:22:58.379890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] admin_token = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.379976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] admin_token = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.380133 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] config_dir = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.380215 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] config_dir = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.380321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.380402 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.380503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] config_source = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.380583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] config_source = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.380698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] debug = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.380782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] debug = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.380899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.382355 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.382355 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.382516 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.382582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.382647 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.382705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.382768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.382834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.382892 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.382954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] list_limit = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383011 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383067 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] log_config_append = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383123 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_config_append = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] log_dir = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_dir = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] log_file = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_file = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383692 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383809 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.383991 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.384354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.384493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.384748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.386378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.387001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.387150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.387323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.387488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.387661 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.387835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.387835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.387835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.387835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.387835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.388508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.388703 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.388889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.389070 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.389206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.389206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.389495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.389667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.389830 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] publish_errors = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.389990 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.390126 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.390126 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.390126 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.390545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.390650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.390789 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] publish_errors = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.390894 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.390991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.391087 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] standard_threads = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.391239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.391239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.391506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.392165 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.392275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.392275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.392491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.392602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] use_journal = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.392721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] standard_threads = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.392831 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] use_json = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.392944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.393049 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] use_stderr = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.393049 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] use_syslog = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.393293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.393471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.393619 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.393722 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.393820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] use_journal = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.393937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.393937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.393937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.393937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.393937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.394385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.394385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.394574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] use_json = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.394679 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.394783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] use_stderr = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.394783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] use_syslog = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.394971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.395075 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 06:22:58.395186 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.395186 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.395374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.395470 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.395573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.395680 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.395778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.395874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.395983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.396120 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.396260 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.396375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.396851 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.396851 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.397141 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.397272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.397409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.397556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.397688 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.397819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.397966 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.398098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.398227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.398365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.398502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.398633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.398763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.398900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.399037 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.399245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.399378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.399535 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.399535 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.399844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.399996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.399996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.400243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.400374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.400510 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.400647 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.400647 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.400939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.401076 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.401076 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.401335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.401476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.401476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.401739 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.401934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.402112 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.402256 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.402385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.402607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.402751 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.402883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.403066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.403339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.403573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.403778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.403916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.404046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.404258 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.404870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.405056 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.405255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.405255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.405589 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.405763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.405916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.406083 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.406293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.406495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.406495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.406876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.407116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.407116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.407116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.407116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.407836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.408015 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.408015 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.408450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.408661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.408661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.408974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.409104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.409265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.409412 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.409558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.409690 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.409819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.409948 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.410079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.410215 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.410353 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.410498 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.410629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.410758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.410894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.411024 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.411166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.411643 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.411782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.411945 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.412085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.412226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.412397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.412609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.412836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.413026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.413217 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.413413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.413651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.413818 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.414047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.414229 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.414426 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.414722 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.414933 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.415171 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.415372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.415543 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.415543 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.415915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.415915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.416290 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.416290 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.416290 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.417062 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.417232 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.417428 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.417682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.417866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.418031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.418031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.418281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.418482 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.418682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.418821 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.418959 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.419128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.419265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.419407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.419407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.419672 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.419813 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.419945 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.420075 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.420212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.420356 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.420518 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.420654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.420818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.420960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.421093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.421244 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.421244 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.421465 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.421632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.421763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.421892 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.422028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.422160 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.422287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.422415 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.external = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.422547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.422682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.422682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.422682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.423057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.423201 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.password = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.423201 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] auth.token = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.423439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.423639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.423769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.423902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.424030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.424162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.424297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.424433 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.424569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.424720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.424857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.424993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.424993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.424993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.425354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.425482 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.425482 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.425726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.425854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.425986 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.426125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.426254 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.426380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.426506 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.426651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.426785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.426950 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.427078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.427208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.427334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.427460 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.427613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.427754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.427884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.428019 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.428147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.428275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.428412 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.428539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.428728 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.428871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.429000 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.429127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.429256 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.429385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.429512 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.429647 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.429775 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.429775 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.430021 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.430154 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.430292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.430429 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.430556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.430639 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.430781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.430864 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.430937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.431018 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.431092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.431166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.431247 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.431322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.431395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.431476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.431551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.431624 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.431697 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.431777 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.431851 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.431932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.432007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.432083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.432156 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.432228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.432301 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.432383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.432458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.432530 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] auth.external = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.432603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.432704 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.432781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.432866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.432948 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.433022 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.433093 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.433171 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] auth.password = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.433250 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.433332 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] auth.token = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.433405 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.433477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.433549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.433621 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.433701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.433775 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.433847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.433919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.433997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.434070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.434150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.434225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.434297 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.434871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.434948 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.435020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] credential.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.435101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.435176 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.435248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.435320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.435392 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.435464 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.435545 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.435618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.435691 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.435762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.435834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.435906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.436055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.436132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.436205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.436277 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.436349 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.436421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.436501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.436501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.436635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.436756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.436843 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.436959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.437053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.437128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.437201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.437273 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.437345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.437417 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.437498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.437572 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.437645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.437717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.437788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.437860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.437940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.438014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.438087 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.438159 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.438230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.438302 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.438382 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.438457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.438530 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.438722 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.438803 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.438961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.439050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.439215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.439303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.439451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.439531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.439697 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.439785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.439931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.440010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.440178 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.440267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.440419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.440505 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.440651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.440765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.440909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.440992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.441144 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.441231 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.441371 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.441450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.441607 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.441687 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.441854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.441943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.442102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.442181 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.442331 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.442409 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.442561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.442650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.442791 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.442872 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.443037 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.443142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.443276 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.443395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.443514 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.443639 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.443754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.443893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.443985 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.444136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.444218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.444406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.444488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.444643 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.444761 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.444942 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.445025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.445173 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.445254 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.445408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.445495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.445635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.445714 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.445867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.445948 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.446104 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.446192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.446341 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.446420 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.446581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.446661 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.446807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.446894 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.447053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.447142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.447292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.447372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.447522 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.447610 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.447766 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.447847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.448009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.448089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.448237 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.448331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.448474 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.448552 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.448716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.448801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.448956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.449049 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.449192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.449279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.449429 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.449509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.449666 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.449753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.449911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.450596 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.450732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.450845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.450984 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.451095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.451223 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.451328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.451474 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.451554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.451727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.451816 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.451966 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.452047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.452221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.452309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.452463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.452553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.452712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.452797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.452946 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.453029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] role.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.453184 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.453278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] role.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.453414 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.453495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.453659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.453738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.453906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.453998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.454152 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.454232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.454395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.454475 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.454630 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.454719 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.454857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.454938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.455090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.455171 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.455324 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.455406 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.455558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.455639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.455788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.455864 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.456035 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.456125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.456279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.456359 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.456522 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.456601 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.456792 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.456984 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.457104 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.457229 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.457311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.457483 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.457573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.457715 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.457797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.457951 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.458033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.458186 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.458340 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.458417 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.458489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.458649 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.458730 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.458893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.458982 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.459129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.459210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.459368 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.459447 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.459597 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.459684 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.459829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.459908 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.460060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.460139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.460301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.460389 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.460537 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.460617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.460807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.460891 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.461045 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.461137 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.461274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.461353 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.461508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.461588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.461745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.461833 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.461990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.462069 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.462229 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.462309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.462458 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.462545 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.462704 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.462785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.462944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.463023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.463175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.463262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.463418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.463499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.463654 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.463734 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.463889 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.463980 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.464119 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] role.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.464199 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.464350 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.464429 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] role.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.464581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.464699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.464857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.464938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.465103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.465195 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.465347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.465427 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.465623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.465709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.465888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.connection = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.465968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.466138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.466218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.466378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.466459 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.466617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.466697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.466847 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.466926 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.467084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.467205 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.467323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.467404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.467562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.467643 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.467802 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.467884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.468050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.468218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.468298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.468453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.468542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.468721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.468808 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.468972 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.469054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.469219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.469313 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.469463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.469544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.469691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.469770 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.469931 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.470019 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.470170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.470251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.470327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81460) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 06:22:58.470400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.470624 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.470853 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.471083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.471332 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.471584 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.471830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.472064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.472298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.472525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.472787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] token.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.473023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.473267 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.473501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.473754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.473998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.474232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.474474 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.474713 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.474956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.475190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.475425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.475656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.475898 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.476173 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.476400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.476640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.476925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.477181 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.connection = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.477423 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.477666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.477902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.478138 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.478371 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.478605 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.478840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.479074 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.479316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.479555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.479796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.480029 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.480274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.480507 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.480779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.481010 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.481274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.481509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 06:22:58.481678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 06:22:58.500330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.500548 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.500810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.507077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.507308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.507532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.509251 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.516450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.537799 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.538035 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.542327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.542561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.592601 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.592798 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.643062 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.643224 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.643296 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.643359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.799072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.799300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.799391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.799530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.799640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.799751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.799836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.799966 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.800048 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.800179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.800262 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.800391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.823564 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.823797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.823891 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.824025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.824110 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.824249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.824333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.824466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.824560 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.824695 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.824782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.824914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.824998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.825176 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.836114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.836388 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.848624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.848845 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.849073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.849172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.849301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.849383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.849523 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.849606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.849738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.849826 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.849951 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.850033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81460) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.850165 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.850378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 06:22:58.867278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.867411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.867496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 06:22:58.867620 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 06:22:58.867819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.867963 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.868047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 06:22:58.868164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 06:22:58.868286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.868440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.868552 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.868727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.868849 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.868993 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.869112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.869248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.879250 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.879341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.879533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.879617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.879801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.879896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.880086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.880170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.887004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.887096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.889940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.890025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.890226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.890309 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.890509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.890592 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.890789 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.890874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.891073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.891156 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.891334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.891425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.891602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.891686 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.891876 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.891958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.892142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.892224 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.892411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.892493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.892698 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.892784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.915153 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.915422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.916602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.916910 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.916994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.917196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.922060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.922345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.922428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.922623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.922719 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.922946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.928925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.929209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.929293 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.929576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.935339 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.935634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.935720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.935918 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.936002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.936196 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.936280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.936467 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.936551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.936762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.936860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.937032 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.937116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.937296 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.937378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.937595 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.952724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.953005 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.953129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.953411 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.956932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.957299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.960131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.960425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.960507 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.960833 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.964601 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.965054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.968236 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.968691 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.971424 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.971724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.971876 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.972010 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.972179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.972296 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.972466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.972578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.972777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.972886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.973061 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.973345 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.988948 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.989237 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.989501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:58.989584 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.989763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.989857 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.990047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.990318 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.996805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.997430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.998386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.998997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:58.999883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.000165 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.000505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.000813 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.002887 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.003173 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.003463 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.003544 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.003744 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.003835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.004059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.004142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.004346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.004761 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.015273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.015557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.015836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.015947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.016112 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.016236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.016489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.016573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.016792 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.016879 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.017081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.017194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.017495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.017777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.032934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.033726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.035810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.036636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.038707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.039559 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.040205 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.041074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.041693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.041974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.042364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.042557 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.042842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.043237 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.049378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.050212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.050837 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.051677 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.053716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.054106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.054390 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.054585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.054751 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.054983 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.055273 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.055556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.062442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.062736 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.063025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.063398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.063692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.063977 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.069876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.070160 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.070443 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.070715 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.070897 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81460) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 06:22:59.070982 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.071184 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.071277 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.071472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.071556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.071750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.071834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.072025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.072118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.072301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.072384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.072570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.072655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.072852 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.072935 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.073122 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.073204 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.073386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.073470 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.073695 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.073984 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.074254 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.074523 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81460) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 06:22:59.108168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a109d779c0 pid: 81461 (default app) Sep 13 06:22:59.109436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a109d779c0 pid: 81460 (default app) Sep 13 06:22:59.111386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69c139-97b6-4f2e-8889-e8be50827498 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:22:59.111670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69c139-97b6-4f2e-8889-e8be50827498 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:22:59.111942 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca69c139-97b6-4f2e-8889-e8be50827498 None None] PATH_INFO: `/v3` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:22:59.116283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Tue Sep 13 06:22:59 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:05.827248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0e187-fe26-42ea-8aea-1a600f22dc88 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:05.827768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0e187-fe26-42ea-8aea-1a600f22dc88 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:05.827768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0e187-fe26-42ea-8aea-1a600f22dc88 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:05.832022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:05.837435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f709dd0-1b0f-4148-b889-e6209772e0fa None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:05.837877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f709dd0-1b0f-4148-b889-e6209772e0fa None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:05.838018 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f709dd0-1b0f-4148-b889-e6209772e0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:05.908716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: INFO dbcounter [None req-1f709dd0-1b0f-4148-b889-e6209772e0fa None None] Registered counter for database keystone Sep 13 06:23:05.927392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG oslo_db.sqlalchemy.engines [None req-1f709dd0-1b0f-4148-b889-e6209772e0fa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:23:05.934041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writer thread running {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:23:06.114138 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG passlib.handlers.bcrypt [None req-1f709dd0-1b0f-4148-b889-e6209772e0fa None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81461) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 06:23:06.114524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG passlib.handlers.bcrypt [None req-1f709dd0-1b0f-4148-b889-e6209772e0fa None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81461) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 06:23:06.173038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-1f709dd0-1b0f-4148-b889-e6209772e0fa None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:06.174595 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1f709dd0-1b0f-4148-b889-e6209772e0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:06.302658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 06:23:06.766918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0e187-fe26-42ea-8aea-1a600f22dc88 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:06.836070 dv-cinder-856385-1-smb devstack@keystone.service[81460]: INFO dbcounter [None req-09a0e187-fe26-42ea-8aea-1a600f22dc88 None None] Registered counter for database keystone Sep 13 06:23:06.857627 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG oslo_db.sqlalchemy.engines [None req-09a0e187-fe26-42ea-8aea-1a600f22dc88 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81460) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 06:23:06.863964 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writer thread running {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 06:23:06.983299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0e187-fe26-42ea-8aea-1a600f22dc88 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:06.987607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfebe24b-5066-4073-858a-03af650fca0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:06.988227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebe24b-5066-4073-858a-03af650fca0f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:06.988505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebe24b-5066-4073-858a-03af650fca0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:06.988816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfebe24b-5066-4073-858a-03af650fca0f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:06.998178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebe24b-5066-4073-858a-03af650fca0f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:07.049038 dv-cinder-856385-1-smb devstack@keystone.service[81460]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cfebe24b-5066-4073-858a-03af650fca0f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 06:23:07.049382 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfebe24b-5066-4073-858a-03af650fca0f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:07.058780 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Sep 13 06:23:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 06:23:07.065241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f709dd0-1b0f-4148-b889-e6209772e0fa None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:07.081918 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f709dd0-1b0f-4148-b889-e6209772e0fa None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:07.086486 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c729d37-542d-492c-8edd-937371757449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:07.087581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c729d37-542d-492c-8edd-937371757449 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:07.087867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c729d37-542d-492c-8edd-937371757449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:07.088142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c729d37-542d-492c-8edd-937371757449 admin admin] PATH_INFO: `/v3/projects/275d03b5a7094075b5f8d560d8a5be83` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:07.089778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c729d37-542d-492c-8edd-937371757449 admin admin] RBAC: Authorizing `identity:get_project(project_id=275d03b5a7094075b5f8d560d8a5be83)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:07.142794 dv-cinder-856385-1-smb devstack@keystone.service[81461]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0c729d37-542d-492c-8edd-937371757449 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 06:23:07.143139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c729d37-542d-492c-8edd-937371757449 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:07.147718 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Sep 13 06:23:07 2022] GET /identity/v3/projects/275d03b5a7094075b5f8d560d8a5be83 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:09.288483 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d64d7a-4d71-40dc-ac81-7989961f0789 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:09.289087 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d64d7a-4d71-40dc-ac81-7989961f0789 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:09.289087 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d64d7a-4d71-40dc-ac81-7989961f0789 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:09.293136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:09.299333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bca8d-6631-4d4d-bea2-ad1f95e00e52 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:09.299781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bca8d-6631-4d4d-bea2-ad1f95e00e52 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:09.299875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bca8d-6631-4d4d-bea2-ad1f95e00e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:09.319626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-7a9bca8d-6631-4d4d-bea2-ad1f95e00e52 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:09.321173 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-7a9bca8d-6631-4d4d-bea2-ad1f95e00e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:09.329885 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 06:23:09.593371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d64d7a-4d71-40dc-ac81-7989961f0789 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:09.605355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d64d7a-4d71-40dc-ac81-7989961f0789 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:09.609608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a18f0-c8aa-4f19-8500-53fc3865a3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:09.610206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a18f0-c8aa-4f19-8500-53fc3865a3bc admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:09.610488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a18f0-c8aa-4f19-8500-53fc3865a3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:09.610760 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a18f0-c8aa-4f19-8500-53fc3865a3bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:09.618620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a18f0-c8aa-4f19-8500-53fc3865a3bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:09.620381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a18f0-c8aa-4f19-8500-53fc3865a3bc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:09.629608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Sep 13 06:23:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 06:23:09.634863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bca8d-6631-4d4d-bea2-ad1f95e00e52 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:09.644586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bca8d-6631-4d4d-bea2-ad1f95e00e52 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:09.648930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67561f8e-e4a3-47a2-bc6f-18b2f7f2fb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:09.649552 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67561f8e-e4a3-47a2-bc6f-18b2f7f2fb51 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:09.649830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67561f8e-e4a3-47a2-bc6f-18b2f7f2fb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:09.650104 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67561f8e-e4a3-47a2-bc6f-18b2f7f2fb51 admin admin] PATH_INFO: `/v3/users/bcb0a034a4c8491eb41145193c3db0d0` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:09.651407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67561f8e-e4a3-47a2-bc6f-18b2f7f2fb51 admin admin] RBAC: Authorizing `identity:get_user(user_id=bcb0a034a4c8491eb41145193c3db0d0)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:09.653250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67561f8e-e4a3-47a2-bc6f-18b2f7f2fb51 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:09.654781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Sep 13 06:23:09 2022] GET /identity/v3/users/bcb0a034a4c8491eb41145193c3db0d0 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:11.867829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20231eed-17d5-48ce-b5d6-bf24af91f7a1 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:11.868364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20231eed-17d5-48ce-b5d6-bf24af91f7a1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:11.868364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20231eed-17d5-48ce-b5d6-bf24af91f7a1 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:11.869805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:11.875035 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b5764-5e86-4f01-ab5a-c9dfea766392 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:11.875429 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b5764-5e86-4f01-ab5a-c9dfea766392 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:11.875594 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896b5764-5e86-4f01-ab5a-c9dfea766392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:11.884379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b47fcd-291d-4c1a-befa-57044f6207ef None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:11.884661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b47fcd-291d-4c1a-befa-57044f6207ef None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:11.884962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b47fcd-291d-4c1a-befa-57044f6207ef None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:11.886234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:23:11.891331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692e028-2869-4ed2-aeed-e10705e4c0f3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:11.891619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692e028-2869-4ed2-aeed-e10705e4c0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:11.891898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692e028-2869-4ed2-aeed-e10705e4c0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:11.893532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-896b5764-5e86-4f01-ab5a-c9dfea766392 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:11.894772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-896b5764-5e86-4f01-ab5a-c9dfea766392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:11.934157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG passlib.handlers.bcrypt [None req-0692e028-2869-4ed2-aeed-e10705e4c0f3 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81460) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 06:23:11.934593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG passlib.handlers.bcrypt [None req-0692e028-2869-4ed2-aeed-e10705e4c0f3 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81460) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 06:23:11.975889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:11.983883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0692e028-2869-4ed2-aeed-e10705e4c0f3 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:11.985525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0692e028-2869-4ed2-aeed-e10705e4c0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:12.084771 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:23:12.251367 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b5764-5e86-4f01-ab5a-c9dfea766392 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:12.276789 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:12.350925 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692e028-2869-4ed2-aeed-e10705e4c0f3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:12.359933 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896b5764-5e86-4f01-ab5a-c9dfea766392 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:12.394515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da53794-26b6-4558-b4a9-dabcabde101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:12.395139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da53794-26b6-4558-b4a9-dabcabde101e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:12.395421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da53794-26b6-4558-b4a9-dabcabde101e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:12.395691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da53794-26b6-4558-b4a9-dabcabde101e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:12.407435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da53794-26b6-4558-b4a9-dabcabde101e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-6da53794-26b6-4558-b4a9-dabcabde101e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:12.416169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:12.417241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:12.418255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:12.418255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:12.418255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:12.418255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:12.418255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:12.418255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:12.418255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:12.418255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:12.418255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:12.418255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:12.418255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:12.418255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:12.418255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:23:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:12.423002 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da53794-26b6-4558-b4a9-dabcabde101e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:12.453688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692e028-2869-4ed2-aeed-e10705e4c0f3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:12.456010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:12.491056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac520cd-9f8f-43cc-a286-c527ab2feefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:12.492177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac520cd-9f8f-43cc-a286-c527ab2feefa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:12.492457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac520cd-9f8f-43cc-a286-c527ab2feefa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:12.492756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac520cd-9f8f-43cc-a286-c527ab2feefa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:12.504198 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:12.522928 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da53794-26b6-4558-b4a9-dabcabde101e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:12.556603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19b0cb-fcc2-4c13-9e5a-cee6c498354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:12.557235 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19b0cb-fcc2-4c13-9e5a-cee6c498354d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:12.557521 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19b0cb-fcc2-4c13-9e5a-cee6c498354d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:12.557808 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab19b0cb-fcc2-4c13-9e5a-cee6c498354d None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:12.558452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19b0cb-fcc2-4c13-9e5a-cee6c498354d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:12.558764 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19b0cb-fcc2-4c13-9e5a-cee6c498354d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:12.560688 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab19b0cb-fcc2-4c13-9e5a-cee6c498354d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:12.561458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac520cd-9f8f-43cc-a286-c527ab2feefa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:12.562962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac520cd-9f8f-43cc-a286-c527ab2feefa None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:12.572474 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:12.579099 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19b0cb-fcc2-4c13-9e5a-cee6c498354d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:12.664455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 06:23:12.670028 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac520cd-9f8f-43cc-a286-c527ab2feefa None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:12.672691 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:12.680059 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab19b0cb-fcc2-4c13-9e5a-cee6c498354d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:12.714459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cf7c1-8188-4dbc-aa77-37b582a66bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:12.715090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cf7c1-8188-4dbc-aa77-37b582a66bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:12.715369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cf7c1-8188-4dbc-aa77-37b582a66bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:12.715644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0cf7c1-8188-4dbc-aa77-37b582a66bd2 None admin] PATH_INFO: `/v3/users/bcb0a034a4c8491eb41145193c3db0d0` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:12.716887 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cf7c1-8188-4dbc-aa77-37b582a66bd2 None admin] RBAC: Authorizing `identity:get_user(user_id=bcb0a034a4c8491eb41145193c3db0d0)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:12.718337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0cf7c1-8188-4dbc-aa77-37b582a66bd2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:12.719890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:12 2022] GET /identity/v3/users/bcb0a034a4c8491eb41145193c3db0d0 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:12.725366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cf7c1-8188-4dbc-aa77-37b582a66bd2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:12.739839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:12.771590 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac520cd-9f8f-43cc-a286-c527ab2feefa None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:12.805450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cb120-640f-47fc-a6ea-30f4f7dae32b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:12.806307 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cb120-640f-47fc-a6ea-30f4f7dae32b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:12.806585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cb120-640f-47fc-a6ea-30f4f7dae32b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:12.806855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1cb120-640f-47fc-a6ea-30f4f7dae32b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:12.825117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0cf7c1-8188-4dbc-aa77-37b582a66bd2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:12.825534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cb120-640f-47fc-a6ea-30f4f7dae32b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:12.827019 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1cb120-640f-47fc-a6ea-30f4f7dae32b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-7b1cb120-640f-47fc-a6ea-30f4f7dae32b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:23:12.844902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:12.845768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:23:12.846584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:23:12.846584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:23:12.846584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:12.846584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 9/18] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:23:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:23:12.851875 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cb120-640f-47fc-a6ea-30f4f7dae32b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:12.858402 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c934078-a846-42cd-b777-c4f4443bad23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:12.859036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c934078-a846-42cd-b777-c4f4443bad23 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:12.859316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c934078-a846-42cd-b777-c4f4443bad23 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:12.859589 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c934078-a846-42cd-b777-c4f4443bad23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:12.860730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c934078-a846-42cd-b777-c4f4443bad23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:12.862189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c934078-a846-42cd-b777-c4f4443bad23 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:12.863727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 10/19] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:23:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:12.869562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c934078-a846-42cd-b777-c4f4443bad23 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:12.907418 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:12.949319 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:12.955954 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1cb120-640f-47fc-a6ea-30f4f7dae32b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:12.968551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c934078-a846-42cd-b777-c4f4443bad23 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:12.989007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1525fe-b183-43bb-8bc6-aa4643018030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:12.989615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1525fe-b183-43bb-8bc6-aa4643018030 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:12.989900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1525fe-b183-43bb-8bc6-aa4643018030 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:12.990176 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1525fe-b183-43bb-8bc6-aa4643018030 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:12.990820 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1525fe-b183-43bb-8bc6-aa4643018030 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:12.991123 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1525fe-b183-43bb-8bc6-aa4643018030 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:12.992797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1525fe-b183-43bb-8bc6-aa4643018030 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:13.002413 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a6f7b-59bf-4bb3-8abc-8f11fc66e088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:13.003007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a6f7b-59bf-4bb3-8abc-8f11fc66e088 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:13.003286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a6f7b-59bf-4bb3-8abc-8f11fc66e088 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:13.003561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a6f7b-59bf-4bb3-8abc-8f11fc66e088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:13.004282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a6f7b-59bf-4bb3-8abc-8f11fc66e088 None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.domain.id=default, user.id=bcb0a034a4c8491eb41145193c3db0d0) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:13.004592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a6f7b-59bf-4bb3-8abc-8f11fc66e088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:13.006036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a6f7b-59bf-4bb3-8abc-8f11fc66e088 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:13.010275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 10/20] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:13.012528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 11/21] 10.222.0.42 () {56 vars in 1322 bytes} [Tue Sep 13 06:23:12 2022] GET /identity/v3/role_assignments?user.id=bcb0a034a4c8491eb41145193c3db0d0&scope.domain.id=default&role.id=6382a06103714d068409d25cbeb48744 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:15.374101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991e20a-281c-4778-bd71-faab196bf3bd None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:15.374613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991e20a-281c-4778-bd71-faab196bf3bd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:15.374687 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991e20a-281c-4778-bd71-faab196bf3bd None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:15.375971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 11/22] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:15.381480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb935d-40a1-4649-b838-859c0db5ef55 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:15.381967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb935d-40a1-4649-b838-859c0db5ef55 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:15.382057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bb935d-40a1-4649-b838-859c0db5ef55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:15.401558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-97bb935d-40a1-4649-b838-859c0db5ef55 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:15.402779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-97bb935d-40a1-4649-b838-859c0db5ef55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:15.483255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 12/23] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:23:15.620955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbf4c1-93fe-4bb0-9ed3-a0ca1f229aa9 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:15.621238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbf4c1-93fe-4bb0-9ed3-a0ca1f229aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:15.621506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbf4c1-93fe-4bb0-9ed3-a0ca1f229aa9 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:15.625753 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:15.631467 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39558a62-e0b0-43af-8040-f144eee1878b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:15.631761 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39558a62-e0b0-43af-8040-f144eee1878b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:15.632036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39558a62-e0b0-43af-8040-f144eee1878b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:15.662103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-39558a62-e0b0-43af-8040-f144eee1878b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:15.663305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-39558a62-e0b0-43af-8040-f144eee1878b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:15.757996 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 13/25] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:16.063118 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbf4c1-93fe-4bb0-9ed3-a0ca1f229aa9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:16.096699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbc48b-94b1-4433-aa9b-89865ea63694 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:16.097327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbc48b-94b1-4433-aa9b-89865ea63694 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:16.097814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbc48b-94b1-4433-aa9b-89865ea63694 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:16.099607 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 14/26] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:16.105135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2845a7a-c39a-427e-ac2a-9755042a2d1d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:16.105656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2845a7a-c39a-427e-ac2a-9755042a2d1d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:16.106141 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2845a7a-c39a-427e-ac2a-9755042a2d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:16.114542 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:16.127655 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e2845a7a-c39a-427e-ac2a-9755042a2d1d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:16.129349 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e2845a7a-c39a-427e-ac2a-9755042a2d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:16.230683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbf4c1-93fe-4bb0-9ed3-a0ca1f229aa9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:16.244344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 15/27] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:23:16.245879 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe431fd-3a19-4160-90da-c7b0dbb08c5f None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:16.246451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe431fd-3a19-4160-90da-c7b0dbb08c5f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:16.252117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe431fd-3a19-4160-90da-c7b0dbb08c5f None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:16.252117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 16/28] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:16.253547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe431fd-3a19-4160-90da-c7b0dbb08c5f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:16.268760 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:16.303964 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3be1948-55df-4690-b7f5-90b80080678f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:16.304602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be1948-55df-4690-b7f5-90b80080678f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:16.306515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be1948-55df-4690-b7f5-90b80080678f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:16.306515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3be1948-55df-4690-b7f5-90b80080678f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:16.332574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3be1948-55df-4690-b7f5-90b80080678f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a3be1948-55df-4690-b7f5-90b80080678f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:16.338678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:16.339542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:16.340304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:16.340304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:16.340304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:16.340304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:16.340304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:16.340304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:16.340304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:16.340304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:16.340304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:16.340304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:16.340304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:16.340304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:16.340304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 13/29] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:23:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:16.341873 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe989b-bf39-4b76-8fc5-5346b4774809 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:16.342943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe989b-bf39-4b76-8fc5-5346b4774809 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:16.342943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afe989b-bf39-4b76-8fc5-5346b4774809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:16.362463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9afe989b-bf39-4b76-8fc5-5346b4774809 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:16.363725 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9afe989b-bf39-4b76-8fc5-5346b4774809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:16.467209 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 14/30] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:16.468061 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe989b-bf39-4b76-8fc5-5346b4774809 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:16.473644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe431fd-3a19-4160-90da-c7b0dbb08c5f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:16.535983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fd8ba-2baf-45a0-b8f7-732b059755e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:16.537151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fd8ba-2baf-45a0-b8f7-732b059755e4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:16.537646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fd8ba-2baf-45a0-b8f7-732b059755e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:16.538335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50fd8ba-2baf-45a0-b8f7-732b059755e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:16.543575 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:16.559043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fd8ba-2baf-45a0-b8f7-732b059755e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:16.560948 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50fd8ba-2baf-45a0-b8f7-732b059755e4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c50fd8ba-2baf-45a0-b8f7-732b059755e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:23:16.588354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:16.593838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:23:16.594646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:23:16.594646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:23:16.594646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:16.597677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 17/31] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:23:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:16.603890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fd8ba-2baf-45a0-b8f7-732b059755e4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:16.693852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afe989b-bf39-4b76-8fc5-5346b4774809 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:16.708460 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:16.754558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f8eac-4652-414c-8ca0-4a22bc43dc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:16.755182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f8eac-4652-414c-8ca0-4a22bc43dc15 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:16.755461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f8eac-4652-414c-8ca0-4a22bc43dc15 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:16.755736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f8eac-4652-414c-8ca0-4a22bc43dc15 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:16.756409 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f8eac-4652-414c-8ca0-4a22bc43dc15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:16.758284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f8eac-4652-414c-8ca0-4a22bc43dc15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:16.759692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f8eac-4652-414c-8ca0-4a22bc43dc15 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:16.774480 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 15/32] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:16.775397 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f8eac-4652-414c-8ca0-4a22bc43dc15 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:16.807894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50fd8ba-2baf-45a0-b8f7-732b059755e4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:16.873579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949ca6d-3b3f-49cc-91f7-ada8e8db529a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:16.874175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949ca6d-3b3f-49cc-91f7-ada8e8db529a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:16.874461 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949ca6d-3b3f-49cc-91f7-ada8e8db529a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:16.874732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3949ca6d-3b3f-49cc-91f7-ada8e8db529a None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:16.875385 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949ca6d-3b3f-49cc-91f7-ada8e8db529a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:16.875687 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949ca6d-3b3f-49cc-91f7-ada8e8db529a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:16.877098 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3949ca6d-3b3f-49cc-91f7-ada8e8db529a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:16.899983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 18/33] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:16.900888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949ca6d-3b3f-49cc-91f7-ada8e8db529a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:16.934113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f8eac-4652-414c-8ca0-4a22bc43dc15 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:16.957508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:16.971511 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4920289-7b32-4090-8c0b-e607a499ba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:16.972454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4920289-7b32-4090-8c0b-e607a499ba00 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:16.972974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4920289-7b32-4090-8c0b-e607a499ba00 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:16.973317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4920289-7b32-4090-8c0b-e607a499ba00 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:16.974062 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4920289-7b32-4090-8c0b-e607a499ba00 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:16.975526 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4920289-7b32-4090-8c0b-e607a499ba00 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:17.018877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3949ca6d-3b3f-49cc-91f7-ada8e8db529a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:17.055553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d383b3-c0cd-458a-86f1-aa07f15ced44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:17.056509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d383b3-c0cd-458a-86f1-aa07f15ced44 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:17.056991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d383b3-c0cd-458a-86f1-aa07f15ced44 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:17.057469 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d383b3-c0cd-458a-86f1-aa07f15ced44 None admin] PATH_INFO: `/v3/users/bcb0a034a4c8491eb41145193c3db0d0` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:17.058772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d383b3-c0cd-458a-86f1-aa07f15ced44 None admin] RBAC: Authorizing `identity:get_user(user_id=bcb0a034a4c8491eb41145193c3db0d0)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:17.060480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d383b3-c0cd-458a-86f1-aa07f15ced44 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:17.062266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 19/34] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:16 2022] GET /identity/v3/users/bcb0a034a4c8491eb41145193c3db0d0 => generated 247 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:17.063170 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d383b3-c0cd-458a-86f1-aa07f15ced44 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:17.111346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 16/35] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Sep 13 06:23:16 2022] POST /identity/v3/roles => generated 225 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:23:17.112310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4920289-7b32-4090-8c0b-e607a499ba00 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:17.157552 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:17.206075 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d383b3-c0cd-458a-86f1-aa07f15ced44 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:17.252332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4920289-7b32-4090-8c0b-e607a499ba00 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:17.256062 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:17.263956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8f3a0-965e-466a-98b9-a44206a386aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:17.265279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8f3a0-965e-466a-98b9-a44206a386aa None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:17.265648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8f3a0-965e-466a-98b9-a44206a386aa None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:17.266001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8f3a0-965e-466a-98b9-a44206a386aa None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:17.267209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8f3a0-965e-466a-98b9-a44206a386aa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:17.269061 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8f3a0-965e-466a-98b9-a44206a386aa None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:17.295915 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c9bbd4-912c-4f5e-aa3d-64e8bd775b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:17.296978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9bbd4-912c-4f5e-aa3d-64e8bd775b54 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:17.297367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9bbd4-912c-4f5e-aa3d-64e8bd775b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:17.297710 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9bbd4-912c-4f5e-aa3d-64e8bd775b54 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:17.300171 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9bbd4-912c-4f5e-aa3d-64e8bd775b54 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:17.300551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c9bbd4-912c-4f5e-aa3d-64e8bd775b54 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:17.335089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 17/36] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 13 06:23:17 2022] POST /identity/v3/projects => generated 301 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:23:17.336531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a5c26-0064-42bc-8a6e-2c2d0ff0da9c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:17.336854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a5c26-0064-42bc-8a6e-2c2d0ff0da9c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:17.337130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a5c26-0064-42bc-8a6e-2c2d0ff0da9c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:17.338376 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 18/37] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:17.344107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a5c26-0064-42bc-8a6e-2c2d0ff0da9c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:17.447204 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:17.473445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a5c26-0064-42bc-8a6e-2c2d0ff0da9c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:17.511546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a432c7-dcae-49da-865c-2e11ce99aeeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:17.512184 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a432c7-dcae-49da-865c-2e11ce99aeeb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:17.512469 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a432c7-dcae-49da-865c-2e11ce99aeeb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:17.512765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a432c7-dcae-49da-865c-2e11ce99aeeb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:17.514547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a432c7-dcae-49da-865c-2e11ce99aeeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:17.515991 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a432c7-dcae-49da-865c-2e11ce99aeeb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:17.523956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 19/38] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:23:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:17.524157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 20/39] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Sep 13 06:23:17 2022] POST /identity/v3/roles => generated 219 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:23:17.524157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fa35f-3e6a-40a7-95a4-4c9b74cc1263 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:17.524157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fa35f-3e6a-40a7-95a4-4c9b74cc1263 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:17.524157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fa35f-3e6a-40a7-95a4-4c9b74cc1263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:17.526142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f0ac2-8aae-4ab7-b1e3-9e37355d3efa None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:17.526432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f0ac2-8aae-4ab7-b1e3-9e37355d3efa None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:17.526709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f0ac2-8aae-4ab7-b1e3-9e37355d3efa None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:17.528082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 20/40] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:17.529516 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f0ac2-8aae-4ab7-b1e3-9e37355d3efa None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:17.547792 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-1e1fa35f-3e6a-40a7-95a4-4c9b74cc1263 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:17.549469 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1e1fa35f-3e6a-40a7-95a4-4c9b74cc1263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:17.650407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 21/41] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:17.655699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1d77f-c265-4fa6-842a-e76001547c85 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:17.655699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1d77f-c265-4fa6-842a-e76001547c85 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:17.655699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b1d77f-c265-4fa6-842a-e76001547c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:17.674579 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f0ac2-8aae-4ab7-b1e3-9e37355d3efa None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:17.675782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f8b1d77f-c265-4fa6-842a-e76001547c85 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:17.678258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f8b1d77f-c265-4fa6-842a-e76001547c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:17.719194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a718d3c-2c1c-4ac4-9566-525115ba65d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:17.719781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a718d3c-2c1c-4ac4-9566-525115ba65d7 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:17.720116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a718d3c-2c1c-4ac4-9566-525115ba65d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:17.720397 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a718d3c-2c1c-4ac4-9566-525115ba65d7 None admin] PATH_INFO: `/v3/domains/default/users/bcb0a034a4c8491eb41145193c3db0d0/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:17.722757 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a718d3c-2c1c-4ac4-9566-525115ba65d7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bcb0a034a4c8491eb41145193c3db0d0, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:17.725141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a718d3c-2c1c-4ac4-9566-525115ba65d7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:17.744189 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 21/42] 10.222.0.42 () {58 vars in 1361 bytes} [Tue Sep 13 06:23:17 2022] PUT /identity/v3/domains/default/users/bcb0a034a4c8491eb41145193c3db0d0/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:23:17.770156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 22/43] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:17.930130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a718d3c-2c1c-4ac4-9566-525115ba65d7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:17.942154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:18.033693 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a718d3c-2c1c-4ac4-9566-525115ba65d7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:18.042341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1d77f-c265-4fa6-842a-e76001547c85 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:18.069133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7b4f7-0738-4101-8938-c5529c6fb50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:18.069819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7b4f7-0738-4101-8938-c5529c6fb50a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:18.070109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7b4f7-0738-4101-8938-c5529c6fb50a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:18.070394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e7b4f7-0738-4101-8938-c5529c6fb50a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:18.072279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7b4f7-0738-4101-8938-c5529c6fb50a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:18.073745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e7b4f7-0738-4101-8938-c5529c6fb50a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:18.075531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 22/44] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:23:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:18.078458 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:18.080837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7b4f7-0738-4101-8938-c5529c6fb50a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:18.154830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b1d77f-c265-4fa6-842a-e76001547c85 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:18.165438 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:18.191611 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e7b4f7-0738-4101-8938-c5529c6fb50a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:18.193635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab818b88-de3a-46ec-b544-b7798ed0d673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:18.194276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab818b88-de3a-46ec-b544-b7798ed0d673 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:18.194561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab818b88-de3a-46ec-b544-b7798ed0d673 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:18.194838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab818b88-de3a-46ec-b544-b7798ed0d673 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:18.195525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab818b88-de3a-46ec-b544-b7798ed0d673 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:18.197068 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab818b88-de3a-46ec-b544-b7798ed0d673 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:18.212397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Sep 13 06:23:18 2022] POST /identity/v3/roles => generated 223 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:23:18.230700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2fb36-2781-42d6-b80b-f74724928941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:18.231470 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2fb36-2781-42d6-b80b-f74724928941 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:18.232323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2fb36-2781-42d6-b80b-f74724928941 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:18.232601 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2fb36-2781-42d6-b80b-f74724928941 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:18.233429 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2fb36-2781-42d6-b80b-f74724928941 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:18.235010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a2fb36-2781-42d6-b80b-f74724928941 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:18.267506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 13 06:23:18 2022] POST /identity/v3/projects => generated 312 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:23:19.928989 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb26f3-75a1-46c3-8784-a7145639b3ae None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:19.929531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb26f3-75a1-46c3-8784-a7145639b3ae None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:19.929531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdb26f3-75a1-46c3-8784-a7145639b3ae None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:19.930879 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 24/47] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:19.936879 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f2f1d-4eaa-4dd0-a4b3-dae43a908929 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:19.937297 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f2f1d-4eaa-4dd0-a4b3-dae43a908929 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:19.937439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141f2f1d-4eaa-4dd0-a4b3-dae43a908929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:19.955318 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-141f2f1d-4eaa-4dd0-a4b3-dae43a908929 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:19.956864 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-141f2f1d-4eaa-4dd0-a4b3-dae43a908929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:20.023555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 24/48] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:20.290607 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb26f3-75a1-46c3-8784-a7145639b3ae None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:20.391182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:20.399400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdb26f3-75a1-46c3-8784-a7145639b3ae None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:20.428621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48a18b-49e9-432b-ba8e-043a4d46da33 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:20.429025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48a18b-49e9-432b-ba8e-043a4d46da33 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:20.429372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48a18b-49e9-432b-ba8e-043a4d46da33 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:20.430718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 25/49] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:23:20.432822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7479a-83fa-4db2-9716-32bac9c5af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:20.433445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7479a-83fa-4db2-9716-32bac9c5af38 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:20.433724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7479a-83fa-4db2-9716-32bac9c5af38 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:20.433994 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7479a-83fa-4db2-9716-32bac9c5af38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:20.435594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb76bd-236b-4d34-8b10-c0f69e0b40ef None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:20.435887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb76bd-236b-4d34-8b10-c0f69e0b40ef None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:20.436165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb76bd-236b-4d34-8b10-c0f69e0b40ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:20.444538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7479a-83fa-4db2-9716-32bac9c5af38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-09e7479a-83fa-4db2-9716-32bac9c5af38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:20.449693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:20.451079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:20.451819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:20.451819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:20.451819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:20.451819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:20.451819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:20.451819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:20.451819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:20.451819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:20.451819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:20.451819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:20.451819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:20.451819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:20.451819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 25/50] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:23:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:20.454624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4deb76bd-236b-4d34-8b10-c0f69e0b40ef None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:20.455913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4deb76bd-236b-4d34-8b10-c0f69e0b40ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:20.456892 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7479a-83fa-4db2-9716-32bac9c5af38 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:20.509901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:20.524738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 26/51] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:23:20.555763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7479a-83fa-4db2-9716-32bac9c5af38 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:20.588616 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c189681-023a-48ef-93f7-f7376164a63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:20.589241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c189681-023a-48ef-93f7-f7376164a63e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:20.589523 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c189681-023a-48ef-93f7-f7376164a63e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:20.589799 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c189681-023a-48ef-93f7-f7376164a63e None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:20.590471 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c189681-023a-48ef-93f7-f7376164a63e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:20.590775 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c189681-023a-48ef-93f7-f7376164a63e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:20.592778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c189681-023a-48ef-93f7-f7376164a63e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:20.600635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 26/52] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:20.606320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb76bd-236b-4d34-8b10-c0f69e0b40ef None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:20.706716 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb76bd-236b-4d34-8b10-c0f69e0b40ef None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:20.738767 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beebb70-9e41-4b4c-b7e4-e1ccda8a4fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:20.739398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beebb70-9e41-4b4c-b7e4-e1ccda8a4fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:20.739684 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beebb70-9e41-4b4c-b7e4-e1ccda8a4fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:20.739963 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beebb70-9e41-4b4c-b7e4-e1ccda8a4fb4 None admin] PATH_INFO: `/v3/users/bcb0a034a4c8491eb41145193c3db0d0` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:20.741115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beebb70-9e41-4b4c-b7e4-e1ccda8a4fb4 None admin] RBAC: Authorizing `identity:get_user(user_id=bcb0a034a4c8491eb41145193c3db0d0)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:20.742830 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beebb70-9e41-4b4c-b7e4-e1ccda8a4fb4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:20.744389 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:20 2022] GET /identity/v3/users/bcb0a034a4c8491eb41145193c3db0d0 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:20.750453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c189681-023a-48ef-93f7-f7376164a63e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:20.769160 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:20.791763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beebb70-9e41-4b4c-b7e4-e1ccda8a4fb4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:20.849522 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:20.850996 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c189681-023a-48ef-93f7-f7376164a63e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:20.885812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe5143-7cbd-4e30-a135-f75382247d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:20.886440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe5143-7cbd-4e30-a135-f75382247d9f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:20.886725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe5143-7cbd-4e30-a135-f75382247d9f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:20.887004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe5143-7cbd-4e30-a135-f75382247d9f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:20.888684 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe5143-7cbd-4e30-a135-f75382247d9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:20.890174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe5143-7cbd-4e30-a135-f75382247d9f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:20.891737 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 27/54] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:23:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:20.894176 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beebb70-9e41-4b4c-b7e4-e1ccda8a4fb4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:20.897555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe5143-7cbd-4e30-a135-f75382247d9f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:20.986754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:21.004795 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe5143-7cbd-4e30-a135-f75382247d9f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:21.032142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662dc28-5822-4b6f-9096-6133f11d32c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:21.032817 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662dc28-5822-4b6f-9096-6133f11d32c5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:21.033097 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662dc28-5822-4b6f-9096-6133f11d32c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:21.033374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662dc28-5822-4b6f-9096-6133f11d32c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:21.034532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662dc28-5822-4b6f-9096-6133f11d32c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:21.035971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7662dc28-5822-4b6f-9096-6133f11d32c5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:21.037556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:23:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:21.040511 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e912fb8-eb45-4087-a69c-cb5980380112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:21.041143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e912fb8-eb45-4087-a69c-cb5980380112 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:21.041428 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e912fb8-eb45-4087-a69c-cb5980380112 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:21.041705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e912fb8-eb45-4087-a69c-cb5980380112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:21.042711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e912fb8-eb45-4087-a69c-cb5980380112 None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.domain.id=default, user.id=bcb0a034a4c8491eb41145193c3db0d0) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:21.042938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662dc28-5822-4b6f-9096-6133f11d32c5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:21.043027 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e912fb8-eb45-4087-a69c-cb5980380112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:21.045016 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e912fb8-eb45-4087-a69c-cb5980380112 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:21.050818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 28/56] 10.222.0.42 () {56 vars in 1322 bytes} [Tue Sep 13 06:23:20 2022] GET /identity/v3/role_assignments?user.id=bcb0a034a4c8491eb41145193c3db0d0&scope.domain.id=default&role.id=6382a06103714d068409d25cbeb48744 => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:21.148855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662dc28-5822-4b6f-9096-6133f11d32c5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:21.173233 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:21.184504 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da58cc39-5c4f-4ca2-b13f-b63c4c0e00a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:21.185215 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58cc39-5c4f-4ca2-b13f-b63c4c0e00a4 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:21.185497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58cc39-5c4f-4ca2-b13f-b63c4c0e00a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:21.185769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58cc39-5c4f-4ca2-b13f-b63c4c0e00a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:21.186435 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58cc39-5c4f-4ca2-b13f-b63c4c0e00a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:21.187896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da58cc39-5c4f-4ca2-b13f-b63c4c0e00a4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:21.217290 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 29/57] 10.222.0.42 () {60 vars in 1140 bytes} [Tue Sep 13 06:23:21 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:23:23.360884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d669a-ccba-4a2a-bae8-2818a4458b36 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:23.361432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d669a-ccba-4a2a-bae8-2818a4458b36 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:23.361432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d669a-ccba-4a2a-bae8-2818a4458b36 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:23.362769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 29/58] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:23.368197 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793956c-1801-4e83-8fa6-d06ec62ab3af None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:23.368609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793956c-1801-4e83-8fa6-d06ec62ab3af None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:23.368783 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793956c-1801-4e83-8fa6-d06ec62ab3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:23.388569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4793956c-1801-4e83-8fa6-d06ec62ab3af None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:23.389798 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4793956c-1801-4e83-8fa6-d06ec62ab3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:23.453281 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 30/59] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:23.719191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d669a-ccba-4a2a-bae8-2818a4458b36 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:23.818733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d669a-ccba-4a2a-bae8-2818a4458b36 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:23.850896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4bf7f3-af81-41e3-b2b8-aa2062fe58f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:23.851508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bf7f3-af81-41e3-b2b8-aa2062fe58f6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:23.851786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bf7f3-af81-41e3-b2b8-aa2062fe58f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:23.852059 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4bf7f3-af81-41e3-b2b8-aa2062fe58f6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:23.853188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bf7f3-af81-41e3-b2b8-aa2062fe58f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:23.854618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4bf7f3-af81-41e3-b2b8-aa2062fe58f6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:23.856146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 30/60] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:23:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:23.862073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793956c-1801-4e83-8fa6-d06ec62ab3af None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:23.956489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4793956c-1801-4e83-8fa6-d06ec62ab3af None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:23.963440 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:23.990885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f451af7-6424-4e5d-a658-6f1296acaa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:23.991483 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f451af7-6424-4e5d-a658-6f1296acaa68 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:23.991767 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f451af7-6424-4e5d-a658-6f1296acaa68 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:23.992041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f451af7-6424-4e5d-a658-6f1296acaa68 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:23.992982 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f451af7-6424-4e5d-a658-6f1296acaa68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:23.994415 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f451af7-6424-4e5d-a658-6f1296acaa68 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:24.019303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 31/61] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:23:23 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:23:27.240229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353751c-3337-47e0-bebd-b97b0a4faef9 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:27.240229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353751c-3337-47e0-bebd-b97b0a4faef9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:27.240229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353751c-3337-47e0-bebd-b97b0a4faef9 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:27.240229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 31/62] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:27.246178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae454e7-052b-498c-a018-c1e64a07285f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:27.246577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae454e7-052b-498c-a018-c1e64a07285f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:27.246732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae454e7-052b-498c-a018-c1e64a07285f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:27.273982 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bae454e7-052b-498c-a018-c1e64a07285f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:27.275173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bae454e7-052b-498c-a018-c1e64a07285f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:27.398291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 32/63] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:27.655190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98229761-010b-444e-b0ed-b768e90acdc8 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:27.655732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98229761-010b-444e-b0ed-b768e90acdc8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:27.656197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98229761-010b-444e-b0ed-b768e90acdc8 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:27.657776 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 32/64] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:27.663394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a6ae6-ae06-48c8-9779-0bdd00c1c89d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:27.663916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a6ae6-ae06-48c8-9779-0bdd00c1c89d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:27.664373 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67a6ae6-ae06-48c8-9779-0bdd00c1c89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:27.689598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a67a6ae6-ae06-48c8-9779-0bdd00c1c89d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:27.691119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a67a6ae6-ae06-48c8-9779-0bdd00c1c89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:27.725902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd3b69-fbbc-4af3-ad6c-ea577ad3e149 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:27.725902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd3b69-fbbc-4af3-ad6c-ea577ad3e149 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:27.725902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd3b69-fbbc-4af3-ad6c-ea577ad3e149 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:27.725902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 33/65] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:23:27.738523 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defeb87-5f79-408a-b978-b8a776f0fb99 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:27.738814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defeb87-5f79-408a-b978-b8a776f0fb99 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:27.739095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4defeb87-5f79-408a-b978-b8a776f0fb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:27.769227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-4defeb87-5f79-408a-b978-b8a776f0fb99 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:27.771343 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4defeb87-5f79-408a-b978-b8a776f0fb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:27.788175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:27.809828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 33/66] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:27.812391 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a6ae6-ae06-48c8-9779-0bdd00c1c89d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:27.838003 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:27.875514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 34/67] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:23:27.943881 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67a6ae6-ae06-48c8-9779-0bdd00c1c89d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:27.979840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869f2407-656d-469d-91a6-84be0b321fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:27.980481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f2407-656d-469d-91a6-84be0b321fa6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:27.980793 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f2407-656d-469d-91a6-84be0b321fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:27.981070 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869f2407-656d-469d-91a6-84be0b321fa6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:27.991886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869f2407-656d-469d-91a6-84be0b321fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-869f2407-656d-469d-91a6-84be0b321fa6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:27.997085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:27.998481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:27.999628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:27.999628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:27.999628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:27.999628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:27.999628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:27.999628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:27.999628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:27.999628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:27.999628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:27.999628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:27.999628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:27.999628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:27.999628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 34/68] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:28.004576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defeb87-5f79-408a-b978-b8a776f0fb99 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:28.067831 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018a3cb-055f-40a8-8f3a-22c2a5f4e1ee None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:28.068140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018a3cb-055f-40a8-8f3a-22c2a5f4e1ee None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:28.068395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2018a3cb-055f-40a8-8f3a-22c2a5f4e1ee None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:28.069763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 35/69] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:28.075047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddbc60-b41a-4992-b2dc-0858f147b3c8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:28.075337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddbc60-b41a-4992-b2dc-0858f147b3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:28.075650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ddbc60-b41a-4992-b2dc-0858f147b3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:28.107498 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-86ddbc60-b41a-4992-b2dc-0858f147b3c8 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:28.108791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-86ddbc60-b41a-4992-b2dc-0858f147b3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:28.159020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4defeb87-5f79-408a-b978-b8a776f0fb99 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:28.204815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 36/70] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:23:28.213938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddbc60-b41a-4992-b2dc-0858f147b3c8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:28.214521 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76576bac-eef0-414b-b51c-b171fb0726ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:28.215341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576bac-eef0-414b-b51c-b171fb0726ac None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:28.215810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576bac-eef0-414b-b51c-b171fb0726ac None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:28.216839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76576bac-eef0-414b-b51c-b171fb0726ac None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:28.217959 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76576bac-eef0-414b-b51c-b171fb0726ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:28.218446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76576bac-eef0-414b-b51c-b171fb0726ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:28.221032 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76576bac-eef0-414b-b51c-b171fb0726ac None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:28.232468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:28.233338 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:28.235245 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7ef20-aab7-446b-95bf-c4a3dc374d46 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:28.235750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7ef20-aab7-446b-95bf-c4a3dc374d46 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:28.236310 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c7ef20-aab7-446b-95bf-c4a3dc374d46 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:28.238496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 36/72] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:28.239837 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7ef20-aab7-446b-95bf-c4a3dc374d46 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:28.251310 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:28.323770 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ddbc60-b41a-4992-b2dc-0858f147b3c8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:28.353835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c7ef20-aab7-446b-95bf-c4a3dc374d46 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:28.357562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433639e5-f4dd-4458-bbad-a30b846ce9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:28.358193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433639e5-f4dd-4458-bbad-a30b846ce9ef None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:28.358473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433639e5-f4dd-4458-bbad-a30b846ce9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:28.358743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433639e5-f4dd-4458-bbad-a30b846ce9ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:28.369200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433639e5-f4dd-4458-bbad-a30b846ce9ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-433639e5-f4dd-4458-bbad-a30b846ce9ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:28.374057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:28.374913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:28.380501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:28.380501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:28.380501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:28.380501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:28.380501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:28.380501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:28.380501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:28.380501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:28.380501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:28.380501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:28.380501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:23:28.380501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:28.380501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 37/73] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:23:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:28.380501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433639e5-f4dd-4458-bbad-a30b846ce9ef None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:28.397213 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c29313-d791-498e-a1b4-a5d1e5daf7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:28.397905 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c29313-d791-498e-a1b4-a5d1e5daf7d5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:28.398190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c29313-d791-498e-a1b4-a5d1e5daf7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:28.398464 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c29313-d791-498e-a1b4-a5d1e5daf7d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:28.410234 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c29313-d791-498e-a1b4-a5d1e5daf7d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-e3c29313-d791-498e-a1b4-a5d1e5daf7d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:28.415311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:28.416162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:28.417095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:28.417095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:28.417095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:28.417095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:28.417095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:28.417095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:28.417095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:28.417095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:28.417095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:28.417095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:28.417095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:28.417095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:28.417095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 37/74] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:23:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:28.418213 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f7113-35fb-4f28-9272-ba1ed8283d4f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:28.418213 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f7113-35fb-4f28-9272-ba1ed8283d4f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:28.418432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f7113-35fb-4f28-9272-ba1ed8283d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:28.439992 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d10f7113-35fb-4f28-9272-ba1ed8283d4f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:28.441244 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d10f7113-35fb-4f28-9272-ba1ed8283d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:28.451654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:28.485015 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433639e5-f4dd-4458-bbad-a30b846ce9ef None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:28.505313 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:28.510861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 38/75] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:28.517551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f7113-35fb-4f28-9272-ba1ed8283d4f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:28.519800 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a099d-1b04-49fd-8ddd-967beba9e91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:28.520448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a099d-1b04-49fd-8ddd-967beba9e91d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:28.520762 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a099d-1b04-49fd-8ddd-967beba9e91d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:28.521058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a099d-1b04-49fd-8ddd-967beba9e91d None admin] PATH_INFO: `/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:28.536454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a099d-1b04-49fd-8ddd-967beba9e91d None admin] RBAC: Authorizing `identity:get_user(user_id=b1eaabedfbf1451aa63ab57fb37bf6cf)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:28.537950 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86a099d-1b04-49fd-8ddd-967beba9e91d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:28.539589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 38/76] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:28 2022] GET /identity/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:28.540346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a099d-1b04-49fd-8ddd-967beba9e91d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:28.639619 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f7113-35fb-4f28-9272-ba1ed8283d4f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:28.649119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a099d-1b04-49fd-8ddd-967beba9e91d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:28.676328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1f741-0469-4da5-9b9a-9cde7a447ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:28.676975 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1f741-0469-4da5-9b9a-9cde7a447ebb None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:28.677260 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1f741-0469-4da5-9b9a-9cde7a447ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:28.677536 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1f741-0469-4da5-9b9a-9cde7a447ebb None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:28.678200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1f741-0469-4da5-9b9a-9cde7a447ebb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:28.678509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1f741-0469-4da5-9b9a-9cde7a447ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:28.679875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1f741-0469-4da5-9b9a-9cde7a447ebb None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:28.681031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:28.688127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a7307-417b-492c-8d6d-dbbf3d3f637d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:28.688425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 39/77] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:23:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:28.688769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a7307-417b-492c-8d6d-dbbf3d3f637d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:28.689058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a7307-417b-492c-8d6d-dbbf3d3f637d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:28.689392 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013a7307-417b-492c-8d6d-dbbf3d3f637d None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:28.690068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a7307-417b-492c-8d6d-dbbf3d3f637d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:28.690377 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a7307-417b-492c-8d6d-dbbf3d3f637d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:28.691740 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013a7307-417b-492c-8d6d-dbbf3d3f637d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:28.693661 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1f741-0469-4da5-9b9a-9cde7a447ebb None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:28.706164 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 39/78] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:28.706164 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a7307-417b-492c-8d6d-dbbf3d3f637d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:28.757579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:28.800998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1f741-0469-4da5-9b9a-9cde7a447ebb None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:28.808736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013a7307-417b-492c-8d6d-dbbf3d3f637d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:28.834651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9012a-7eed-46c2-88ef-cc93b19285d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:28.835309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9012a-7eed-46c2-88ef-cc93b19285d7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:28.835594 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9012a-7eed-46c2-88ef-cc93b19285d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:28.835872 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9012a-7eed-46c2-88ef-cc93b19285d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:28.837027 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9012a-7eed-46c2-88ef-cc93b19285d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:28.838603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9012a-7eed-46c2-88ef-cc93b19285d7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:28.840167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 40/79] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:23:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:28.840972 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9012a-7eed-46c2-88ef-cc93b19285d7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:28.843711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b7bb5-7502-4b0a-936d-dad76b945734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:28.844332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b7bb5-7502-4b0a-936d-dad76b945734 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:28.844617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b7bb5-7502-4b0a-936d-dad76b945734 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:28.844933 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3b7bb5-7502-4b0a-936d-dad76b945734 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:28.905351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:28.915758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b7bb5-7502-4b0a-936d-dad76b945734 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:28.917278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3b7bb5-7502-4b0a-936d-dad76b945734 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:28.943546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9012a-7eed-46c2-88ef-cc93b19285d7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:28.970307 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:28.978956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ff08c-3651-44c9-bb5b-a7f295d5e62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:28.979577 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ff08c-3651-44c9-bb5b-a7f295d5e62f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:28.979866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ff08c-3651-44c9-bb5b-a7f295d5e62f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:28.980144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ff08c-3651-44c9-bb5b-a7f295d5e62f None admin] PATH_INFO: `/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:28.981324 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ff08c-3651-44c9-bb5b-a7f295d5e62f None admin] RBAC: Authorizing `identity:get_user(user_id=b1eaabedfbf1451aa63ab57fb37bf6cf)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:28.982796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ff08c-3651-44c9-bb5b-a7f295d5e62f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:28.984369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 41/80] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:28 2022] GET /identity/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:28.985169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ff08c-3651-44c9-bb5b-a7f295d5e62f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:29.014378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 40/81] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:23:29.015157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b7bb5-7502-4b0a-936d-dad76b945734 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:29.083289 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ff08c-3651-44c9-bb5b-a7f295d5e62f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:29.107419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:29.116862 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3b7bb5-7502-4b0a-936d-dad76b945734 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:29.117707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e7a0e-d201-4256-b133-effff662c6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:29.118322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e7a0e-d201-4256-b133-effff662c6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:29.118606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e7a0e-d201-4256-b133-effff662c6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:29.118876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e7a0e-d201-4256-b133-effff662c6f0 None admin] PATH_INFO: `/v3/users/bcb0a034a4c8491eb41145193c3db0d0` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:29.119991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e7a0e-d201-4256-b133-effff662c6f0 None admin] RBAC: Authorizing `identity:get_user(user_id=bcb0a034a4c8491eb41145193c3db0d0)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:29.121453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e7a0e-d201-4256-b133-effff662c6f0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:29.123039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 42/82] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:28 2022] GET /identity/v3/users/bcb0a034a4c8491eb41145193c3db0d0 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:29.127605 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e7a0e-d201-4256-b133-effff662c6f0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:29.151256 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2141f-ad2a-46f2-aebd-0f864206d1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:29.151885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2141f-ad2a-46f2-aebd-0f864206d1ac None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:29.152177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2141f-ad2a-46f2-aebd-0f864206d1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:29.152450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2141f-ad2a-46f2-aebd-0f864206d1ac None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:29.162865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2141f-ad2a-46f2-aebd-0f864206d1ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-44a2141f-ad2a-46f2-aebd-0f864206d1ac None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:29.169056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:29.169987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:29.171255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:29.171255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:29.171255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:29.171255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:29.171255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:29.171255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:29.171255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:29.171255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:29.171255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:29.171255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:29.171255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:29.171255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:29.171255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 41/83] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:29.172499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2141f-ad2a-46f2-aebd-0f864206d1ac None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:29.190248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:29.228378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e7a0e-d201-4256-b133-effff662c6f0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:29.261178 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e7e36-3f4d-4650-87da-1459870ae021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:29.261768 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e7e36-3f4d-4650-87da-1459870ae021 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:29.262036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e7e36-3f4d-4650-87da-1459870ae021 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:29.262309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e7e36-3f4d-4650-87da-1459870ae021 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:29.262952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e7e36-3f4d-4650-87da-1459870ae021 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:29.265034 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e7e36-3f4d-4650-87da-1459870ae021 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:29.271356 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2141f-ad2a-46f2-aebd-0f864206d1ac None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:29.291849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 43/84] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:23:29 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:23:29.292922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e7e36-3f4d-4650-87da-1459870ae021 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:29.316474 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e937b6-1266-45ed-828f-695b09ece5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:29.317144 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e937b6-1266-45ed-828f-695b09ece5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:29.317431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e937b6-1266-45ed-828f-695b09ece5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:29.317709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e937b6-1266-45ed-828f-695b09ece5e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:29.345341 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:29.405151 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e937b6-1266-45ed-828f-695b09ece5e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:29.407074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e937b6-1266-45ed-828f-695b09ece5e1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:29.410906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e7e36-3f4d-4650-87da-1459870ae021 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:29.433156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:29.452211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade8a12-912b-4e75-9c69-d0fc01402d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:29.453230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8a12-912b-4e75-9c69-d0fc01402d7b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:29.453515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8a12-912b-4e75-9c69-d0fc01402d7b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:29.453793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade8a12-912b-4e75-9c69-d0fc01402d7b None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:29.454967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade8a12-912b-4e75-9c69-d0fc01402d7b None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:29.456450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ade8a12-912b-4e75-9c69-d0fc01402d7b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:29.459002 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 44/85] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:29 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:29.459002 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade8a12-912b-4e75-9c69-d0fc01402d7b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:29.545020 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 42/86] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:23:29.545880 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e937b6-1266-45ed-828f-695b09ece5e1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:29.591700 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade8a12-912b-4e75-9c69-d0fc01402d7b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:29.612567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:29.639518 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129546df-2c69-4cea-99a4-127902e65794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:29.640132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129546df-2c69-4cea-99a4-127902e65794 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:29.640413 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129546df-2c69-4cea-99a4-127902e65794 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:29.641530 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129546df-2c69-4cea-99a4-127902e65794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:29.676473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e937b6-1266-45ed-828f-695b09ece5e1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:29.715192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1a1e8-7add-4c89-b325-68a24a7ea5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:29.715805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1a1e8-7add-4c89-b325-68a24a7ea5f3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:29.716091 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1a1e8-7add-4c89-b325-68a24a7ea5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:29.716924 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1a1e8-7add-4c89-b325-68a24a7ea5f3 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:29.717695 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1a1e8-7add-4c89-b325-68a24a7ea5f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:29.718003 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1a1e8-7add-4c89-b325-68a24a7ea5f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:29.719433 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb1a1e8-7add-4c89-b325-68a24a7ea5f3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:29.721638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:29.730508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 43/87] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:29.731140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1a1e8-7add-4c89-b325-68a24a7ea5f3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:29.738149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129546df-2c69-4cea-99a4-127902e65794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:29.739896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129546df-2c69-4cea-99a4-127902e65794 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:29.841669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1a1e8-7add-4c89-b325-68a24a7ea5f3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:29.857272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:29.878609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 45/88] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:23:29.879566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129546df-2c69-4cea-99a4-127902e65794 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:29.894102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37d955-9b02-4f56-ab8b-cd7172d8354a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:29.895509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37d955-9b02-4f56-ab8b-cd7172d8354a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:29.895987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37d955-9b02-4f56-ab8b-cd7172d8354a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:29.896910 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37d955-9b02-4f56-ab8b-cd7172d8354a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:29.898136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37d955-9b02-4f56-ab8b-cd7172d8354a None admin] RBAC: Adding query filter params (role.id=1147187a70be4f46abe9a5f8d33d98fa, scope.project.id=15e11565450444f8bd36291d4e8e3385, user.id=b1eaabedfbf1451aa63ab57fb37bf6cf) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:29.898807 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37d955-9b02-4f56-ab8b-cd7172d8354a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:29.900782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab37d955-9b02-4f56-ab8b-cd7172d8354a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:29.910326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 44/89] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:29 2022] GET /identity/v3/role_assignments?user.id=b1eaabedfbf1451aa63ab57fb37bf6cf&scope.project.id=15e11565450444f8bd36291d4e8e3385&role.id=1147187a70be4f46abe9a5f8d33d98fa => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:29.911623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37d955-9b02-4f56-ab8b-cd7172d8354a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:30.025189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:30.035395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129546df-2c69-4cea-99a4-127902e65794 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:30.074356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770e2bb-13d1-46c3-b480-c00ad3e31044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:30.075009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770e2bb-13d1-46c3-b480-c00ad3e31044 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:30.075447 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770e2bb-13d1-46c3-b480-c00ad3e31044 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:30.075768 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770e2bb-13d1-46c3-b480-c00ad3e31044 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:30.076986 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770e2bb-13d1-46c3-b480-c00ad3e31044 None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:30.078457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770e2bb-13d1-46c3-b480-c00ad3e31044 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:30.081467 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 46/90] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:29 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:30.082411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770e2bb-13d1-46c3-b480-c00ad3e31044 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:30.126975 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab37d955-9b02-4f56-ab8b-cd7172d8354a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:30.193125 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770e2bb-13d1-46c3-b480-c00ad3e31044 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:30.209464 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343f32-1901-44e1-ba01-2c7d1d57236a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:30.210114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343f32-1901-44e1-ba01-2c7d1d57236a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:30.210398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343f32-1901-44e1-ba01-2c7d1d57236a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:30.210671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a343f32-1901-44e1-ba01-2c7d1d57236a None admin] PATH_INFO: `/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:30.217372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a343f32-1901-44e1-ba01-2c7d1d57236a None admin] RBAC: Authorizing `identity:get_user(user_id=b1eaabedfbf1451aa63ab57fb37bf6cf)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:30.218910 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a343f32-1901-44e1-ba01-2c7d1d57236a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:30.220839 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 45/91] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:29 2022] GET /identity/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf => generated 275 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:30.221624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343f32-1901-44e1-ba01-2c7d1d57236a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:30.228179 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c24fd-c69b-4efe-8f6f-3be6e6e7d8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:30.229067 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c24fd-c69b-4efe-8f6f-3be6e6e7d8f4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:30.230290 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c24fd-c69b-4efe-8f6f-3be6e6e7d8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:30.230715 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c24fd-c69b-4efe-8f6f-3be6e6e7d8f4 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:30.232548 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c24fd-c69b-4efe-8f6f-3be6e6e7d8f4 None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:30.234174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c24fd-c69b-4efe-8f6f-3be6e6e7d8f4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:30.235974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 47/92] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:30 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:30.236928 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c24fd-c69b-4efe-8f6f-3be6e6e7d8f4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:30.269033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:30.347247 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c24fd-c69b-4efe-8f6f-3be6e6e7d8f4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:30.353203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:30.394904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e6667-32e8-4193-9064-3b790804623b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:30.395754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e6667-32e8-4193-9064-3b790804623b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:30.396188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e6667-32e8-4193-9064-3b790804623b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:30.396601 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022e6667-32e8-4193-9064-3b790804623b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:30.423211 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a343f32-1901-44e1-ba01-2c7d1d57236a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:30.490315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c3e59-025a-4031-a009-729df22d98f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:30.490942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c3e59-025a-4031-a009-729df22d98f0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:30.491226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c3e59-025a-4031-a009-729df22d98f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:30.491502 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c3e59-025a-4031-a009-729df22d98f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:30.492248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c3e59-025a-4031-a009-729df22d98f0 None admin] RBAC: Adding query filter params (role.id=8727ddb8ab8e4ae4bf2145352def3fb6, scope.project.id=15e11565450444f8bd36291d4e8e3385, user.id=b1eaabedfbf1451aa63ab57fb37bf6cf) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:30.492890 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c3e59-025a-4031-a009-729df22d98f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:30.493314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e6667-32e8-4193-9064-3b790804623b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:30.494362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c3e59-025a-4031-a009-729df22d98f0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:30.495107 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022e6667-32e8-4193-9064-3b790804623b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:30.505864 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 46/93] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:30 2022] GET /identity/v3/role_assignments?user.id=b1eaabedfbf1451aa63ab57fb37bf6cf&scope.project.id=15e11565450444f8bd36291d4e8e3385&role.id=8727ddb8ab8e4ae4bf2145352def3fb6 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:30.507169 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c3e59-025a-4031-a009-729df22d98f0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:30.522356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:30.604436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 48/94] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:23:30.610568 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e6667-32e8-4193-9064-3b790804623b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:30.774671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c3e59-025a-4031-a009-729df22d98f0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:30.778095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022e6667-32e8-4193-9064-3b790804623b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:30.794989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:30.811026 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:30.815072 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec329b-45c9-4dc8-9ef9-e109d5118d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:30.815899 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec329b-45c9-4dc8-9ef9-e109d5118d92 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:30.816337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec329b-45c9-4dc8-9ef9-e109d5118d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:30.816769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec329b-45c9-4dc8-9ef9-e109d5118d92 None admin] PATH_INFO: `/v3/projects/7eabfe5c98d74f529cbd92228e458f0b` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:30.818582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec329b-45c9-4dc8-9ef9-e109d5118d92 None admin] RBAC: Authorizing `identity:get_project(project_id=7eabfe5c98d74f529cbd92228e458f0b)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:30.820194 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec329b-45c9-4dc8-9ef9-e109d5118d92 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:30.822028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 49/95] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:30 2022] GET /identity/v3/projects/7eabfe5c98d74f529cbd92228e458f0b => generated 312 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:30.829262 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec329b-45c9-4dc8-9ef9-e109d5118d92 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:30.853457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8576d2-4c37-496f-9de6-fa6299d03c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:30.854077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8576d2-4c37-496f-9de6-fa6299d03c6e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:30.854362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8576d2-4c37-496f-9de6-fa6299d03c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:30.854641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8576d2-4c37-496f-9de6-fa6299d03c6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:30.855381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8576d2-4c37-496f-9de6-fa6299d03c6e None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=15e11565450444f8bd36291d4e8e3385, user.id=bcb0a034a4c8491eb41145193c3db0d0) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:30.855695 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8576d2-4c37-496f-9de6-fa6299d03c6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:30.857732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8576d2-4c37-496f-9de6-fa6299d03c6e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:30.867411 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 47/96] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:30 2022] GET /identity/v3/role_assignments?user.id=bcb0a034a4c8491eb41145193c3db0d0&scope.project.id=15e11565450444f8bd36291d4e8e3385&role.id=6382a06103714d068409d25cbeb48744 => generated 259 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:30.990440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec329b-45c9-4dc8-9ef9-e109d5118d92 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:31.038273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da30b4-a55e-4f8b-9ef5-4f0ab4817af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:31.038897 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da30b4-a55e-4f8b-9ef5-4f0ab4817af8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:31.039181 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da30b4-a55e-4f8b-9ef5-4f0ab4817af8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:31.039459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da30b4-a55e-4f8b-9ef5-4f0ab4817af8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:31.040197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da30b4-a55e-4f8b-9ef5-4f0ab4817af8 None admin] RBAC: Adding query filter params (role.id=1147187a70be4f46abe9a5f8d33d98fa, scope.project.id=7eabfe5c98d74f529cbd92228e458f0b, user.id=b1eaabedfbf1451aa63ab57fb37bf6cf) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:31.040509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da30b4-a55e-4f8b-9ef5-4f0ab4817af8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:31.042062 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da30b4-a55e-4f8b-9ef5-4f0ab4817af8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:31.053421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 50/97] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:30 2022] GET /identity/v3/role_assignments?user.id=b1eaabedfbf1451aa63ab57fb37bf6cf&scope.project.id=7eabfe5c98d74f529cbd92228e458f0b&role.id=1147187a70be4f46abe9a5f8d33d98fa => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:32.022202 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e90288-34ae-47e0-a139-d1269510ff09 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:32.022752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e90288-34ae-47e0-a139-d1269510ff09 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:32.022752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e90288-34ae-47e0-a139-d1269510ff09 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:32.024077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 48/98] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:32.029891 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291e045-4276-43ba-b5b4-6881113c32e5 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:32.030284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291e045-4276-43ba-b5b4-6881113c32e5 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:32.030501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291e045-4276-43ba-b5b4-6881113c32e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:32.053362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f291e045-4276-43ba-b5b4-6881113c32e5 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:32.054556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f291e045-4276-43ba-b5b4-6881113c32e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:32.123261 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:32.144301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 51/99] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:32.450729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064016d-a5e1-49f2-b667-ebfb66760bcf None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:32.451126 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064016d-a5e1-49f2-b667-ebfb66760bcf None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:32.451304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e064016d-a5e1-49f2-b667-ebfb66760bcf None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:32.452892 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 49/100] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:32.458041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace84ea-8457-4cb3-8848-6a37cd119e60 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:32.458330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace84ea-8457-4cb3-8848-6a37cd119e60 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:32.458610 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace84ea-8457-4cb3-8848-6a37cd119e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:32.478666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-dace84ea-8457-4cb3-8848-6a37cd119e60 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:32.479856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-dace84ea-8457-4cb3-8848-6a37cd119e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:32.567254 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 52/101] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:32.590993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064016d-a5e1-49f2-b667-ebfb66760bcf None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:32.730373 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e064016d-a5e1-49f2-b667-ebfb66760bcf None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:32.773453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f63b1-e0f5-47e1-bf75-198001892925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:32.774089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f63b1-e0f5-47e1-bf75-198001892925 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:32.774370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f63b1-e0f5-47e1-bf75-198001892925 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:32.774644 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f63b1-e0f5-47e1-bf75-198001892925 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:32.793483 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f63b1-e0f5-47e1-bf75-198001892925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-731f63b1-e0f5-47e1-bf75-198001892925 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:32.799359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:32.800221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:32.801065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:32.801065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:32.801065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:32.801065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:32.801065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:32.801065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:32.801065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:32.801065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:32.801065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:32.801065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:32.801065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:23:32.801065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:32.801065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 50/102] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:32.809837 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace84ea-8457-4cb3-8848-6a37cd119e60 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:32.977384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace84ea-8457-4cb3-8848-6a37cd119e60 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:32.999944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:33.024454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b898c-4c94-4cfa-b5a3-cd3fc825c15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:33.025099 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b898c-4c94-4cfa-b5a3-cd3fc825c15a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:33.025380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b898c-4c94-4cfa-b5a3-cd3fc825c15a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:33.025710 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b898c-4c94-4cfa-b5a3-cd3fc825c15a None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:33.026386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b898c-4c94-4cfa-b5a3-cd3fc825c15a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:33.026697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b898c-4c94-4cfa-b5a3-cd3fc825c15a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:33.028130 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b898c-4c94-4cfa-b5a3-cd3fc825c15a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:33.037433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 53/103] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:33.042971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f63b1-e0f5-47e1-bf75-198001892925 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:33.050791 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b898c-4c94-4cfa-b5a3-cd3fc825c15a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:33.144038 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:33.185878 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b898c-4c94-4cfa-b5a3-cd3fc825c15a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:33.250295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f63b1-e0f5-47e1-bf75-198001892925 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:33.277382 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380bdaa3-7b27-427c-b74d-1be307251d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:33.278549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bdaa3-7b27-427c-b74d-1be307251d34 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:33.279626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bdaa3-7b27-427c-b74d-1be307251d34 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:33.280122 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380bdaa3-7b27-427c-b74d-1be307251d34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:33.281497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bdaa3-7b27-427c-b74d-1be307251d34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:33.283155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380bdaa3-7b27-427c-b74d-1be307251d34 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:33.285401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 54/104] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:23:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:33.286738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0b213-1a46-441a-828b-2893f1f8a2a0 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:33.287236 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0b213-1a46-441a-828b-2893f1f8a2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:33.287713 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0b213-1a46-441a-828b-2893f1f8a2a0 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:33.288069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eedfd51-0adc-475b-942b-5b0d4260cf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:33.292754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedfd51-0adc-475b-942b-5b0d4260cf2b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:33.292754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedfd51-0adc-475b-942b-5b0d4260cf2b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:33.292754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eedfd51-0adc-475b-942b-5b0d4260cf2b None admin] PATH_INFO: `/v3/users/1f37a87a3a134e11b04fc15951f5443e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:33.294041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 55/105] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:33.295099 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0b213-1a46-441a-828b-2893f1f8a2a0 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:33.304800 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedfd51-0adc-475b-942b-5b0d4260cf2b None admin] RBAC: Authorizing `identity:get_user(user_id=1f37a87a3a134e11b04fc15951f5443e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:33.306306 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eedfd51-0adc-475b-942b-5b0d4260cf2b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:33.307965 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 51/106] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:33 2022] GET /identity/v3/users/1f37a87a3a134e11b04fc15951f5443e => generated 289 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:33.312705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc46f2-f34f-43ee-94de-48602799eda9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:33.312705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc46f2-f34f-43ee-94de-48602799eda9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:33.312705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc46f2-f34f-43ee-94de-48602799eda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:33.331187 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d3dc46f2-f34f-43ee-94de-48602799eda9 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:33.332379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d3dc46f2-f34f-43ee-94de-48602799eda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:33.405019 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:33.408901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 52/107] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:33.410549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc46f2-f34f-43ee-94de-48602799eda9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:33.437047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:33.526661 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0b213-1a46-441a-828b-2893f1f8a2a0 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:33.589855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e427e08-1917-408e-a40c-adc01323a4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:33.590489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e427e08-1917-408e-a40c-adc01323a4b3 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:33.590769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e427e08-1917-408e-a40c-adc01323a4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:33.591043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e427e08-1917-408e-a40c-adc01323a4b3 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:33.591739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e427e08-1917-408e-a40c-adc01323a4b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:33.593210 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e427e08-1917-408e-a40c-adc01323a4b3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:33.640401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 56/108] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 13 06:23:33 2022] POST /identity/v3/projects => generated 302 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:23:33.663149 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc46f2-f34f-43ee-94de-48602799eda9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:33.710043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3cd6d-09fa-4a6d-bcc5-78febd987494 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:33.710357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3cd6d-09fa-4a6d-bcc5-78febd987494 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:33.710606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e3cd6d-09fa-4a6d-bcc5-78febd987494 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:33.713383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 57/109] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:23:33.719056 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03820405-9212-4d0a-9432-eef42301a06c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:33.719350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03820405-9212-4d0a-9432-eef42301a06c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:33.719629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03820405-9212-4d0a-9432-eef42301a06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:33.719844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82866930-bdb3-47c2-9e6a-15b8bb71e236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:33.720477 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82866930-bdb3-47c2-9e6a-15b8bb71e236 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:33.720788 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82866930-bdb3-47c2-9e6a-15b8bb71e236 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:33.721067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82866930-bdb3-47c2-9e6a-15b8bb71e236 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:33.754517 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-03820405-9212-4d0a-9432-eef42301a06c None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:33.755730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-03820405-9212-4d0a-9432-eef42301a06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:33.871079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 58/110] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:23:33.871882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03820405-9212-4d0a-9432-eef42301a06c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:33.872210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82866930-bdb3-47c2-9e6a-15b8bb71e236 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:33.874646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82866930-bdb3-47c2-9e6a-15b8bb71e236 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:33.903267 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:33.903944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:34.012278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03820405-9212-4d0a-9432-eef42301a06c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:34.055586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c22672-646b-4c61-b91b-aae665462abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:34.057047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c22672-646b-4c61-b91b-aae665462abc None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:34.057557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c22672-646b-4c61-b91b-aae665462abc None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:34.058029 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c22672-646b-4c61-b91b-aae665462abc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:34.069579 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 53/111] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:23:34.073559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c22672-646b-4c61-b91b-aae665462abc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:34.075426 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82866930-bdb3-47c2-9e6a-15b8bb71e236 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-46c22672-646b-4c61-b91b-aae665462abc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:34.080121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:34.081073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:34.081833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:34.081833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:34.081833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:34.081833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:34.081833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:34.081833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:34.081833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:34.081833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:34.081833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:34.081833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:34.081833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:34.081833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:34.085501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 59/112] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:34.092848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c22672-646b-4c61-b91b-aae665462abc None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:34.206415 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:34.221102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c22672-646b-4c61-b91b-aae665462abc None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:34.271974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87716280-794f-4b80-9b2f-f326f65a5f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:34.273023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87716280-794f-4b80-9b2f-f326f65a5f8b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:34.273644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87716280-794f-4b80-9b2f-f326f65a5f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:34.274138 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87716280-794f-4b80-9b2f-f326f65a5f8b None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:34.275006 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87716280-794f-4b80-9b2f-f326f65a5f8b None admin] RBAC: Adding query filter params (name=member) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:34.275508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87716280-794f-4b80-9b2f-f326f65a5f8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:34.276360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82866930-bdb3-47c2-9e6a-15b8bb71e236 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:34.277389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87716280-794f-4b80-9b2f-f326f65a5f8b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:34.286623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 60/113] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:34.288445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d5adc-6a23-4af1-8631-e9f0e078328f None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:34.293475 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d5adc-6a23-4af1-8631-e9f0e078328f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:34.294013 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d5adc-6a23-4af1-8631-e9f0e078328f None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:34.295878 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 61/114] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:34.296862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d5adc-6a23-4af1-8631-e9f0e078328f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:34.322075 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:34.334642 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b02d4e-8090-4b1b-8c20-2b9e9ce848a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:34.335273 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b02d4e-8090-4b1b-8c20-2b9e9ce848a9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:34.335558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b02d4e-8090-4b1b-8c20-2b9e9ce848a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:34.335837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b02d4e-8090-4b1b-8c20-2b9e9ce848a9 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:34.337023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b02d4e-8090-4b1b-8c20-2b9e9ce848a9 None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:34.338688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b02d4e-8090-4b1b-8c20-2b9e9ce848a9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:34.340318 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 54/115] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:34 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:34.341652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c2d1b-f168-4b90-bb6f-4e834d743734 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:34.341937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c2d1b-f168-4b90-bb6f-4e834d743734 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:34.342214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c2d1b-f168-4b90-bb6f-4e834d743734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:34.361427 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-431c2d1b-f168-4b90-bb6f-4e834d743734 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:34.362691 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-431c2d1b-f168-4b90-bb6f-4e834d743734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:34.426325 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d5adc-6a23-4af1-8631-e9f0e078328f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:34.456134 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 55/116] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:34.461618 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c2d1b-f168-4b90-bb6f-4e834d743734 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:34.473401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99636490-89d7-4e79-9c67-ae7f0b075c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:34.474387 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99636490-89d7-4e79-9c67-ae7f0b075c89 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:34.475014 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99636490-89d7-4e79-9c67-ae7f0b075c89 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:34.475521 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99636490-89d7-4e79-9c67-ae7f0b075c89 None admin] PATH_INFO: `/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:34.477710 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99636490-89d7-4e79-9c67-ae7f0b075c89 None admin] RBAC: Authorizing `identity:get_user(user_id=b1eaabedfbf1451aa63ab57fb37bf6cf)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:34.480959 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99636490-89d7-4e79-9c67-ae7f0b075c89 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:34.484883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 62/117] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:34 2022] GET /identity/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:34.487260 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99636490-89d7-4e79-9c67-ae7f0b075c89 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:34.512232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:34.591507 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c2d1b-f168-4b90-bb6f-4e834d743734 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:34.604168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99636490-89d7-4e79-9c67-ae7f0b075c89 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:34.613813 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:34.634249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb1d565-199d-4c79-a03a-1a8245eee306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:34.635135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1d565-199d-4c79-a03a-1a8245eee306 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:34.635559 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1d565-199d-4c79-a03a-1a8245eee306 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:34.635975 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb1d565-199d-4c79-a03a-1a8245eee306 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:34.647293 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb1d565-199d-4c79-a03a-1a8245eee306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:34.649503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c61624-8352-42f2-9a01-f12f0f4c70e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:34.650831 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c61624-8352-42f2-9a01-f12f0f4c70e1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:34.650831 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c61624-8352-42f2-9a01-f12f0f4c70e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:34.651135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c61624-8352-42f2-9a01-f12f0f4c70e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:34.651968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c61624-8352-42f2-9a01-f12f0f4c70e1 None admin] RBAC: Adding query filter params (role.id=2e9374cdc2f84d6eac42b2dfaf1008a3, scope.project.id=15e11565450444f8bd36291d4e8e3385, user.id=1f37a87a3a134e11b04fc15951f5443e) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:34.652379 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c61624-8352-42f2-9a01-f12f0f4c70e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:34.654109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c61624-8352-42f2-9a01-f12f0f4c70e1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-8cb1d565-199d-4c79-a03a-1a8245eee306 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:34.654607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:34.655518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:34.656272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:34.656272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:34.656272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:34.656272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:34.656272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:34.656272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:34.656272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:34.656272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:34.656272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:34.656272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:34.656272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:23:34.656272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:34.658602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 56/118] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:23:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:34.660120 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164108ef-550d-4ccd-b580-b2aa20ea76d0 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:34.660582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164108ef-550d-4ccd-b580-b2aa20ea76d0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:34.661062 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 63/119] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:34 2022] GET /identity/v3/role_assignments?user.id=1f37a87a3a134e11b04fc15951f5443e&scope.project.id=15e11565450444f8bd36291d4e8e3385&role.id=2e9374cdc2f84d6eac42b2dfaf1008a3 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:34.661234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164108ef-550d-4ccd-b580-b2aa20ea76d0 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:34.661971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c61624-8352-42f2-9a01-f12f0f4c70e1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:34.663631 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 57/120] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:34.673773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164108ef-550d-4ccd-b580-b2aa20ea76d0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:34.823605 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:34.842116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164108ef-550d-4ccd-b580-b2aa20ea76d0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:34.852426 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c61624-8352-42f2-9a01-f12f0f4c70e1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:34.884590 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc310a2-bc40-47dd-a360-fedfafbd65e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:34.885272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc310a2-bc40-47dd-a360-fedfafbd65e0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:34.885556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc310a2-bc40-47dd-a360-fedfafbd65e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:34.885826 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc310a2-bc40-47dd-a360-fedfafbd65e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:34.886492 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc310a2-bc40-47dd-a360-fedfafbd65e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:34.886798 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc310a2-bc40-47dd-a360-fedfafbd65e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:34.888370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc310a2-bc40-47dd-a360-fedfafbd65e0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:34.897894 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 58/121] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:23:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:34.898635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d05b8e-2f9c-4b91-b321-927aa3b58e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:34.899241 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb715c-b2c1-4931-be38-87b313fbd677 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:34.899530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb715c-b2c1-4931-be38-87b313fbd677 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:34.899808 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fb715c-b2c1-4931-be38-87b313fbd677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:34.900064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d05b8e-2f9c-4b91-b321-927aa3b58e50 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:34.900510 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d05b8e-2f9c-4b91-b321-927aa3b58e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:34.900980 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d05b8e-2f9c-4b91-b321-927aa3b58e50 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:34.902663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d05b8e-2f9c-4b91-b321-927aa3b58e50 None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:34.904572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d05b8e-2f9c-4b91-b321-927aa3b58e50 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:34.907869 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 64/122] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:34 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:34.908879 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d05b8e-2f9c-4b91-b321-927aa3b58e50 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:34.920639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-15fb715c-b2c1-4931-be38-87b313fbd677 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:34.922317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-15fb715c-b2c1-4931-be38-87b313fbd677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:34.966876 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:35.007581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 59/123] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:35.008661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb715c-b2c1-4931-be38-87b313fbd677 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:35.065552 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d05b8e-2f9c-4b91-b321-927aa3b58e50 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:35.129973 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732500c-c281-43fa-bd80-d87d27ffa18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:35.130526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732500c-c281-43fa-bd80-d87d27ffa18d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:35.130808 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732500c-c281-43fa-bd80-d87d27ffa18d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:35.131083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c732500c-c281-43fa-bd80-d87d27ffa18d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:35.156839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c732500c-c281-43fa-bd80-d87d27ffa18d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c732500c-c281-43fa-bd80-d87d27ffa18d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:35.164509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:35.165499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:35.166275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:35.166275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:35.166275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:35.166275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:35.166275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:35.166275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:35.166275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:35.166275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:35.166275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:35.166275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:35.166275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:35.166275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:35.166275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 65/124] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:23:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:35.172364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732500c-c281-43fa-bd80-d87d27ffa18d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:35.204814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:35.212531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fb715c-b2c1-4931-be38-87b313fbd677 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:35.290336 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d00fc-e1f1-4d84-b619-7b030ac536a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:35.290971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d00fc-e1f1-4d84-b619-7b030ac536a2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:35.291254 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d00fc-e1f1-4d84-b619-7b030ac536a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:35.291530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d00fc-e1f1-4d84-b619-7b030ac536a2 None admin] PATH_INFO: `/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:35.292823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d00fc-e1f1-4d84-b619-7b030ac536a2 None admin] RBAC: Authorizing `identity:get_user(user_id=b1eaabedfbf1451aa63ab57fb37bf6cf)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:35.294280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538d00fc-e1f1-4d84-b619-7b030ac536a2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:35.296694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 60/125] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:35 2022] GET /identity/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf => generated 275 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:35.297235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d00fc-e1f1-4d84-b619-7b030ac536a2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:35.336943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c732500c-c281-43fa-bd80-d87d27ffa18d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:35.344420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:35.375490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a6d13-869c-4f5a-83da-f21690d31599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:35.376169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a6d13-869c-4f5a-83da-f21690d31599 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:35.376450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a6d13-869c-4f5a-83da-f21690d31599 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:35.376763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a6d13-869c-4f5a-83da-f21690d31599 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385/users/b1eaabedfbf1451aa63ab57fb37bf6cf/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:35.378676 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a6d13-869c-4f5a-83da-f21690d31599 None admin] RBAC: Authorizing `identity:create_grant(project_id=15e11565450444f8bd36291d4e8e3385, user_id=b1eaabedfbf1451aa63ab57fb37bf6cf, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:35.380191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a6d13-869c-4f5a-83da-f21690d31599 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:35.395549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 66/126] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:23:35 2022] PUT /identity/v3/projects/15e11565450444f8bd36291d4e8e3385/users/b1eaabedfbf1451aa63ab57fb37bf6cf/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:23:35.396613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a6d13-869c-4f5a-83da-f21690d31599 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:35.423640 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d00fc-e1f1-4d84-b619-7b030ac536a2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:35.480401 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11d389-f8cd-4fe8-b523-1c2160aeedd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:35.481068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11d389-f8cd-4fe8-b523-1c2160aeedd1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:35.481355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11d389-f8cd-4fe8-b523-1c2160aeedd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:35.481632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc11d389-f8cd-4fe8-b523-1c2160aeedd1 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:35.484639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11d389-f8cd-4fe8-b523-1c2160aeedd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:35.485034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11d389-f8cd-4fe8-b523-1c2160aeedd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:35.488189 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc11d389-f8cd-4fe8-b523-1c2160aeedd1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:35.501994 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:35.512587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 61/127] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:35.514454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11d389-f8cd-4fe8-b523-1c2160aeedd1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:35.571436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a6d13-869c-4f5a-83da-f21690d31599 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:35.651113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844890c0-f48d-4fea-97ff-ed1326fbdb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:35.651759 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844890c0-f48d-4fea-97ff-ed1326fbdb86 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:35.652039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844890c0-f48d-4fea-97ff-ed1326fbdb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:35.652309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844890c0-f48d-4fea-97ff-ed1326fbdb86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:35.674685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844890c0-f48d-4fea-97ff-ed1326fbdb86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-844890c0-f48d-4fea-97ff-ed1326fbdb86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:35.681166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:35.682192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:35.683123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:35.683123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:35.683123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:35.683123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:35.683123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:35.683123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:35.683123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:35.683123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:35.683123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:35.683123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:35.683123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:35.683123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:35.683123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 67/128] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:35.684044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844890c0-f48d-4fea-97ff-ed1326fbdb86 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:35.738696 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc11d389-f8cd-4fe8-b523-1c2160aeedd1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:35.741628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:35.799173 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844890c0-f48d-4fea-97ff-ed1326fbdb86 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:35.813114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a23e0b-0ffb-41e9-87aa-6e49a504d687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:35.813991 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a23e0b-0ffb-41e9-87aa-6e49a504d687 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:35.814413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a23e0b-0ffb-41e9-87aa-6e49a504d687 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:35.814828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a23e0b-0ffb-41e9-87aa-6e49a504d687 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:35.817546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a23e0b-0ffb-41e9-87aa-6e49a504d687 None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:35.819138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a23e0b-0ffb-41e9-87aa-6e49a504d687 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:35.821714 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 62/129] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:35 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:35.824433 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a23e0b-0ffb-41e9-87aa-6e49a504d687 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:35.857638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:35.868996 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19b8aa-727c-4daa-8d45-1a3a1d83a1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:35.869921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b8aa-727c-4daa-8d45-1a3a1d83a1e0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:35.870434 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b8aa-727c-4daa-8d45-1a3a1d83a1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:35.870905 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19b8aa-727c-4daa-8d45-1a3a1d83a1e0 None admin] PATH_INFO: `/v3/users/bcb0a034a4c8491eb41145193c3db0d0` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:35.873320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19b8aa-727c-4daa-8d45-1a3a1d83a1e0 None admin] RBAC: Authorizing `identity:get_user(user_id=bcb0a034a4c8491eb41145193c3db0d0)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:35.875016 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19b8aa-727c-4daa-8d45-1a3a1d83a1e0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:35.876863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 68/130] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:35 2022] GET /identity/v3/users/bcb0a034a4c8491eb41145193c3db0d0 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:35.878008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19b8aa-727c-4daa-8d45-1a3a1d83a1e0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:35.988429 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a23e0b-0ffb-41e9-87aa-6e49a504d687 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:36.031378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f00a24-4304-44e0-80f8-28c93ee7e5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:36.032348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f00a24-4304-44e0-80f8-28c93ee7e5cc None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:36.032885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f00a24-4304-44e0-80f8-28c93ee7e5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:36.033362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f00a24-4304-44e0-80f8-28c93ee7e5cc None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:36.034232 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f00a24-4304-44e0-80f8-28c93ee7e5cc None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:36.034754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f00a24-4304-44e0-80f8-28c93ee7e5cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:36.036315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f00a24-4304-44e0-80f8-28c93ee7e5cc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:36.047635 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 63/131] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:36.048956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f00a24-4304-44e0-80f8-28c93ee7e5cc None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:36.086644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19b8aa-727c-4daa-8d45-1a3a1d83a1e0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:36.093417 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:36.152903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2ea69-a8c7-45d4-a367-6776d8ee5e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:36.154892 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2ea69-a8c7-45d4-a367-6776d8ee5e4f None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:36.155637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2ea69-a8c7-45d4-a367-6776d8ee5e4f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:36.157116 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b2ea69-a8c7-45d4-a367-6776d8ee5e4f None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385/users/b1eaabedfbf1451aa63ab57fb37bf6cf/roles/8727ddb8ab8e4ae4bf2145352def3fb6` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:36.161568 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2ea69-a8c7-45d4-a367-6776d8ee5e4f None admin] RBAC: Authorizing `identity:create_grant(project_id=15e11565450444f8bd36291d4e8e3385, user_id=b1eaabedfbf1451aa63ab57fb37bf6cf, role_id=8727ddb8ab8e4ae4bf2145352def3fb6)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:36.167728 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b2ea69-a8c7-45d4-a367-6776d8ee5e4f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:36.197480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 69/132] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:23:35 2022] PUT /identity/v3/projects/15e11565450444f8bd36291d4e8e3385/users/b1eaabedfbf1451aa63ab57fb37bf6cf/roles/8727ddb8ab8e4ae4bf2145352def3fb6 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:23:36.199749 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2ea69-a8c7-45d4-a367-6776d8ee5e4f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:36.246848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f00a24-4304-44e0-80f8-28c93ee7e5cc None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:36.338285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3719b63-fc88-4909-9d62-e1779ffc891c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:36.339456 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3719b63-fc88-4909-9d62-e1779ffc891c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:36.341047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3719b63-fc88-4909-9d62-e1779ffc891c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:36.343677 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3719b63-fc88-4909-9d62-e1779ffc891c None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:36.346754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3719b63-fc88-4909-9d62-e1779ffc891c None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:36.348713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3719b63-fc88-4909-9d62-e1779ffc891c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:36.350848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 64/133] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:36 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:36.359507 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3719b63-fc88-4909-9d62-e1779ffc891c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:36.366254 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:36.424840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b2ea69-a8c7-45d4-a367-6776d8ee5e4f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:36.471184 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a754af-dafb-4baf-bfa5-4c40ca94432e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:36.472209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a754af-dafb-4baf-bfa5-4c40ca94432e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:36.472713 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a754af-dafb-4baf-bfa5-4c40ca94432e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:36.473214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a754af-dafb-4baf-bfa5-4c40ca94432e None admin] PATH_INFO: `/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:36.474587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a754af-dafb-4baf-bfa5-4c40ca94432e None admin] RBAC: Authorizing `identity:get_user(user_id=b1eaabedfbf1451aa63ab57fb37bf6cf)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:36.476660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a754af-dafb-4baf-bfa5-4c40ca94432e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:36.478938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 70/134] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:36 2022] GET /identity/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:36.484495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a754af-dafb-4baf-bfa5-4c40ca94432e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:36.507052 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:36.511859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3719b63-fc88-4909-9d62-e1779ffc891c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:36.585048 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33b65e-578b-416c-b5f6-c53866a44d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:36.585751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33b65e-578b-416c-b5f6-c53866a44d33 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:36.586033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33b65e-578b-416c-b5f6-c53866a44d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:36.586313 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33b65e-578b-416c-b5f6-c53866a44d33 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385/users/bcb0a034a4c8491eb41145193c3db0d0/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:36.592844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33b65e-578b-416c-b5f6-c53866a44d33 None admin] RBAC: Authorizing `identity:create_grant(project_id=15e11565450444f8bd36291d4e8e3385, user_id=bcb0a034a4c8491eb41145193c3db0d0, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:36.594358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33b65e-578b-416c-b5f6-c53866a44d33 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:36.619309 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 65/135] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:23:36 2022] PUT /identity/v3/projects/15e11565450444f8bd36291d4e8e3385/users/bcb0a034a4c8491eb41145193c3db0d0/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:23:36.662454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a754af-dafb-4baf-bfa5-4c40ca94432e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:36.692093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:36.703114 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0a637-43ef-4fa3-8cdb-9c4147f34452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:36.703822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0a637-43ef-4fa3-8cdb-9c4147f34452 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:36.704110 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0a637-43ef-4fa3-8cdb-9c4147f34452 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:36.704401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0a637-43ef-4fa3-8cdb-9c4147f34452 None admin] PATH_INFO: `/v3/projects/7eabfe5c98d74f529cbd92228e458f0b` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:36.705657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0a637-43ef-4fa3-8cdb-9c4147f34452 None admin] RBAC: Authorizing `identity:get_project(project_id=7eabfe5c98d74f529cbd92228e458f0b)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:36.707115 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0a637-43ef-4fa3-8cdb-9c4147f34452 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:36.709126 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 71/136] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:36 2022] GET /identity/v3/projects/7eabfe5c98d74f529cbd92228e458f0b => generated 312 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:36.717857 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33b65e-578b-416c-b5f6-c53866a44d33 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:36.780145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea0e38-2f1d-4367-8784-49a1b1f729fc None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:36.780323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea0e38-2f1d-4367-8784-49a1b1f729fc None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:36.780626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea0e38-2f1d-4367-8784-49a1b1f729fc None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:36.783529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 72/137] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:36.787972 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d8096-ab60-48fb-a2bd-023ccb5cb191 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:36.788265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d8096-ab60-48fb-a2bd-023ccb5cb191 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:36.788538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300d8096-ab60-48fb-a2bd-023ccb5cb191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:36.826507 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-300d8096-ab60-48fb-a2bd-023ccb5cb191 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:36.827731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-300d8096-ab60-48fb-a2bd-023ccb5cb191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:36.892265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33b65e-578b-416c-b5f6-c53866a44d33 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:36.956089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d913eff1-1bc0-4ba3-afa9-74a0a94e9a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:36.956656 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913eff1-1bc0-4ba3-afa9-74a0a94e9a56 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:36.956961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913eff1-1bc0-4ba3-afa9-74a0a94e9a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:36.957238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d913eff1-1bc0-4ba3-afa9-74a0a94e9a56 None admin] PATH_INFO: `/v3/projects/7eabfe5c98d74f529cbd92228e458f0b/users/b1eaabedfbf1451aa63ab57fb37bf6cf/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:36.960002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913eff1-1bc0-4ba3-afa9-74a0a94e9a56 None admin] RBAC: Authorizing `identity:create_grant(project_id=7eabfe5c98d74f529cbd92228e458f0b, user_id=b1eaabedfbf1451aa63ab57fb37bf6cf, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:36.961459 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d913eff1-1bc0-4ba3-afa9-74a0a94e9a56 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:36.969576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 73/138] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:23:36.990140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 66/139] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:23:36 2022] PUT /identity/v3/projects/7eabfe5c98d74f529cbd92228e458f0b/users/b1eaabedfbf1451aa63ab57fb37bf6cf/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:23:37.449676 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236a831-a991-44fb-ae02-c2821bb5aab0 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:37.450190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236a831-a991-44fb-ae02-c2821bb5aab0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:37.450190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1236a831-a991-44fb-ae02-c2821bb5aab0 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:37.451727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 74/140] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:37.457324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62945643-812e-432e-aa92-b18f6a12340e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:37.457729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62945643-812e-432e-aa92-b18f6a12340e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:37.457901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62945643-812e-432e-aa92-b18f6a12340e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:37.480865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-62945643-812e-432e-aa92-b18f6a12340e None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:37.482632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-62945643-812e-432e-aa92-b18f6a12340e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:37.501994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:37.513298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236a831-a991-44fb-ae02-c2821bb5aab0 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:37.598212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 67/141] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:37.655181 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1236a831-a991-44fb-ae02-c2821bb5aab0 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:37.689155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:37.700024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd7238-7a66-49ba-bf4e-e4b50770b9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:37.701120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd7238-7a66-49ba-bf4e-e4b50770b9d8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:37.701405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd7238-7a66-49ba-bf4e-e4b50770b9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:37.701674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd7238-7a66-49ba-bf4e-e4b50770b9d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:37.702846 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd7238-7a66-49ba-bf4e-e4b50770b9d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:37.704337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd7238-7a66-49ba-bf4e-e4b50770b9d8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:37.705938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 75/142] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:23:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:37.711562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62945643-812e-432e-aa92-b18f6a12340e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:37.836443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62945643-812e-432e-aa92-b18f6a12340e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:37.879394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8be3ce-1e7e-4a37-a6be-e7f10a1e6858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:37.880009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8be3ce-1e7e-4a37-a6be-e7f10a1e6858 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:37.880289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8be3ce-1e7e-4a37-a6be-e7f10a1e6858 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:37.880562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8be3ce-1e7e-4a37-a6be-e7f10a1e6858 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:37.881246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8be3ce-1e7e-4a37-a6be-e7f10a1e6858 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:37.882673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8be3ce-1e7e-4a37-a6be-e7f10a1e6858 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:37.914686 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 68/143] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:23:37 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:23:38.099190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b68f3-dd49-4a84-9043-41d6d8a412ca None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:38.099524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b68f3-dd49-4a84-9043-41d6d8a412ca None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:38.099641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b68f3-dd49-4a84-9043-41d6d8a412ca None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:38.101011 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 76/144] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:38.106410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294753da-c920-40f2-b210-6f9c63854bae None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:38.106703 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294753da-c920-40f2-b210-6f9c63854bae None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:38.107021 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294753da-c920-40f2-b210-6f9c63854bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:38.122162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:38.131551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-294753da-c920-40f2-b210-6f9c63854bae None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:38.132796 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-294753da-c920-40f2-b210-6f9c63854bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:38.227891 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 69/145] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:38.249710 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b68f3-dd49-4a84-9043-41d6d8a412ca None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:38.356761 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b68f3-dd49-4a84-9043-41d6d8a412ca None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:38.394595 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b439e7-c0fa-4457-8d63-b6d233f890ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:38.395264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b439e7-c0fa-4457-8d63-b6d233f890ce None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:38.395550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b439e7-c0fa-4457-8d63-b6d233f890ce None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:38.395821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b439e7-c0fa-4457-8d63-b6d233f890ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:38.408335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b439e7-c0fa-4457-8d63-b6d233f890ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-12b439e7-c0fa-4457-8d63-b6d233f890ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:38.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:38.414042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:38.414821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:38.414821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:38.414821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:38.414821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:38.414821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:38.414821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:38.414821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:38.414821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:38.414821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:38.414821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:38.414821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:23:38.414821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:38.414821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 77/146] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:38.420904 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294753da-c920-40f2-b210-6f9c63854bae None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:38.546259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294753da-c920-40f2-b210-6f9c63854bae None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:38.588037 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570969a-2ff3-44dd-9aaf-698821a5b525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:38.588652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570969a-2ff3-44dd-9aaf-698821a5b525 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:38.588960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570969a-2ff3-44dd-9aaf-698821a5b525 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:38.589235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a570969a-2ff3-44dd-9aaf-698821a5b525 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:38.589904 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570969a-2ff3-44dd-9aaf-698821a5b525 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:38.590213 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570969a-2ff3-44dd-9aaf-698821a5b525 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:38.595079 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a570969a-2ff3-44dd-9aaf-698821a5b525 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:38.597152 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:38.600453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 70/147] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:38.607539 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b439e7-c0fa-4457-8d63-b6d233f890ce None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:38.692723 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570969a-2ff3-44dd-9aaf-698821a5b525 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:38.701836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:38.784529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b439e7-c0fa-4457-8d63-b6d233f890ce None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:38.850472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d795a49-8846-4821-80b3-1204ab9523a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:38.851108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d795a49-8846-4821-80b3-1204ab9523a3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:38.851428 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d795a49-8846-4821-80b3-1204ab9523a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:38.851657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d795a49-8846-4821-80b3-1204ab9523a3 None admin] PATH_INFO: `/v3/users/1f37a87a3a134e11b04fc15951f5443e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:38.854531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d795a49-8846-4821-80b3-1204ab9523a3 None admin] RBAC: Authorizing `identity:get_user(user_id=1f37a87a3a134e11b04fc15951f5443e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:38.856003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d795a49-8846-4821-80b3-1204ab9523a3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:38.857702 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 78/148] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:38 2022] GET /identity/v3/users/1f37a87a3a134e11b04fc15951f5443e => generated 289 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:38.865741 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d795a49-8846-4821-80b3-1204ab9523a3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:38.890142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a570969a-2ff3-44dd-9aaf-698821a5b525 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:38.960135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d2894-fcd1-49a0-8408-bd6817db23a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:38.960821 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d2894-fcd1-49a0-8408-bd6817db23a1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:38.961114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d2894-fcd1-49a0-8408-bd6817db23a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:38.961394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d2894-fcd1-49a0-8408-bd6817db23a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:38.990578 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d2894-fcd1-49a0-8408-bd6817db23a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:38.992182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d795a49-8846-4821-80b3-1204ab9523a3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b13d2894-fcd1-49a0-8408-bd6817db23a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:38.996166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:38.997098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:38.999396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:38.999396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:38.999396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:38.999396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:38.999396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:38.999396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:38.999396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:38.999396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:38.999396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:38.999396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:38.999396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:38.999396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:38.999396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 71/149] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:23:39.009654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d2894-fcd1-49a0-8408-bd6817db23a1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:39.015753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:39.035309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f29f5e-db8a-4dcc-8e6f-7c6f7ee47b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:39.035963 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f29f5e-db8a-4dcc-8e6f-7c6f7ee47b4d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:39.036248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f29f5e-db8a-4dcc-8e6f-7c6f7ee47b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:39.036523 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f29f5e-db8a-4dcc-8e6f-7c6f7ee47b4d None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:39.038560 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f29f5e-db8a-4dcc-8e6f-7c6f7ee47b4d None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:39.040859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f29f5e-db8a-4dcc-8e6f-7c6f7ee47b4d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:39.042969 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 79/150] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:38 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:39.050330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f29f5e-db8a-4dcc-8e6f-7c6f7ee47b4d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:39.141131 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:39.202117 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d2894-fcd1-49a0-8408-bd6817db23a1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:39.215183 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f29f5e-db8a-4dcc-8e6f-7c6f7ee47b4d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:39.254885 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76244da2-1a84-4b24-a1b9-be2cdc523329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:39.255785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76244da2-1a84-4b24-a1b9-be2cdc523329 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:39.256135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a559558-5407-4492-8052-338be97fa5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:39.256403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76244da2-1a84-4b24-a1b9-be2cdc523329 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:39.256772 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a559558-5407-4492-8052-338be97fa5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:39.257042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76244da2-1a84-4b24-a1b9-be2cdc523329 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385/users/1f37a87a3a134e11b04fc15951f5443e/roles/2e9374cdc2f84d6eac42b2dfaf1008a3` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:39.257149 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a559558-5407-4492-8052-338be97fa5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:39.257313 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a559558-5407-4492-8052-338be97fa5a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:39.257983 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a559558-5407-4492-8052-338be97fa5a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:39.258287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a559558-5407-4492-8052-338be97fa5a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:39.259581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76244da2-1a84-4b24-a1b9-be2cdc523329 None admin] RBAC: Authorizing `identity:create_grant(project_id=15e11565450444f8bd36291d4e8e3385, user_id=1f37a87a3a134e11b04fc15951f5443e, role_id=2e9374cdc2f84d6eac42b2dfaf1008a3)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:39.259692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a559558-5407-4492-8052-338be97fa5a3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:39.261411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76244da2-1a84-4b24-a1b9-be2cdc523329 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:39.276774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 72/151] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:39.276774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80913f-1038-4a5e-815e-2c8c6992f8a8 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:39.276774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80913f-1038-4a5e-815e-2c8c6992f8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:39.276774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b80913f-1038-4a5e-815e-2c8c6992f8a8 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:39.277189 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 73/152] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:39.282271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80913f-1038-4a5e-815e-2c8c6992f8a8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:39.286797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 80/153] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:23:39 2022] PUT /identity/v3/projects/15e11565450444f8bd36291d4e8e3385/users/1f37a87a3a134e11b04fc15951f5443e/roles/2e9374cdc2f84d6eac42b2dfaf1008a3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:23:39.288383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79295ea1-6834-4d07-a3e5-ed3ac53f98d6 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:39.288851 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79295ea1-6834-4d07-a3e5-ed3ac53f98d6 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:39.289340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79295ea1-6834-4d07-a3e5-ed3ac53f98d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:39.312102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-79295ea1-6834-4d07-a3e5-ed3ac53f98d6 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:39.313744 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-79295ea1-6834-4d07-a3e5-ed3ac53f98d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:39.411996 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:39.463396 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 81/154] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:39.487953 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b80913f-1038-4a5e-815e-2c8c6992f8a8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:39.517073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:39.536077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360245f-3a2a-43e0-ac62-01354c622b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:39.537064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360245f-3a2a-43e0-ac62-01354c622b4d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:39.537503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360245f-3a2a-43e0-ac62-01354c622b4d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:39.537918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4360245f-3a2a-43e0-ac62-01354c622b4d None admin] PATH_INFO: `/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:39.539294 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360245f-3a2a-43e0-ac62-01354c622b4d None admin] RBAC: Authorizing `identity:get_user(user_id=b1eaabedfbf1451aa63ab57fb37bf6cf)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:39.541088 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4360245f-3a2a-43e0-ac62-01354c622b4d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:39.543294 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 74/155] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:39 2022] GET /identity/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:39.549159 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79295ea1-6834-4d07-a3e5-ed3ac53f98d6 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:39.683877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79295ea1-6834-4d07-a3e5-ed3ac53f98d6 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:39.729027 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b81377-fa7e-41f0-b1a8-891a269572d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:39.729903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b81377-fa7e-41f0-b1a8-891a269572d0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:39.730334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b81377-fa7e-41f0-b1a8-891a269572d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:39.730756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b81377-fa7e-41f0-b1a8-891a269572d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:39.789142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:39.813820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b81377-fa7e-41f0-b1a8-891a269572d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:39.815316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b81377-fa7e-41f0-b1a8-891a269572d0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:39.924341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 82/156] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 06:23:39.930338 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360245f-3a2a-43e0-ac62-01354c622b4d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:40.048603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e879e0f-f0fc-4da8-bad7-c8f8a7b6d226 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:40.048822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e879e0f-f0fc-4da8-bad7-c8f8a7b6d226 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:40.049091 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e879e0f-f0fc-4da8-bad7-c8f8a7b6d226 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:40.050567 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 83/157] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:40.055889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffe19d-183f-4510-ad32-afb7e79d0334 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:40.056167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffe19d-183f-4510-ad32-afb7e79d0334 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:40.056439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ffe19d-183f-4510-ad32-afb7e79d0334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:40.072583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4360245f-3a2a-43e0-ac62-01354c622b4d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:40.085117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d1ffe19d-183f-4510-ad32-afb7e79d0334 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:40.086332 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d1ffe19d-183f-4510-ad32-afb7e79d0334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:40.138548 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64373ea-88bb-4ec1-94cd-dcca3e0497e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:40.139193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64373ea-88bb-4ec1-94cd-dcca3e0497e6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:40.139473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64373ea-88bb-4ec1-94cd-dcca3e0497e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:40.139745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64373ea-88bb-4ec1-94cd-dcca3e0497e6 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:40.142369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64373ea-88bb-4ec1-94cd-dcca3e0497e6 None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:40.143833 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64373ea-88bb-4ec1-94cd-dcca3e0497e6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:40.148355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 75/158] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:39 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:40.151774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64373ea-88bb-4ec1-94cd-dcca3e0497e6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:40.212698 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 84/159] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:23:40.259865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:40.264588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffe19d-183f-4510-ad32-afb7e79d0334 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:40.279403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:40.319759 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64373ea-88bb-4ec1-94cd-dcca3e0497e6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:40.396210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d08b5-7fe6-446f-bc95-bfda502cf25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:40.396849 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d08b5-7fe6-446f-bc95-bfda502cf25d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:40.397132 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d08b5-7fe6-446f-bc95-bfda502cf25d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:40.397407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d08b5-7fe6-446f-bc95-bfda502cf25d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:40.398145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d08b5-7fe6-446f-bc95-bfda502cf25d None admin] RBAC: Adding query filter params (role.id=1147187a70be4f46abe9a5f8d33d98fa, scope.project.id=15e11565450444f8bd36291d4e8e3385, user.id=b1eaabedfbf1451aa63ab57fb37bf6cf) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:40.398457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d08b5-7fe6-446f-bc95-bfda502cf25d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:40.399911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3d08b5-7fe6-446f-bc95-bfda502cf25d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:40.416458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 76/160] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:40 2022] GET /identity/v3/role_assignments?user.id=b1eaabedfbf1451aa63ab57fb37bf6cf&scope.project.id=15e11565450444f8bd36291d4e8e3385&role.id=1147187a70be4f46abe9a5f8d33d98fa => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:40.443244 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ffe19d-183f-4510-ad32-afb7e79d0334 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:40.481738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e99f97-624e-440f-bfcd-8388b8f50704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:40.482434 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e99f97-624e-440f-bfcd-8388b8f50704 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:40.482710 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e99f97-624e-440f-bfcd-8388b8f50704 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:40.482979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e99f97-624e-440f-bfcd-8388b8f50704 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:40.494528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e99f97-624e-440f-bfcd-8388b8f50704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-22e99f97-624e-440f-bfcd-8388b8f50704 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:40.499573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:40.500546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:40.501397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:40.501397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:40.501397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:40.501397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:40.501397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:40.501397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:40.501397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:40.501397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:40.501397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:40.501397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:40.501397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:23:40.501397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:40.501397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 85/161] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:23:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:23:40.506940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d08b5-7fe6-446f-bc95-bfda502cf25d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:40.617823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d08b5-7fe6-446f-bc95-bfda502cf25d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:40.645096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:40.656568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e695b2b-00f2-4dee-934c-0017da1b86af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:40.657223 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e695b2b-00f2-4dee-934c-0017da1b86af None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:40.657505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e695b2b-00f2-4dee-934c-0017da1b86af None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:40.657838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e695b2b-00f2-4dee-934c-0017da1b86af None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:40.658514 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e695b2b-00f2-4dee-934c-0017da1b86af None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:40.658869 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e695b2b-00f2-4dee-934c-0017da1b86af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:40.660299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e695b2b-00f2-4dee-934c-0017da1b86af None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:40.669661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 77/162] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:23:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:40.675285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e99f97-624e-440f-bfcd-8388b8f50704 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:40.753065 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:40.797315 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e99f97-624e-440f-bfcd-8388b8f50704 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:40.843521 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edfff3-fab2-4ad2-b9f5-bd10f8337057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:40.844174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edfff3-fab2-4ad2-b9f5-bd10f8337057 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:40.844452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edfff3-fab2-4ad2-b9f5-bd10f8337057 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:40.844754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27edfff3-fab2-4ad2-b9f5-bd10f8337057 None admin] PATH_INFO: `/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:40.846016 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edfff3-fab2-4ad2-b9f5-bd10f8337057 None admin] RBAC: Authorizing `identity:get_user(user_id=b1eaabedfbf1451aa63ab57fb37bf6cf)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:40.847571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27edfff3-fab2-4ad2-b9f5-bd10f8337057 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:40.849577 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 86/163] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:40 2022] GET /identity/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:40.855662 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e695b2b-00f2-4dee-934c-0017da1b86af None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:40.946910 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edfff3-fab2-4ad2-b9f5-bd10f8337057 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:40.988288 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e695b2b-00f2-4dee-934c-0017da1b86af None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:41.029679 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9b3a5-6a11-41a3-91e3-fa5ae0867b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:41.030296 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9b3a5-6a11-41a3-91e3-fa5ae0867b29 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:41.030576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9b3a5-6a11-41a3-91e3-fa5ae0867b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:41.030849 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab9b3a5-6a11-41a3-91e3-fa5ae0867b29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:41.095512 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:41.132154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9b3a5-6a11-41a3-91e3-fa5ae0867b29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:41.134106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab9b3a5-6a11-41a3-91e3-fa5ae0867b29 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:41.145488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27edfff3-fab2-4ad2-b9f5-bd10f8337057 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:41.192134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c59f65-7ca6-48be-ba82-adf82667db48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:41.196844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c59f65-7ca6-48be-ba82-adf82667db48 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:41.197206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c59f65-7ca6-48be-ba82-adf82667db48 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:41.197428 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c59f65-7ca6-48be-ba82-adf82667db48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:41.200376 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:41.213025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c59f65-7ca6-48be-ba82-adf82667db48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c5c59f65-7ca6-48be-ba82-adf82667db48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:41.218408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:41.219297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:41.220327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:41.220327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:41.220327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:41.220327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:41.220327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:41.220327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:41.220327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:41.220327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:41.220327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:41.220327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:41.220327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:41.220327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:41.220327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 87/164] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:23:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:41.221515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1c63b-8d85-41e5-8632-8a18c07f30e7 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:41.221515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1c63b-8d85-41e5-8632-8a18c07f30e7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:41.221752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d1c63b-8d85-41e5-8632-8a18c07f30e7 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:41.222968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 88/165] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:41.228460 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142c970-ded4-4258-8356-b2debd6edd6e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:41.228771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142c970-ded4-4258-8356-b2debd6edd6e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:41.229054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0142c970-ded4-4258-8356-b2debd6edd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:41.256977 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0142c970-ded4-4258-8356-b2debd6edd6e None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:41.258242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0142c970-ded4-4258-8356-b2debd6edd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:41.339626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 78/166] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:23:41.340878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9b3a5-6a11-41a3-91e3-fa5ae0867b29 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:41.356476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 89/167] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:23:41.358888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142c970-ded4-4258-8356-b2debd6edd6e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:41.498284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0142c970-ded4-4258-8356-b2debd6edd6e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:41.507065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:41.524742 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:41.534034 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35fabb-920d-44e4-9805-e568c2c96896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:41.534676 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35fabb-920d-44e4-9805-e568c2c96896 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:41.534956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35fabb-920d-44e4-9805-e568c2c96896 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:41.535228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35fabb-920d-44e4-9805-e568c2c96896 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:41.536366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35fabb-920d-44e4-9805-e568c2c96896 None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:41.537835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35fabb-920d-44e4-9805-e568c2c96896 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:41.539466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 90/168] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:41 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:41.541907 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab9b3a5-6a11-41a3-91e3-fa5ae0867b29 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:41.545873 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35fabb-920d-44e4-9805-e568c2c96896 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:41.584139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b669490-16fb-4220-9c90-55d2ac303511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:41.585292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b669490-16fb-4220-9c90-55d2ac303511 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:41.585787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b669490-16fb-4220-9c90-55d2ac303511 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:41.586251 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b669490-16fb-4220-9c90-55d2ac303511 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:41.587194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b669490-16fb-4220-9c90-55d2ac303511 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:41.587874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b669490-16fb-4220-9c90-55d2ac303511 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:41.590591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b669490-16fb-4220-9c90-55d2ac303511 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:41.601741 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 79/169] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:41.607537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b669490-16fb-4220-9c90-55d2ac303511 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:41.671061 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35fabb-920d-44e4-9805-e568c2c96896 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:41.707477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd47ec-491a-4593-b879-f60ed5c13fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:41.708000 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd47ec-491a-4593-b879-f60ed5c13fc6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:41.708350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd47ec-491a-4593-b879-f60ed5c13fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:41.708809 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bd47ec-491a-4593-b879-f60ed5c13fc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:41.709523 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd47ec-491a-4593-b879-f60ed5c13fc6 None admin] RBAC: Adding query filter params (role.id=8727ddb8ab8e4ae4bf2145352def3fb6, scope.project.id=15e11565450444f8bd36291d4e8e3385, user.id=b1eaabedfbf1451aa63ab57fb37bf6cf) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:41.709901 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd47ec-491a-4593-b879-f60ed5c13fc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:41.711405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bd47ec-491a-4593-b879-f60ed5c13fc6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:41.717867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 91/170] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:41 2022] GET /identity/v3/role_assignments?user.id=b1eaabedfbf1451aa63ab57fb37bf6cf&scope.project.id=15e11565450444f8bd36291d4e8e3385&role.id=8727ddb8ab8e4ae4bf2145352def3fb6 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:41.763538 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b669490-16fb-4220-9c90-55d2ac303511 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:41.806849 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fa0ae-d3ed-4f00-9efe-6ae37d4f633c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:41.807759 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fa0ae-d3ed-4f00-9efe-6ae37d4f633c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:41.808219 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fa0ae-d3ed-4f00-9efe-6ae37d4f633c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:41.808634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5fa0ae-d3ed-4f00-9efe-6ae37d4f633c None admin] PATH_INFO: `/v3/users/bcb0a034a4c8491eb41145193c3db0d0` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:41.810031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fa0ae-d3ed-4f00-9efe-6ae37d4f633c None admin] RBAC: Authorizing `identity:get_user(user_id=bcb0a034a4c8491eb41145193c3db0d0)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:41.812149 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5fa0ae-d3ed-4f00-9efe-6ae37d4f633c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:41.813916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 80/171] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:41 2022] GET /identity/v3/users/bcb0a034a4c8491eb41145193c3db0d0 => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:41.819525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd47ec-491a-4593-b879-f60ed5c13fc6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:41.903060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:41.906118 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fa0ae-d3ed-4f00-9efe-6ae37d4f633c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:41.930005 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:41.987001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bd47ec-491a-4593-b879-f60ed5c13fc6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:42.073500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ea5ca-d21d-4173-820c-679536e0584f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:42.074047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ea5ca-d21d-4173-820c-679536e0584f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:42.074343 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ea5ca-d21d-4173-820c-679536e0584f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:42.074606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ea5ca-d21d-4173-820c-679536e0584f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:42.088427 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5fa0ae-d3ed-4f00-9efe-6ae37d4f633c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:42.161941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171028fb-9f46-4551-8274-c7ef9f6703eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:42.162590 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171028fb-9f46-4551-8274-c7ef9f6703eb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:42.162871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171028fb-9f46-4551-8274-c7ef9f6703eb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:42.163145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171028fb-9f46-4551-8274-c7ef9f6703eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:42.189607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171028fb-9f46-4551-8274-c7ef9f6703eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-171028fb-9f46-4551-8274-c7ef9f6703eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:42.194993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:42.195955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:42.196810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:42.196810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:42.196810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:42.196810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:42.196810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:42.196810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:42.196810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:42.196810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:42.196810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:42.196810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:42.196810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:42.196810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:42.196810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 81/172] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:23:42.203151 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171028fb-9f46-4551-8274-c7ef9f6703eb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:42.257732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ea5ca-d21d-4173-820c-679536e0584f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:42.259224 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08ea5ca-d21d-4173-820c-679536e0584f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:42.366989 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:42.369635 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:42.430998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 92/173] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:23:42.442339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171028fb-9f46-4551-8274-c7ef9f6703eb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:42.459141 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ea5ca-d21d-4173-820c-679536e0584f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:42.522453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde3602-eaac-4789-a1f7-a65413c8fc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:42.523090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde3602-eaac-4789-a1f7-a65413c8fc1a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:42.523374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde3602-eaac-4789-a1f7-a65413c8fc1a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:42.523651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bde3602-eaac-4789-a1f7-a65413c8fc1a None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:42.524340 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde3602-eaac-4789-a1f7-a65413c8fc1a None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:42.524647 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde3602-eaac-4789-a1f7-a65413c8fc1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:42.526109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bde3602-eaac-4789-a1f7-a65413c8fc1a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:42.549367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 82/174] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:42.556712 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde3602-eaac-4789-a1f7-a65413c8fc1a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:42.640158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08ea5ca-d21d-4173-820c-679536e0584f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:42.711952 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bde3602-eaac-4789-a1f7-a65413c8fc1a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:42.713550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5461b7-f854-47bd-bffd-933a8ddad07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:42.714431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5461b7-f854-47bd-bffd-933a8ddad07b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:42.714904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5461b7-f854-47bd-bffd-933a8ddad07b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:42.715369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5461b7-f854-47bd-bffd-933a8ddad07b None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:42.717630 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5461b7-f854-47bd-bffd-933a8ddad07b None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:42.719351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5461b7-f854-47bd-bffd-933a8ddad07b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:42.721519 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 93/175] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:42 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:42.722832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4d728-30c7-42bb-887d-a8b2c4598a8f None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:42.723374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4d728-30c7-42bb-887d-a8b2c4598a8f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:42.723841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4d728-30c7-42bb-887d-a8b2c4598a8f None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:42.732690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 94/176] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:42.733797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4d728-30c7-42bb-887d-a8b2c4598a8f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:42.753064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87f9e3e-b94f-4e95-9904-87a903452775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:42.753705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f9e3e-b94f-4e95-9904-87a903452775 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:42.753988 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f9e3e-b94f-4e95-9904-87a903452775 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:42.754267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87f9e3e-b94f-4e95-9904-87a903452775 None admin] PATH_INFO: `/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:42.755538 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f9e3e-b94f-4e95-9904-87a903452775 None admin] RBAC: Authorizing `identity:get_user(user_id=b1eaabedfbf1451aa63ab57fb37bf6cf)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:42.756996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87f9e3e-b94f-4e95-9904-87a903452775 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:42.761036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 83/177] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:42 2022] GET /identity/v3/users/b1eaabedfbf1451aa63ab57fb37bf6cf => generated 275 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:42.763719 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db225f-0969-467c-aac9-3abf12753b09 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:42.764005 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db225f-0969-467c-aac9-3abf12753b09 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:42.764280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db225f-0969-467c-aac9-3abf12753b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:42.790337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:42.793006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:42.801006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d4db225f-0969-467c-aac9-3abf12753b09 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:42.802239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d4db225f-0969-467c-aac9-3abf12753b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:42.886600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 84/178] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:42.888746 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db225f-0969-467c-aac9-3abf12753b09 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:42.937443 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4d728-30c7-42bb-887d-a8b2c4598a8f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:43.024766 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efed4f06-c1a0-4368-adc7-8b5d2619985c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:43.025387 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed4f06-c1a0-4368-adc7-8b5d2619985c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:43.025675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed4f06-c1a0-4368-adc7-8b5d2619985c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:43.025953 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efed4f06-c1a0-4368-adc7-8b5d2619985c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:43.026845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed4f06-c1a0-4368-adc7-8b5d2619985c None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=15e11565450444f8bd36291d4e8e3385, user.id=bcb0a034a4c8491eb41145193c3db0d0) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:43.027165 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed4f06-c1a0-4368-adc7-8b5d2619985c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:43.029447 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efed4f06-c1a0-4368-adc7-8b5d2619985c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:43.042225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 95/179] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:42 2022] GET /identity/v3/role_assignments?user.id=bcb0a034a4c8491eb41145193c3db0d0&scope.project.id=15e11565450444f8bd36291d4e8e3385&role.id=6382a06103714d068409d25cbeb48744 => generated 608 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:43.099963 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db225f-0969-467c-aac9-3abf12753b09 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:43.148896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:43.160097 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d5d62-6e4f-44a9-9396-3d6005fec8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:43.161108 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d5d62-6e4f-44a9-9396-3d6005fec8ae None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:43.161611 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d5d62-6e4f-44a9-9396-3d6005fec8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:43.162074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d5d62-6e4f-44a9-9396-3d6005fec8ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:43.262813 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d5d62-6e4f-44a9-9396-3d6005fec8ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:43.264752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732d5d62-6e4f-44a9-9396-3d6005fec8ae None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:43.363317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3a396-bd43-47af-8f40-100f773545cb None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:43.363690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3a396-bd43-47af-8f40-100f773545cb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:43.363873 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3a396-bd43-47af-8f40-100f773545cb None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:43.368356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 96/180] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:43.372526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e342d-539d-43f8-a11c-1689cf80c4bf None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:43.373399 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e342d-539d-43f8-a11c-1689cf80c4bf None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:43.373652 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e342d-539d-43f8-a11c-1689cf80c4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:43.399472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-427e342d-539d-43f8-a11c-1689cf80c4bf None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:43.401359 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-427e342d-539d-43f8-a11c-1689cf80c4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:43.409427 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 85/181] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:23:43.416593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d5d62-6e4f-44a9-9396-3d6005fec8ae None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:43.457490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:43.532093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 97/182] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:43.533229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e342d-539d-43f8-a11c-1689cf80c4bf None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:43.545688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d5d62-6e4f-44a9-9396-3d6005fec8ae None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:43.559635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:43.599917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366040cd-b5a9-403f-a5bb-b30f40bd7da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:43.600786 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366040cd-b5a9-403f-a5bb-b30f40bd7da8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:43.601017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366040cd-b5a9-403f-a5bb-b30f40bd7da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:43.601286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366040cd-b5a9-403f-a5bb-b30f40bd7da8 None admin] PATH_INFO: `/v3/projects/7eabfe5c98d74f529cbd92228e458f0b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:43.602529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366040cd-b5a9-403f-a5bb-b30f40bd7da8 None admin] RBAC: Authorizing `identity:get_project(project_id=7eabfe5c98d74f529cbd92228e458f0b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:43.603901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366040cd-b5a9-403f-a5bb-b30f40bd7da8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:43.611702 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 86/183] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:43 2022] GET /identity/v3/projects/7eabfe5c98d74f529cbd92228e458f0b => generated 312 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:43.613342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4494c-79ec-4f41-b709-b097ed6db9da None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:43.613626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4494c-79ec-4f41-b709-b097ed6db9da None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:43.614027 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4494c-79ec-4f41-b709-b097ed6db9da None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:43.615543 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 87/184] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:43.617340 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4494c-79ec-4f41-b709-b097ed6db9da None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:43.664574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e342d-539d-43f8-a11c-1689cf80c4bf None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:43.706597 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b1c1b6-dd0e-4939-bcc0-a7bd0e09a011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:43.707233 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1c1b6-dd0e-4939-bcc0-a7bd0e09a011 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:43.707509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1c1b6-dd0e-4939-bcc0-a7bd0e09a011 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:43.707779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b1c1b6-dd0e-4939-bcc0-a7bd0e09a011 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:43.719758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b1c1b6-dd0e-4939-bcc0-a7bd0e09a011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-97b1c1b6-dd0e-4939-bcc0-a7bd0e09a011 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:43.724580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:43.725535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:43.729520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:43.729520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:43.729520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:43.729520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:43.729520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:43.729520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:43.729520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:43.729520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:43.729520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:43.729520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:43.729520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:43.729520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:43.729520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 98/185] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:23:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:43.729520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4615c91-7eb8-49b9-8065-30efe11a62cb None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:43.730286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4615c91-7eb8-49b9-8065-30efe11a62cb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:43.730286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4615c91-7eb8-49b9-8065-30efe11a62cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:43.746079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-c4615c91-7eb8-49b9-8065-30efe11a62cb None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:43.747274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c4615c91-7eb8-49b9-8065-30efe11a62cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:43.754424 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:43.759258 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4494c-79ec-4f41-b709-b097ed6db9da None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:43.796336 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1d710-aeb8-4756-97e3-15808e46ab36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:43.796890 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1d710-aeb8-4756-97e3-15808e46ab36 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:43.797166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1d710-aeb8-4756-97e3-15808e46ab36 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:43.797434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1d710-aeb8-4756-97e3-15808e46ab36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:43.798147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1d710-aeb8-4756-97e3-15808e46ab36 None admin] RBAC: Adding query filter params (role.id=1147187a70be4f46abe9a5f8d33d98fa, scope.project.id=7eabfe5c98d74f529cbd92228e458f0b, user.id=b1eaabedfbf1451aa63ab57fb37bf6cf) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:43.798448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1d710-aeb8-4756-97e3-15808e46ab36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:43.799852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1d710-aeb8-4756-97e3-15808e46ab36 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:43.812846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 88/186] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:43 2022] GET /identity/v3/role_assignments?user.id=b1eaabedfbf1451aa63ab57fb37bf6cf&scope.project.id=7eabfe5c98d74f529cbd92228e458f0b&role.id=1147187a70be4f46abe9a5f8d33d98fa => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:43.812846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3c907-354a-4ad4-9fe5-59fe497945a6 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:43.812846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3c907-354a-4ad4-9fe5-59fe497945a6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:43.812846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3c907-354a-4ad4-9fe5-59fe497945a6 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:43.812846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 89/187] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:43.812846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3c907-354a-4ad4-9fe5-59fe497945a6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:43.825135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 99/188] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:43.827108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2989290-9225-47f2-94f1-2848f466042d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:43.827493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2989290-9225-47f2-94f1-2848f466042d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:43.827841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2989290-9225-47f2-94f1-2848f466042d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:43.847259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a2989290-9225-47f2-94f1-2848f466042d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:43.848561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a2989290-9225-47f2-94f1-2848f466042d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:43.852068 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:43.927391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 100/189] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:43.933955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2989290-9225-47f2-94f1-2848f466042d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:43.941598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3c907-354a-4ad4-9fe5-59fe497945a6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:44.005821 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b01621-3be5-4f49-a07b-be85a89af8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:44.006845 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b01621-3be5-4f49-a07b-be85a89af8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:44.008203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b01621-3be5-4f49-a07b-be85a89af8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:44.009743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b01621-3be5-4f49-a07b-be85a89af8d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:44.010647 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b01621-3be5-4f49-a07b-be85a89af8d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:44.017517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b01621-3be5-4f49-a07b-be85a89af8d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:44.018923 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b01621-3be5-4f49-a07b-be85a89af8d0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:44.031408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 90/190] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:44.037476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b01621-3be5-4f49-a07b-be85a89af8d0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:44.088277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:44.089201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2989290-9225-47f2-94f1-2848f466042d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:44.140359 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3494d-4ffd-40d8-931a-bc418dc28921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:44.141043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3494d-4ffd-40d8-931a-bc418dc28921 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:44.141321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3494d-4ffd-40d8-931a-bc418dc28921 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:44.141593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3494d-4ffd-40d8-931a-bc418dc28921 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:44.153702 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:44.160123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe3494d-4ffd-40d8-931a-bc418dc28921 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-dfe3494d-4ffd-40d8-931a-bc418dc28921 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:44.167024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:44.167919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:44.169285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:44.169285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:44.169285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:44.169285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:44.169285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:44.169285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:44.169285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:44.169285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:44.169285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:44.169285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:44.169285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:23:44.169285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:44.169285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 101/191] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:23:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:44.170521 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3494d-4ffd-40d8-931a-bc418dc28921 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:44.174913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b01621-3be5-4f49-a07b-be85a89af8d0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:44.210437 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3579cfa-03a9-4cf5-b36b-d2c5d2b44dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:44.211375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3579cfa-03a9-4cf5-b36b-d2c5d2b44dfb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:44.211649 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3579cfa-03a9-4cf5-b36b-d2c5d2b44dfb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:44.211916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3579cfa-03a9-4cf5-b36b-d2c5d2b44dfb None admin] PATH_INFO: `/v3/users/2ba6b1a9b34a466996daec1cab56c6d6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:44.226653 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3579cfa-03a9-4cf5-b36b-d2c5d2b44dfb None admin] RBAC: Authorizing `identity:get_user(user_id=2ba6b1a9b34a466996daec1cab56c6d6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:44.228090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3579cfa-03a9-4cf5-b36b-d2c5d2b44dfb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:44.229787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 91/192] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:44 2022] GET /identity/v3/users/2ba6b1a9b34a466996daec1cab56c6d6 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:44.230553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3579cfa-03a9-4cf5-b36b-d2c5d2b44dfb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:44.282851 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3494d-4ffd-40d8-931a-bc418dc28921 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:44.316019 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:44.320356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7aa9b-ae66-4918-b706-3cfeb12251d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:44.321241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7aa9b-ae66-4918-b706-3cfeb12251d5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:44.321521 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7aa9b-ae66-4918-b706-3cfeb12251d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:44.321793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7aa9b-ae66-4918-b706-3cfeb12251d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:44.332038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7aa9b-ae66-4918-b706-3cfeb12251d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:44.332762 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3579cfa-03a9-4cf5-b36b-d2c5d2b44dfb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-8dc7aa9b-ae66-4918-b706-3cfeb12251d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:44.336814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:44.337726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:44.338576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:44.338576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:44.338576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:44.338576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:44.338576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:44.338576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:44.338576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:44.338576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:44.338576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:44.338576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:44.338576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:23:44.338576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:44.338576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 102/193] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:44.339723 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7aa9b-ae66-4918-b706-3cfeb12251d5 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:44.372278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fde37-2197-4136-92ef-020af6438b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:44.372913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fde37-2197-4136-92ef-020af6438b61 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:44.373194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fde37-2197-4136-92ef-020af6438b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:44.373468 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40fde37-2197-4136-92ef-020af6438b61 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:44.374134 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40fde37-2197-4136-92ef-020af6438b61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:44.374445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40fde37-2197-4136-92ef-020af6438b61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:44.375814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40fde37-2197-4136-92ef-020af6438b61 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:44.383557 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 92/194] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:23:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:44.384339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fde37-2197-4136-92ef-020af6438b61 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:44.402218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:44.443185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7aa9b-ae66-4918-b706-3cfeb12251d5 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:44.476446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dda54e-73ef-4f34-be18-8a4028cc2fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:44.477096 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dda54e-73ef-4f34-be18-8a4028cc2fa2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:44.477373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dda54e-73ef-4f34-be18-8a4028cc2fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:44.477648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dda54e-73ef-4f34-be18-8a4028cc2fa2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:44.478750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dda54e-73ef-4f34-be18-8a4028cc2fa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:44.480186 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dda54e-73ef-4f34-be18-8a4028cc2fa2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:44.480289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40fde37-2197-4136-92ef-020af6438b61 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:44.481769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 103/195] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:23:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:44.483063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dda54e-73ef-4f34-be18-8a4028cc2fa2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:44.513841 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e020e3-d562-41e6-b3b2-6756f41df950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:44.514444 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e020e3-d562-41e6-b3b2-6756f41df950 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:44.514723 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e020e3-d562-41e6-b3b2-6756f41df950 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:44.514998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e020e3-d562-41e6-b3b2-6756f41df950 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:44.531326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:44.581455 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dda54e-73ef-4f34-be18-8a4028cc2fa2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:44.581614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e020e3-d562-41e6-b3b2-6756f41df950 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:44.583023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e020e3-d562-41e6-b3b2-6756f41df950 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:44.607857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:44.615805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf983a4-2135-4933-8303-6b16e7212cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:44.616405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf983a4-2135-4933-8303-6b16e7212cd8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:44.616708 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf983a4-2135-4933-8303-6b16e7212cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:44.616981 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf983a4-2135-4933-8303-6b16e7212cd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:44.617644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf983a4-2135-4933-8303-6b16e7212cd8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:44.617952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf983a4-2135-4933-8303-6b16e7212cd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:44.619573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf983a4-2135-4933-8303-6b16e7212cd8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:44.627601 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 104/196] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:44.628425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf983a4-2135-4933-8303-6b16e7212cd8 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:44.687089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 93/197] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:23:44.687910 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e020e3-d562-41e6-b3b2-6756f41df950 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:44.730632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf983a4-2135-4933-8303-6b16e7212cd8 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:44.734092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:44.764156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a6661-030b-4a8f-a902-d515e6ea471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:44.764809 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a6661-030b-4a8f-a902-d515e6ea471c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:44.765083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a6661-030b-4a8f-a902-d515e6ea471c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:44.765352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92a6661-030b-4a8f-a902-d515e6ea471c None admin] PATH_INFO: `/v3/users/2ba6b1a9b34a466996daec1cab56c6d6` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:44.766467 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a6661-030b-4a8f-a902-d515e6ea471c None admin] RBAC: Authorizing `identity:get_user(user_id=2ba6b1a9b34a466996daec1cab56c6d6)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:44.767885 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92a6661-030b-4a8f-a902-d515e6ea471c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:44.769463 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 105/198] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:44 2022] GET /identity/v3/users/2ba6b1a9b34a466996daec1cab56c6d6 => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:44.770217 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a6661-030b-4a8f-a902-d515e6ea471c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:44.786138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e020e3-d562-41e6-b3b2-6756f41df950 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:44.821407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcf960-191d-487e-a697-4b3f5bea3152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:44.822013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcf960-191d-487e-a697-4b3f5bea3152 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:44.822288 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcf960-191d-487e-a697-4b3f5bea3152 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:44.822561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcf960-191d-487e-a697-4b3f5bea3152 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:44.823210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcf960-191d-487e-a697-4b3f5bea3152 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:44.824651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafcf960-191d-487e-a697-4b3f5bea3152 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:44.830968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:44.844466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 94/199] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:23:44 2022] POST /identity/v3/users => generated 297 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:23:44.845326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcf960-191d-487e-a697-4b3f5bea3152 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:44.885089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92a6661-030b-4a8f-a902-d515e6ea471c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:44.921770 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95fdd9-bc94-46a3-8a35-218ff7b93958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:44.922419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95fdd9-bc94-46a3-8a35-218ff7b93958 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:44.922694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95fdd9-bc94-46a3-8a35-218ff7b93958 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:44.922965 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a95fdd9-bc94-46a3-8a35-218ff7b93958 None admin] PATH_INFO: `/v3/users/1f37a87a3a134e11b04fc15951f5443e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:44.924159 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95fdd9-bc94-46a3-8a35-218ff7b93958 None admin] RBAC: Authorizing `identity:get_user(user_id=1f37a87a3a134e11b04fc15951f5443e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:44.925663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a95fdd9-bc94-46a3-8a35-218ff7b93958 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:44.927304 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 106/200] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:44 2022] GET /identity/v3/users/1f37a87a3a134e11b04fc15951f5443e => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:44.928380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95fdd9-bc94-46a3-8a35-218ff7b93958 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:44.960852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcf960-191d-487e-a697-4b3f5bea3152 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:44.962796 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:45.000912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fd4b8-6f78-45e9-ba17-63747f23e8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:45.001563 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fd4b8-6f78-45e9-ba17-63747f23e8ed None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:45.001845 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fd4b8-6f78-45e9-ba17-63747f23e8ed None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:45.002121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fd4b8-6f78-45e9-ba17-63747f23e8ed None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:45.003304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fd4b8-6f78-45e9-ba17-63747f23e8ed None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:45.004800 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273fd4b8-6f78-45e9-ba17-63747f23e8ed None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:45.006661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 95/201] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:44 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:45.007284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fd4b8-6f78-45e9-ba17-63747f23e8ed None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:45.041292 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a95fdd9-bc94-46a3-8a35-218ff7b93958 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:45.075949 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:45.085478 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc72b8-c701-422c-a15c-e1a7166771ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:45.086088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc72b8-c701-422c-a15c-e1a7166771ea None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:45.086369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc72b8-c701-422c-a15c-e1a7166771ea None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:45.086641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc72b8-c701-422c-a15c-e1a7166771ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:45.135404 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fd4b8-6f78-45e9-ba17-63747f23e8ed None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:45.176124 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc72b8-c701-422c-a15c-e1a7166771ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:45.177647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc72b8-c701-422c-a15c-e1a7166771ea None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:45.177973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d976ac5-cc6c-4dcf-8125-34a2c4fb088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:45.178661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d976ac5-cc6c-4dcf-8125-34a2c4fb088d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:45.178943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d976ac5-cc6c-4dcf-8125-34a2c4fb088d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:45.179214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d976ac5-cc6c-4dcf-8125-34a2c4fb088d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:45.221755 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:45.261493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d976ac5-cc6c-4dcf-8125-34a2c4fb088d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:45.262969 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d976ac5-cc6c-4dcf-8125-34a2c4fb088d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:45.324356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 107/202] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:23:45.328837 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc72b8-c701-422c-a15c-e1a7166771ea None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:45.366694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:45.394620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 96/203] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:23:45.396433 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d976ac5-cc6c-4dcf-8125-34a2c4fb088d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:45.448190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc72b8-c701-422c-a15c-e1a7166771ea None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:45.484457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc8d30-588d-46aa-9445-1e0895f8675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:45.485123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc8d30-588d-46aa-9445-1e0895f8675a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:45.485403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc8d30-588d-46aa-9445-1e0895f8675a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:45.485674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc8d30-588d-46aa-9445-1e0895f8675a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:45.486405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc8d30-588d-46aa-9445-1e0895f8675a None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=081387ea09d34bfb94fa762df1c2cd1d, user.id=2ba6b1a9b34a466996daec1cab56c6d6) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:45.486713 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc8d30-588d-46aa-9445-1e0895f8675a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:45.488145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccc8d30-588d-46aa-9445-1e0895f8675a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:45.492812 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:45.494106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 108/204] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:45 2022] GET /identity/v3/role_assignments?user.id=2ba6b1a9b34a466996daec1cab56c6d6&scope.project.id=081387ea09d34bfb94fa762df1c2cd1d&role.id=6382a06103714d068409d25cbeb48744 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:45.501839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc8d30-588d-46aa-9445-1e0895f8675a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:45.533264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d976ac5-cc6c-4dcf-8125-34a2c4fb088d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:45.576454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750c10a-4e61-41c3-b8ad-62dfb8d64fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:45.577628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750c10a-4e61-41c3-b8ad-62dfb8d64fcf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:45.578344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750c10a-4e61-41c3-b8ad-62dfb8d64fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:45.578824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d750c10a-4e61-41c3-b8ad-62dfb8d64fcf None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:45.580298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750c10a-4e61-41c3-b8ad-62dfb8d64fcf None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:45.582258 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d750c10a-4e61-41c3-b8ad-62dfb8d64fcf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:45.584617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 97/205] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:45 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:45.593244 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750c10a-4e61-41c3-b8ad-62dfb8d64fcf None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:45.689414 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:45.702035 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc8d30-588d-46aa-9445-1e0895f8675a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:45.745466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbcd2e4-d39f-42ea-b5e5-f17fbe410388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:45.746366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcd2e4-d39f-42ea-b5e5-f17fbe410388 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:45.746787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcd2e4-d39f-42ea-b5e5-f17fbe410388 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:45.747209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcd2e4-d39f-42ea-b5e5-f17fbe410388 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:45.750132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbcd2e4-d39f-42ea-b5e5-f17fbe410388 None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:45.751731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbcd2e4-d39f-42ea-b5e5-f17fbe410388 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:45.753752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 109/206] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:45 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:45.760864 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbcd2e4-d39f-42ea-b5e5-f17fbe410388 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:45.782759 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d750c10a-4e61-41c3-b8ad-62dfb8d64fcf None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:45.834752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d0ba1-0cae-44f4-800d-9d7468f0ed67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:45.835453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d0ba1-0cae-44f4-800d-9d7468f0ed67 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:45.835649 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d0ba1-0cae-44f4-800d-9d7468f0ed67 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:45.835978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d0ba1-0cae-44f4-800d-9d7468f0ed67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:45.836801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d0ba1-0cae-44f4-800d-9d7468f0ed67 None admin] RBAC: Adding query filter params (role.id=8727ddb8ab8e4ae4bf2145352def3fb6, scope.project.id=081387ea09d34bfb94fa762df1c2cd1d, user.id=2ba6b1a9b34a466996daec1cab56c6d6) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:45.837113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d0ba1-0cae-44f4-800d-9d7468f0ed67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:45.838769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d0ba1-0cae-44f4-800d-9d7468f0ed67 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:45.852319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 98/207] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:45 2022] GET /identity/v3/role_assignments?user.id=2ba6b1a9b34a466996daec1cab56c6d6&scope.project.id=081387ea09d34bfb94fa762df1c2cd1d&role.id=8727ddb8ab8e4ae4bf2145352def3fb6 => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:45.887179 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbcd2e4-d39f-42ea-b5e5-f17fbe410388 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:45.926718 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66a42e-411c-4e5b-9819-ba5921e0045d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:45.927614 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66a42e-411c-4e5b-9819-ba5921e0045d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:45.928038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66a42e-411c-4e5b-9819-ba5921e0045d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:45.928453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66a42e-411c-4e5b-9819-ba5921e0045d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:45.929363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66a42e-411c-4e5b-9819-ba5921e0045d None admin] RBAC: Adding query filter params (role.id=2e9374cdc2f84d6eac42b2dfaf1008a3, scope.project.id=15e11565450444f8bd36291d4e8e3385, user.id=1f37a87a3a134e11b04fc15951f5443e) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:45.929815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66a42e-411c-4e5b-9819-ba5921e0045d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:45.931410 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66a42e-411c-4e5b-9819-ba5921e0045d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:45.938136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 110/208] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:45 2022] GET /identity/v3/role_assignments?user.id=1f37a87a3a134e11b04fc15951f5443e&scope.project.id=15e11565450444f8bd36291d4e8e3385&role.id=2e9374cdc2f84d6eac42b2dfaf1008a3 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:47.227549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b02699-24ec-4ea7-a36f-dc2731efcb7b None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:47.228073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b02699-24ec-4ea7-a36f-dc2731efcb7b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:47.228182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b02699-24ec-4ea7-a36f-dc2731efcb7b None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:47.229726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 99/209] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:47.235702 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccea1f-f97e-421a-91c0-85e951891149 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:47.236113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccea1f-f97e-421a-91c0-85e951891149 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:47.236285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ccea1f-f97e-421a-91c0-85e951891149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:47.255881 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-73ccea1f-f97e-421a-91c0-85e951891149 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:47.257103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-73ccea1f-f97e-421a-91c0-85e951891149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:47.274466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:47.332453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 111/210] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:23:47.443970 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b23240-a7de-48d7-b847-32febbbc0154 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:47.444317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b23240-a7de-48d7-b847-32febbbc0154 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:47.444535 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b23240-a7de-48d7-b847-32febbbc0154 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:47.446185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 100/211] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:47.451330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ab5e9-915f-4871-9fd0-54cb11333461 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:47.451830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ab5e9-915f-4871-9fd0-54cb11333461 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:47.452301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61ab5e9-915f-4871-9fd0-54cb11333461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:47.471385 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a61ab5e9-915f-4871-9fd0-54cb11333461 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:47.472907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a61ab5e9-915f-4871-9fd0-54cb11333461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:47.540849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 112/212] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:47.605491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b23240-a7de-48d7-b847-32febbbc0154 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:47.609420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:47.721838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b23240-a7de-48d7-b847-32febbbc0154 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:47.758156 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f55fb6-2010-4f0b-b164-6cdfd346bed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:47.759136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f55fb6-2010-4f0b-b164-6cdfd346bed7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:47.759616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f55fb6-2010-4f0b-b164-6cdfd346bed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:47.760080 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f55fb6-2010-4f0b-b164-6cdfd346bed7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:47.770935 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f55fb6-2010-4f0b-b164-6cdfd346bed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-33f55fb6-2010-4f0b-b164-6cdfd346bed7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:47.776651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:47.777568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:47.778351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:47.778351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:47.778351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:47.778351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:47.778351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:47.778351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:47.778351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:47.778351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:47.778351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:47.778351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:47.778351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:47.778351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:47.781122 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 101/213] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:47.789893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ab5e9-915f-4871-9fd0-54cb11333461 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:47.821690 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f55fb6-2010-4f0b-b164-6cdfd346bed7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:47.880922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:47.897490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:47.904948 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61ab5e9-915f-4871-9fd0-54cb11333461 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:47.943069 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91afe7-e007-4fe0-96a5-5f4b805caa5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:47.943675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91afe7-e007-4fe0-96a5-5f4b805caa5e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:47.943953 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91afe7-e007-4fe0-96a5-5f4b805caa5e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:47.944060 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f55fb6-2010-4f0b-b164-6cdfd346bed7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:47.944217 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91afe7-e007-4fe0-96a5-5f4b805caa5e None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:47.944916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91afe7-e007-4fe0-96a5-5f4b805caa5e None admin] RBAC: Adding query filter params (name=member) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:47.945217 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91afe7-e007-4fe0-96a5-5f4b805caa5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:47.946591 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91afe7-e007-4fe0-96a5-5f4b805caa5e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:47.955009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 113/214] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:47.958119 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b75aae-565e-4548-960b-d4cb26dbd3e7 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:47.958423 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b75aae-565e-4548-960b-d4cb26dbd3e7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:47.958696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b75aae-565e-4548-960b-d4cb26dbd3e7 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:47.961455 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 114/215] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:47.962832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b75aae-565e-4548-960b-d4cb26dbd3e7 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:47.984373 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aa90f4-c979-4ddf-bde2-6e9a6d9b6020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:47.985043 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa90f4-c979-4ddf-bde2-6e9a6d9b6020 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:47.985305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa90f4-c979-4ddf-bde2-6e9a6d9b6020 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:47.985643 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aa90f4-c979-4ddf-bde2-6e9a6d9b6020 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:47.986995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa90f4-c979-4ddf-bde2-6e9a6d9b6020 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:47.988432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94aa90f4-c979-4ddf-bde2-6e9a6d9b6020 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:47.995037 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 102/216] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:23:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:47.995037 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7449623-82dd-4bab-95a4-8e5896c40c92 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:47.995037 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7449623-82dd-4bab-95a4-8e5896c40c92 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:47.995037 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7449623-82dd-4bab-95a4-8e5896c40c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:48.012588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d7449623-82dd-4bab-95a4-8e5896c40c92 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:48.014404 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d7449623-82dd-4bab-95a4-8e5896c40c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:48.082820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b75aae-565e-4548-960b-d4cb26dbd3e7 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:48.083088 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 103/217] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:48.093667 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7449623-82dd-4bab-95a4-8e5896c40c92 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:48.126126 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860f389-cff7-4ce1-80bf-432c3a64c288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:48.127279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860f389-cff7-4ce1-80bf-432c3a64c288 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:48.127700 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860f389-cff7-4ce1-80bf-432c3a64c288 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:48.128381 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f860f389-cff7-4ce1-80bf-432c3a64c288 None admin] PATH_INFO: `/v3/users/73ee864e916f42d4ba5b2f1f37c20457` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:48.143657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860f389-cff7-4ce1-80bf-432c3a64c288 None admin] RBAC: Authorizing `identity:get_user(user_id=73ee864e916f42d4ba5b2f1f37c20457)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:48.145372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f860f389-cff7-4ce1-80bf-432c3a64c288 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:48.147459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 115/218] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:47 2022] GET /identity/v3/users/73ee864e916f42d4ba5b2f1f37c20457 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:48.152831 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860f389-cff7-4ce1-80bf-432c3a64c288 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:48.157939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:48.166152 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:48.227473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7449623-82dd-4bab-95a4-8e5896c40c92 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:48.265307 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f860f389-cff7-4ce1-80bf-432c3a64c288 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:48.274715 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b36665f-eba6-457f-ae2a-ec76619010a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:48.276210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36665f-eba6-457f-ae2a-ec76619010a9 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:48.276632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36665f-eba6-457f-ae2a-ec76619010a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:48.277364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b36665f-eba6-457f-ae2a-ec76619010a9 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:48.278436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36665f-eba6-457f-ae2a-ec76619010a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:48.280219 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b36665f-eba6-457f-ae2a-ec76619010a9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:48.302255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d67574-9676-4fb2-ad44-aef10d7d8c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:48.302746 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d67574-9676-4fb2-ad44-aef10d7d8c56 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:48.303058 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d67574-9676-4fb2-ad44-aef10d7d8c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:48.303333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d67574-9676-4fb2-ad44-aef10d7d8c56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:48.307911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 104/219] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:23:48 2022] POST /identity/v3/users => generated 297 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:23:48.309333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecd0e1-b14f-435d-a10f-e0f8220a47af None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:48.309755 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecd0e1-b14f-435d-a10f-e0f8220a47af None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:48.310688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecd0e1-b14f-435d-a10f-e0f8220a47af None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:48.312371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 105/220] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:48.317915 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd74d0e-27ad-45ce-b8d3-c2f88140960b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:48.318392 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd74d0e-27ad-45ce-b8d3-c2f88140960b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:48.318824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd74d0e-27ad-45ce-b8d3-c2f88140960b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:48.342842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1cd74d0e-27ad-45ce-b8d3-c2f88140960b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:48.344311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1cd74d0e-27ad-45ce-b8d3-c2f88140960b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:48.402607 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d67574-9676-4fb2-ad44-aef10d7d8c56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:48.404648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d67574-9676-4fb2-ad44-aef10d7d8c56 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:48.407026 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:48.432785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 106/221] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:23:48.432785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd74d0e-27ad-45ce-b8d3-c2f88140960b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:48.491933 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:48.547281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 116/222] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 06:23:48.553494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d67574-9676-4fb2-ad44-aef10d7d8c56 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:48.562545 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd74d0e-27ad-45ce-b8d3-c2f88140960b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:48.601845 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530c268-0c54-4390-a89c-d9751e800343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:48.602418 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530c268-0c54-4390-a89c-d9751e800343 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:48.602808 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530c268-0c54-4390-a89c-d9751e800343 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:48.603090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b530c268-0c54-4390-a89c-d9751e800343 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:48.616639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b530c268-0c54-4390-a89c-d9751e800343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b530c268-0c54-4390-a89c-d9751e800343 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:48.622322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:48.630606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:48.631619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:48.631619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:48.631619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:48.631619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:48.631619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:48.631619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:48.631619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:48.631619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:48.631619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:48.631619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:48.631619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:48.631619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:48.631619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 107/223] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:23:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:48.634270 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530c268-0c54-4390-a89c-d9751e800343 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:48.686214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d67574-9676-4fb2-ad44-aef10d7d8c56 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:48.687954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:48.731832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c862a15-adce-4d7a-8feb-3ec403f7b6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:48.733068 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c862a15-adce-4d7a-8feb-3ec403f7b6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:48.733347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c862a15-adce-4d7a-8feb-3ec403f7b6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:48.733618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c862a15-adce-4d7a-8feb-3ec403f7b6e5 None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:48.734756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c862a15-adce-4d7a-8feb-3ec403f7b6e5 None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:48.736338 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c862a15-adce-4d7a-8feb-3ec403f7b6e5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:48.738118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 117/224] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:48 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:48.739935 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c862a15-adce-4d7a-8feb-3ec403f7b6e5 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:48.779607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b530c268-0c54-4390-a89c-d9751e800343 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:48.787417 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:48.832951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdff987-aca3-4add-b8e9-41a9a99bc073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:48.834044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdff987-aca3-4add-b8e9-41a9a99bc073 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:48.834329 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdff987-aca3-4add-b8e9-41a9a99bc073 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:48.834876 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdff987-aca3-4add-b8e9-41a9a99bc073 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:48.835558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdff987-aca3-4add-b8e9-41a9a99bc073 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:48.836118 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdff987-aca3-4add-b8e9-41a9a99bc073 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:48.837903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdff987-aca3-4add-b8e9-41a9a99bc073 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:48.850724 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 108/225] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:48.851512 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdff987-aca3-4add-b8e9-41a9a99bc073 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:48.858413 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c862a15-adce-4d7a-8feb-3ec403f7b6e5 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:48.896500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554c7d2-e30d-4149-aa0e-2c953a780da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:48.897218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554c7d2-e30d-4149-aa0e-2c953a780da5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:48.897497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554c7d2-e30d-4149-aa0e-2c953a780da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:48.897770 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0554c7d2-e30d-4149-aa0e-2c953a780da5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:48.909299 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0554c7d2-e30d-4149-aa0e-2c953a780da5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-0554c7d2-e30d-4149-aa0e-2c953a780da5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:48.914758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:48.915647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:48.916441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:48.916441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:48.916441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:48.916441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:48.916441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:48.916441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:48.916441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:48.916441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:48.916441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:48.916441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:48.916441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:23:48.916441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:48.916441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 118/226] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:23:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:48.917807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554c7d2-e30d-4149-aa0e-2c953a780da5 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:48.954368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:48.975490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdff987-aca3-4add-b8e9-41a9a99bc073 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:49.020213 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760b775-0bcb-44dd-b832-55b7268892a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:49.021104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760b775-0bcb-44dd-b832-55b7268892a3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:49.021821 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760b775-0bcb-44dd-b832-55b7268892a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:49.022245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6760b775-0bcb-44dd-b832-55b7268892a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:49.023888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760b775-0bcb-44dd-b832-55b7268892a3 None admin] RBAC: Adding query filter params (role.id=1147187a70be4f46abe9a5f8d33d98fa, scope.project.id=081387ea09d34bfb94fa762df1c2cd1d, user.id=73ee864e916f42d4ba5b2f1f37c20457) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:49.024357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760b775-0bcb-44dd-b832-55b7268892a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:49.026605 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6760b775-0bcb-44dd-b832-55b7268892a3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:49.034929 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 109/227] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:48 2022] GET /identity/v3/role_assignments?user.id=73ee864e916f42d4ba5b2f1f37c20457&scope.project.id=081387ea09d34bfb94fa762df1c2cd1d&role.id=1147187a70be4f46abe9a5f8d33d98fa => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:49.036257 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760b775-0bcb-44dd-b832-55b7268892a3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:49.043366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0554c7d2-e30d-4149-aa0e-2c953a780da5 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:49.083132 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:49.083657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b120f-f11a-4cf4-97ed-3a8f0e1f0dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:49.084377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b120f-f11a-4cf4-97ed-3a8f0e1f0dde None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:49.084952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b120f-f11a-4cf4-97ed-3a8f0e1f0dde None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:49.085298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b120f-f11a-4cf4-97ed-3a8f0e1f0dde None admin] PATH_INFO: `/v3/users/2ba6b1a9b34a466996daec1cab56c6d6` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:49.086533 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b120f-f11a-4cf4-97ed-3a8f0e1f0dde None admin] RBAC: Authorizing `identity:get_user(user_id=2ba6b1a9b34a466996daec1cab56c6d6)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:49.088176 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b120f-f11a-4cf4-97ed-3a8f0e1f0dde None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:49.095220 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 119/228] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:48 2022] GET /identity/v3/users/2ba6b1a9b34a466996daec1cab56c6d6 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:49.096592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b120f-f11a-4cf4-97ed-3a8f0e1f0dde None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:49.171484 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6760b775-0bcb-44dd-b832-55b7268892a3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:49.213486 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be35a23-cb59-4225-8e00-4fb4cfdaedee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:49.214128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be35a23-cb59-4225-8e00-4fb4cfdaedee None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:49.214413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be35a23-cb59-4225-8e00-4fb4cfdaedee None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:49.214690 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be35a23-cb59-4225-8e00-4fb4cfdaedee None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:49.215387 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be35a23-cb59-4225-8e00-4fb4cfdaedee None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:49.215700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be35a23-cb59-4225-8e00-4fb4cfdaedee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:49.217709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be35a23-cb59-4225-8e00-4fb4cfdaedee None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:49.228840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 110/229] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:23:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:49.234129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be35a23-cb59-4225-8e00-4fb4cfdaedee None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:49.328844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:49.336943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b120f-f11a-4cf4-97ed-3a8f0e1f0dde None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:49.361699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:49.371508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be35a23-cb59-4225-8e00-4fb4cfdaedee None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:49.379976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae383f-022a-422a-80b3-3f2de0d4f1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:49.380689 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae383f-022a-422a-80b3-3f2de0d4f1d3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:49.380996 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae383f-022a-422a-80b3-3f2de0d4f1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:49.381353 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae383f-022a-422a-80b3-3f2de0d4f1d3 None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:49.383495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae383f-022a-422a-80b3-3f2de0d4f1d3 None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:49.384967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ae383f-022a-422a-80b3-3f2de0d4f1d3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:49.391709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 120/230] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:49 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:49.393040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae383f-022a-422a-80b3-3f2de0d4f1d3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:49.412354 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9af32-e032-4baa-90f7-d321e34f138f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:49.413305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9af32-e032-4baa-90f7-d321e34f138f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:49.413594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9af32-e032-4baa-90f7-d321e34f138f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:49.413876 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9af32-e032-4baa-90f7-d321e34f138f None admin] PATH_INFO: `/v3/users/2ba6b1a9b34a466996daec1cab56c6d6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:49.415693 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9af32-e032-4baa-90f7-d321e34f138f None admin] RBAC: Authorizing `identity:get_user(user_id=2ba6b1a9b34a466996daec1cab56c6d6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:49.417194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9af32-e032-4baa-90f7-d321e34f138f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:49.420181 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 111/231] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:49 2022] GET /identity/v3/users/2ba6b1a9b34a466996daec1cab56c6d6 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:49.425333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9af32-e032-4baa-90f7-d321e34f138f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:49.564154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9af32-e032-4baa-90f7-d321e34f138f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:49.597674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae383f-022a-422a-80b3-3f2de0d4f1d3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:49.638779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e3d99-69c2-4a0a-9612-2b45ec2f3946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:49.639434 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e3d99-69c2-4a0a-9612-2b45ec2f3946 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:49.639711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e3d99-69c2-4a0a-9612-2b45ec2f3946 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:49.642325 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e3d99-69c2-4a0a-9612-2b45ec2f3946 None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d/users/2ba6b1a9b34a466996daec1cab56c6d6/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:49.645342 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e3d99-69c2-4a0a-9612-2b45ec2f3946 None admin] RBAC: Authorizing `identity:create_grant(project_id=081387ea09d34bfb94fa762df1c2cd1d, user_id=2ba6b1a9b34a466996daec1cab56c6d6, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:49.646789 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107e3d99-69c2-4a0a-9612-2b45ec2f3946 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:49.649376 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c1073-20b0-4a30-98d2-67d0377643eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:49.650093 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c1073-20b0-4a30-98d2-67d0377643eb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:49.650380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c1073-20b0-4a30-98d2-67d0377643eb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:49.650764 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10c1073-20b0-4a30-98d2-67d0377643eb None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:49.652069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c1073-20b0-4a30-98d2-67d0377643eb None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:49.654491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10c1073-20b0-4a30-98d2-67d0377643eb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:49.656356 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 112/232] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:49 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:49.664162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c1073-20b0-4a30-98d2-67d0377643eb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:49.666818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 121/233] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:23:49 2022] PUT /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d/users/2ba6b1a9b34a466996daec1cab56c6d6/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:23:49.719950 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:49.804546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10c1073-20b0-4a30-98d2-67d0377643eb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:49.842203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae9d48e-d19b-48b8-8d66-0e240df7014c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:49.843116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9d48e-d19b-48b8-8d66-0e240df7014c None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:49.843536 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9d48e-d19b-48b8-8d66-0e240df7014c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:49.843947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9d48e-d19b-48b8-8d66-0e240df7014c None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d/users/2ba6b1a9b34a466996daec1cab56c6d6/roles/8727ddb8ab8e4ae4bf2145352def3fb6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:49.846380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9d48e-d19b-48b8-8d66-0e240df7014c None admin] RBAC: Authorizing `identity:create_grant(project_id=081387ea09d34bfb94fa762df1c2cd1d, user_id=2ba6b1a9b34a466996daec1cab56c6d6, role_id=8727ddb8ab8e4ae4bf2145352def3fb6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:49.847966 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae9d48e-d19b-48b8-8d66-0e240df7014c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:49.865396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 113/234] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:23:49 2022] PUT /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d/users/2ba6b1a9b34a466996daec1cab56c6d6/roles/8727ddb8ab8e4ae4bf2145352def3fb6 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:23:50.887919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112e2e2-e615-45f4-8d8f-ae58d01ba09c None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:50.888494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112e2e2-e615-45f4-8d8f-ae58d01ba09c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:50.888494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c112e2e2-e615-45f4-8d8f-ae58d01ba09c None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:50.890158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 122/235] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:50.895264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd0d78-8a24-4e52-aec9-d6e56d4a941d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:50.895716 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd0d78-8a24-4e52-aec9-d6e56d4a941d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:50.895809 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd0d78-8a24-4e52-aec9-d6e56d4a941d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:50.921875 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-68bd0d78-8a24-4e52-aec9-d6e56d4a941d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:50.923387 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-68bd0d78-8a24-4e52-aec9-d6e56d4a941d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:51.017385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 114/236] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:23:51.145375 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd538f-44f5-4084-bae4-5cfa7b8c713b None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:51.145578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd538f-44f5-4084-bae4-5cfa7b8c713b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:51.145834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd538f-44f5-4084-bae4-5cfa7b8c713b None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:51.147583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 123/237] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:51.158971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf1f67-7ef1-42a5-a0ef-afc4f864c051 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:51.159577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf1f67-7ef1-42a5-a0ef-afc4f864c051 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:51.160084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf1f67-7ef1-42a5-a0ef-afc4f864c051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:51.183848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7caf1f67-7ef1-42a5-a0ef-afc4f864c051 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:51.185615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7caf1f67-7ef1-42a5-a0ef-afc4f864c051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:51.205838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:51.273158 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 115/238] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:51.347024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd538f-44f5-4084-bae4-5cfa7b8c713b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:51.378910 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:51.468251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd538f-44f5-4084-bae4-5cfa7b8c713b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:51.503743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b438d5d-b47d-4ed4-ac13-b9193a7fe9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:51.504376 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b438d5d-b47d-4ed4-ac13-b9193a7fe9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:51.504654 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b438d5d-b47d-4ed4-ac13-b9193a7fe9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:51.504952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b438d5d-b47d-4ed4-ac13-b9193a7fe9c8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:51.519708 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b438d5d-b47d-4ed4-ac13-b9193a7fe9c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-4b438d5d-b47d-4ed4-ac13-b9193a7fe9c8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:51.524551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:51.525457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:51.526238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:51.526238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:51.526238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:51.526238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:51.526238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:51.526238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:51.526238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:51.526238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:51.526238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:51.526238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:51.526238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:23:51.526238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:51.528270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 124/239] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:51.533169 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf1f67-7ef1-42a5-a0ef-afc4f864c051 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:51.590954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b438d5d-b47d-4ed4-ac13-b9193a7fe9c8 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:51.698235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf1f67-7ef1-42a5-a0ef-afc4f864c051 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:51.741187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:51.758999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1999d-c19e-44bc-94c8-b19563dc7ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:51.760524 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1999d-c19e-44bc-94c8-b19563dc7ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:51.761050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1999d-c19e-44bc-94c8-b19563dc7ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:51.761667 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1999d-c19e-44bc-94c8-b19563dc7ed5 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:51.763550 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1999d-c19e-44bc-94c8-b19563dc7ed5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:51.764797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1999d-c19e-44bc-94c8-b19563dc7ed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:51.766380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1999d-c19e-44bc-94c8-b19563dc7ed5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:51.773579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b438d5d-b47d-4ed4-ac13-b9193a7fe9c8 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:51.782494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 116/240] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:51.793513 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1999d-c19e-44bc-94c8-b19563dc7ed5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:51.822386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:51.841920 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ec7697-58d0-4f9d-83cb-d314e4174631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:51.842814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec7697-58d0-4f9d-83cb-d314e4174631 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:51.843284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec7697-58d0-4f9d-83cb-d314e4174631 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:51.843936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ec7697-58d0-4f9d-83cb-d314e4174631 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:51.846135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec7697-58d0-4f9d-83cb-d314e4174631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:51.847786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ec7697-58d0-4f9d-83cb-d314e4174631 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:51.850085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 125/241] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:23:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:51.851856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df62d1-d7c0-4d85-a587-7babecd0e48a None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:51.852339 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df62d1-d7c0-4d85-a587-7babecd0e48a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:51.853318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df62d1-d7c0-4d85-a587-7babecd0e48a None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:51.855051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 126/242] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:51.856162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df62d1-d7c0-4d85-a587-7babecd0e48a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:51.924988 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1999d-c19e-44bc-94c8-b19563dc7ed5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:51.960860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270314b8-f734-4716-bc8f-de5885ef8fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:51.961824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270314b8-f734-4716-bc8f-de5885ef8fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:51.962342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270314b8-f734-4716-bc8f-de5885ef8fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:51.962857 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270314b8-f734-4716-bc8f-de5885ef8fc5 None admin] PATH_INFO: `/v3/users/7613029ab8884d94be47b4efd0880d18` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:51.967656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df62d1-d7c0-4d85-a587-7babecd0e48a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:51.978235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270314b8-f734-4716-bc8f-de5885ef8fc5 None admin] RBAC: Authorizing `identity:get_user(user_id=7613029ab8884d94be47b4efd0880d18)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:51.979832 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270314b8-f734-4716-bc8f-de5885ef8fc5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:51.981760 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 117/243] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:51 2022] GET /identity/v3/users/7613029ab8884d94be47b4efd0880d18 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:51.987873 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d284c-4df5-4f6b-9f51-8d812277a494 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:51.988255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d284c-4df5-4f6b-9f51-8d812277a494 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:51.988633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d284c-4df5-4f6b-9f51-8d812277a494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:52.007116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-784d284c-4df5-4f6b-9f51-8d812277a494 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:52.007627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12793b3-d0c2-41b2-bf07-4ba4d7a3b5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:52.008425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12793b3-d0c2-41b2-bf07-4ba4d7a3b5a9 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:52.008537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-784d284c-4df5-4f6b-9f51-8d812277a494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:52.009019 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12793b3-d0c2-41b2-bf07-4ba4d7a3b5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:52.009431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12793b3-d0c2-41b2-bf07-4ba4d7a3b5a9 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:52.010297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12793b3-d0c2-41b2-bf07-4ba4d7a3b5a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:52.011923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12793b3-d0c2-41b2-bf07-4ba4d7a3b5a9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:52.039553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 127/244] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:23:51 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:23:52.046535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12793b3-d0c2-41b2-bf07-4ba4d7a3b5a9 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:52.067005 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:52.086304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:52.093165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 118/245] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:52.224322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12793b3-d0c2-41b2-bf07-4ba4d7a3b5a9 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:52.281538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa174b-945b-4fe9-81c3-53bbf6a248c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:52.282139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa174b-945b-4fe9-81c3-53bbf6a248c2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:52.282420 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa174b-945b-4fe9-81c3-53bbf6a248c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:52.282757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafa174b-945b-4fe9-81c3-53bbf6a248c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:52.360895 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d284c-4df5-4f6b-9f51-8d812277a494 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:52.377136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa174b-945b-4fe9-81c3-53bbf6a248c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:52.378823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafa174b-945b-4fe9-81c3-53bbf6a248c2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:52.392393 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:52.494001 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d284c-4df5-4f6b-9f51-8d812277a494 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:52.506421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 128/246] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:23:52.514764 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa174b-945b-4fe9-81c3-53bbf6a248c2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:52.545561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f8054-77b3-4ff3-95bc-47206ad5db02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:52.546675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f8054-77b3-4ff3-95bc-47206ad5db02 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:52.547162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f8054-77b3-4ff3-95bc-47206ad5db02 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:52.547652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14f8054-77b3-4ff3-95bc-47206ad5db02 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:52.562584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14f8054-77b3-4ff3-95bc-47206ad5db02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d14f8054-77b3-4ff3-95bc-47206ad5db02 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:52.568231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:52.569455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:52.570439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:52.570439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:52.570439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:52.570439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:52.570439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:52.570439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:52.570439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:52.570439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:52.570439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:52.570439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:52.570439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:52.570439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:52.572840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 119/247] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:23:52.580042 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f8054-77b3-4ff3-95bc-47206ad5db02 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:52.640303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafa174b-945b-4fe9-81c3-53bbf6a248c2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:52.651653 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:52.656683 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:52.688521 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a382b5a8-1324-46f5-b239-5ec40d88e348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:52.688521 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382b5a8-1324-46f5-b239-5ec40d88e348 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:52.688906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382b5a8-1324-46f5-b239-5ec40d88e348 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:52.688906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382b5a8-1324-46f5-b239-5ec40d88e348 None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:52.690159 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382b5a8-1324-46f5-b239-5ec40d88e348 None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:52.691597 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a382b5a8-1324-46f5-b239-5ec40d88e348 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:52.694468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 129/248] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:52 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:52.694812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb11c-5cfb-445c-806d-87338a0918ac None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:52.695093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb11c-5cfb-445c-806d-87338a0918ac None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:52.695367 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eeb11c-5cfb-445c-806d-87338a0918ac None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:52.696830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 130/249] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:52.697874 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e249f45-fd4a-48bd-bccc-acdac250bd0e None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:52.698205 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e249f45-fd4a-48bd-bccc-acdac250bd0e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:52.698478 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e249f45-fd4a-48bd-bccc-acdac250bd0e None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:52.699664 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 131/250] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:52.703218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14f8054-77b3-4ff3-95bc-47206ad5db02 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:52.705293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e249f45-fd4a-48bd-bccc-acdac250bd0e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:52.746472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3feaa5-8901-422d-9681-a17492c766aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:52.747147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3feaa5-8901-422d-9681-a17492c766aa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:52.747424 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3feaa5-8901-422d-9681-a17492c766aa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:52.748258 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3feaa5-8901-422d-9681-a17492c766aa None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:52.748965 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3feaa5-8901-422d-9681-a17492c766aa None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:52.749264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3feaa5-8901-422d-9681-a17492c766aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:52.750635 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3feaa5-8901-422d-9681-a17492c766aa None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:52.761248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 120/251] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:52.762573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a4fd9-6cd3-49c4-8794-62468d19e898 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:52.762853 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a4fd9-6cd3-49c4-8794-62468d19e898 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:52.763152 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86a4fd9-6cd3-49c4-8794-62468d19e898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:52.782430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f86a4fd9-6cd3-49c4-8794-62468d19e898 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:52.783755 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f86a4fd9-6cd3-49c4-8794-62468d19e898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:52.830773 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e249f45-fd4a-48bd-bccc-acdac250bd0e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:52.867637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 121/252] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:52.869468 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ca1e4-9114-49f5-836e-52790e432f41 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:52.869753 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ca1e4-9114-49f5-836e-52790e432f41 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:52.870023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ca1e4-9114-49f5-836e-52790e432f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:52.872471 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4d414-ac1a-4755-9b1d-a9a78feadb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:52.873197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4d414-ac1a-4755-9b1d-a9a78feadb0e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:52.873529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4d414-ac1a-4755-9b1d-a9a78feadb0e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:52.873804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4d414-ac1a-4755-9b1d-a9a78feadb0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:52.874532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4d414-ac1a-4755-9b1d-a9a78feadb0e None admin] RBAC: Adding query filter params (role.id=2e9374cdc2f84d6eac42b2dfaf1008a3, scope.project.id=081387ea09d34bfb94fa762df1c2cd1d, user.id=7613029ab8884d94be47b4efd0880d18) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:52.874838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4d414-ac1a-4755-9b1d-a9a78feadb0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:52.876257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4d414-ac1a-4755-9b1d-a9a78feadb0e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:52.888904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 132/253] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:52 2022] GET /identity/v3/role_assignments?user.id=7613029ab8884d94be47b4efd0880d18&scope.project.id=081387ea09d34bfb94fa762df1c2cd1d&role.id=2e9374cdc2f84d6eac42b2dfaf1008a3 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:52.890932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4d414-ac1a-4755-9b1d-a9a78feadb0e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:52.911559 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c84ca1e4-9114-49f5-836e-52790e432f41 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:52.912832 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c84ca1e4-9114-49f5-836e-52790e432f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:52.986895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:53.000881 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:53.035916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 122/254] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:53.098513 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4d414-ac1a-4755-9b1d-a9a78feadb0e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:53.142934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7fed4-5792-4a27-8170-b969b85ac9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:53.143569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7fed4-5792-4a27-8170-b969b85ac9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:53.143847 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7fed4-5792-4a27-8170-b969b85ac9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:53.144120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7fed4-5792-4a27-8170-b969b85ac9a0 None admin] PATH_INFO: `/v3/users/73ee864e916f42d4ba5b2f1f37c20457` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:53.145478 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7fed4-5792-4a27-8170-b969b85ac9a0 None admin] RBAC: Authorizing `identity:get_user(user_id=73ee864e916f42d4ba5b2f1f37c20457)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:53.147172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7fed4-5792-4a27-8170-b969b85ac9a0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:53.148992 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 133/255] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:52 2022] GET /identity/v3/users/73ee864e916f42d4ba5b2f1f37c20457 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:53.157803 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ca1e4-9114-49f5-836e-52790e432f41 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:53.282733 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ca1e4-9114-49f5-836e-52790e432f41 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:53.320282 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb11ed-ca63-4f6d-be3b-2ab0f80b7ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:53.320956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb11ed-ca63-4f6d-be3b-2ab0f80b7ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:53.321232 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb11ed-ca63-4f6d-be3b-2ab0f80b7ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:53.321503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb11ed-ca63-4f6d-be3b-2ab0f80b7ac6 None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:53.322638 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb11ed-ca63-4f6d-be3b-2ab0f80b7ac6 None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:53.324074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb11ed-ca63-4f6d-be3b-2ab0f80b7ac6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:53.325937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 123/256] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:53 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:53.331493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7fed4-5792-4a27-8170-b969b85ac9a0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:53.444748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb11ed-ca63-4f6d-be3b-2ab0f80b7ac6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:53.454901 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7fed4-5792-4a27-8170-b969b85ac9a0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:53.473038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:53.499336 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:53.502097 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891714a7-27a9-442e-bea4-5b9664dfb9fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:53.502833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891714a7-27a9-442e-bea4-5b9664dfb9fd None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:53.503109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891714a7-27a9-442e-bea4-5b9664dfb9fd None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:53.504554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891714a7-27a9-442e-bea4-5b9664dfb9fd None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d/users/73ee864e916f42d4ba5b2f1f37c20457/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:53.507325 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891714a7-27a9-442e-bea4-5b9664dfb9fd None admin] RBAC: Authorizing `identity:create_grant(project_id=081387ea09d34bfb94fa762df1c2cd1d, user_id=73ee864e916f42d4ba5b2f1f37c20457, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:53.509454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891714a7-27a9-442e-bea4-5b9664dfb9fd None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:53.527456 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 134/257] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:23:53 2022] PUT /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d/users/73ee864e916f42d4ba5b2f1f37c20457/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:23:53.533473 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891714a7-27a9-442e-bea4-5b9664dfb9fd None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:53.587129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb11ed-ca63-4f6d-be3b-2ab0f80b7ac6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:53.661412 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64072f59-c0eb-4f8e-81ff-b415ee1e5728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:53.662075 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64072f59-c0eb-4f8e-81ff-b415ee1e5728 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:53.662357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64072f59-c0eb-4f8e-81ff-b415ee1e5728 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:53.662632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64072f59-c0eb-4f8e-81ff-b415ee1e5728 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:53.692076 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64072f59-c0eb-4f8e-81ff-b415ee1e5728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-64072f59-c0eb-4f8e-81ff-b415ee1e5728 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:53.698682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:53.699614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:53.700420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:53.700420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:53.700420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:53.700420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:53.700420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:53.700420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:53.700420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:53.700420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:53.700420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:53.700420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:53.700420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:23:53.700420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:53.701696 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 124/258] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:23:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:53.712317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64072f59-c0eb-4f8e-81ff-b415ee1e5728 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:53.744390 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891714a7-27a9-442e-bea4-5b9664dfb9fd None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:53.826401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b946f-c23d-4f98-8be7-4b2b231a0527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:53.827049 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b946f-c23d-4f98-8be7-4b2b231a0527 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:53.827326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b946f-c23d-4f98-8be7-4b2b231a0527 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:53.827600 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5b946f-c23d-4f98-8be7-4b2b231a0527 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:53.860389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5b946f-c23d-4f98-8be7-4b2b231a0527 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-ea5b946f-c23d-4f98-8be7-4b2b231a0527 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:53.869818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:53.871957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:53.873985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:53.873985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:53.873985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:53.873985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:53.873985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:53.873985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:53.873985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:53.873985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:53.873985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:53.873985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:53.873985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:23:53.873985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:53.873985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 135/259] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:23:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:53.884039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b946f-c23d-4f98-8be7-4b2b231a0527 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:53.940261 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:53.965656 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64072f59-c0eb-4f8e-81ff-b415ee1e5728 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:53.985137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:54.034561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23bec8-4bda-447c-ba98-48711ace253b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:54.035194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23bec8-4bda-447c-ba98-48711ace253b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:54.035702 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23bec8-4bda-447c-ba98-48711ace253b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:54.035977 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23bec8-4bda-447c-ba98-48711ace253b None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:54.036700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23bec8-4bda-447c-ba98-48711ace253b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:54.036999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23bec8-4bda-447c-ba98-48711ace253b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:54.038412 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23bec8-4bda-447c-ba98-48711ace253b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:54.058453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 125/260] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:23:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:54.068917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23bec8-4bda-447c-ba98-48711ace253b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:54.114665 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5b946f-c23d-4f98-8be7-4b2b231a0527 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:54.213370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3317df0-efe5-49e0-9e7d-1ef652394f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:54.214374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3317df0-efe5-49e0-9e7d-1ef652394f83 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:54.214871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3317df0-efe5-49e0-9e7d-1ef652394f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:54.215338 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3317df0-efe5-49e0-9e7d-1ef652394f83 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:54.216289 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3317df0-efe5-49e0-9e7d-1ef652394f83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:54.216832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3317df0-efe5-49e0-9e7d-1ef652394f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:54.218396 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3317df0-efe5-49e0-9e7d-1ef652394f83 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:54.232033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 136/261] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:54.237408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3317df0-efe5-49e0-9e7d-1ef652394f83 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:54.249490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23bec8-4bda-447c-ba98-48711ace253b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:54.337962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1ccc9-116c-40f9-b754-ecc772ad8cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:54.338615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1ccc9-116c-40f9-b754-ecc772ad8cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:54.338899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1ccc9-116c-40f9-b754-ecc772ad8cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:54.339178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1ccc9-116c-40f9-b754-ecc772ad8cf5 None admin] PATH_INFO: `/v3/users/2ba6b1a9b34a466996daec1cab56c6d6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:54.345384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1ccc9-116c-40f9-b754-ecc772ad8cf5 None admin] RBAC: Authorizing `identity:get_user(user_id=2ba6b1a9b34a466996daec1cab56c6d6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:54.346877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1ccc9-116c-40f9-b754-ecc772ad8cf5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:54.348712 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 126/262] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:54 2022] GET /identity/v3/users/2ba6b1a9b34a466996daec1cab56c6d6 => generated 283 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:54.357720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1ccc9-116c-40f9-b754-ecc772ad8cf5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:54.461760 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:54.479031 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3317df0-efe5-49e0-9e7d-1ef652394f83 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:54.481019 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:54.546167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e967509-8671-4ec8-b4cf-42a4c61b886b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:54.547286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e967509-8671-4ec8-b4cf-42a4c61b886b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:54.547758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e967509-8671-4ec8-b4cf-42a4c61b886b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:54.548222 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e967509-8671-4ec8-b4cf-42a4c61b886b None admin] PATH_INFO: `/v3/users/2ba6b1a9b34a466996daec1cab56c6d6` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:54.553371 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e967509-8671-4ec8-b4cf-42a4c61b886b None admin] RBAC: Authorizing `identity:get_user(user_id=2ba6b1a9b34a466996daec1cab56c6d6)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:54.555057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e967509-8671-4ec8-b4cf-42a4c61b886b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:54.557244 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 137/263] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:54 2022] GET /identity/v3/users/2ba6b1a9b34a466996daec1cab56c6d6 => generated 283 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:54.568397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e967509-8671-4ec8-b4cf-42a4c61b886b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:54.590401 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1ccc9-116c-40f9-b754-ecc772ad8cf5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:54.658326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297870e8-87fe-434a-91ba-0685b8e6d674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:54.658946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297870e8-87fe-434a-91ba-0685b8e6d674 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:54.659230 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297870e8-87fe-434a-91ba-0685b8e6d674 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:54.659502 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297870e8-87fe-434a-91ba-0685b8e6d674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:54.758043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e967509-8671-4ec8-b4cf-42a4c61b886b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:54.819201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b5c779-28c5-4fa3-98a0-28c1234b1854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:54.820057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5c779-28c5-4fa3-98a0-28c1234b1854 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:54.820478 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5c779-28c5-4fa3-98a0-28c1234b1854 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:54.820911 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b5c779-28c5-4fa3-98a0-28c1234b1854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:54.825520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297870e8-87fe-434a-91ba-0685b8e6d674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:54.827815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297870e8-87fe-434a-91ba-0685b8e6d674 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:54.869421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:54.925055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:54.941798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5c779-28c5-4fa3-98a0-28c1234b1854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:54.946236 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b5c779-28c5-4fa3-98a0-28c1234b1854 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:55.074310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 127/264] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:23:55.085727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297870e8-87fe-434a-91ba-0685b8e6d674 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:55.126401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 138/265] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 06:23:55.127673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba0177-bd1b-4ee9-9f7a-d9407eaf6c8f None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:55.127958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba0177-bd1b-4ee9-9f7a-d9407eaf6c8f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:55.128257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba0177-bd1b-4ee9-9f7a-d9407eaf6c8f None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:55.138001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 139/266] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:55 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:55.138812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba0177-bd1b-4ee9-9f7a-d9407eaf6c8f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:55.208692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297870e8-87fe-434a-91ba-0685b8e6d674 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:55.244537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f1faf-efb8-4b28-a50c-6687b8978207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:55.245202 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f1faf-efb8-4b28-a50c-6687b8978207 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:55.245486 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f1faf-efb8-4b28-a50c-6687b8978207 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:55.245762 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f1faf-efb8-4b28-a50c-6687b8978207 None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:55.247025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f1faf-efb8-4b28-a50c-6687b8978207 None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:55.249226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f1faf-efb8-4b28-a50c-6687b8978207 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:55.255751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 128/267] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:55 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:55.257095 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862f673-fc2b-4cb4-ba78-88e0bbde1ba1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:55.257376 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862f673-fc2b-4cb4-ba78-88e0bbde1ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:55.257649 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3862f673-fc2b-4cb4-ba78-88e0bbde1ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:55.276001 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3862f673-fc2b-4cb4-ba78-88e0bbde1ba1 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:55.277235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3862f673-fc2b-4cb4-ba78-88e0bbde1ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:55.281001 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:55.301086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:55.388644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba0177-bd1b-4ee9-9f7a-d9407eaf6c8f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:55.398739 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 129/268] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:55.399691 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862f673-fc2b-4cb4-ba78-88e0bbde1ba1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:55.455090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe8f4c-1ca5-423c-aaee-7ceb3a32d052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:55.455721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe8f4c-1ca5-423c-aaee-7ceb3a32d052 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:55.456001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe8f4c-1ca5-423c-aaee-7ceb3a32d052 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:55.456271 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fe8f4c-1ca5-423c-aaee-7ceb3a32d052 None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:55.460469 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe8f4c-1ca5-423c-aaee-7ceb3a32d052 None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:55.461958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fe8f4c-1ca5-423c-aaee-7ceb3a32d052 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:55.463641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 140/269] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:55 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:55.473692 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe8f4c-1ca5-423c-aaee-7ceb3a32d052 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:55.569612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3862f673-fc2b-4cb4-ba78-88e0bbde1ba1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:55.613049 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdd61a-5cc6-4a2d-80d5-3900864ea2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:55.613657 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdd61a-5cc6-4a2d-80d5-3900864ea2fa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:55.613933 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdd61a-5cc6-4a2d-80d5-3900864ea2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:55.614210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdd61a-5cc6-4a2d-80d5-3900864ea2fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:55.614931 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdd61a-5cc6-4a2d-80d5-3900864ea2fa None admin] RBAC: Adding query filter params (role.id=8727ddb8ab8e4ae4bf2145352def3fb6, scope.project.id=081387ea09d34bfb94fa762df1c2cd1d, user.id=2ba6b1a9b34a466996daec1cab56c6d6) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:55.615234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdd61a-5cc6-4a2d-80d5-3900864ea2fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:55.616656 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdd61a-5cc6-4a2d-80d5-3900864ea2fa None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:55.632899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 130/270] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:55 2022] GET /identity/v3/role_assignments?user.id=2ba6b1a9b34a466996daec1cab56c6d6&scope.project.id=081387ea09d34bfb94fa762df1c2cd1d&role.id=8727ddb8ab8e4ae4bf2145352def3fb6 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:55.674452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fe8f4c-1ca5-423c-aaee-7ceb3a32d052 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:55.713140 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:55.725363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1168487-757a-4286-b8a0-e8fc0fef7d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:55.725995 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1168487-757a-4286-b8a0-e8fc0fef7d9a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:55.729066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1168487-757a-4286-b8a0-e8fc0fef7d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:55.729345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1168487-757a-4286-b8a0-e8fc0fef7d9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:55.730127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1168487-757a-4286-b8a0-e8fc0fef7d9a None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=081387ea09d34bfb94fa762df1c2cd1d, user.id=2ba6b1a9b34a466996daec1cab56c6d6) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:55.730437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1168487-757a-4286-b8a0-e8fc0fef7d9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:55.731934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1168487-757a-4286-b8a0-e8fc0fef7d9a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:55.739665 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 141/271] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:55 2022] GET /identity/v3/role_assignments?user.id=2ba6b1a9b34a466996daec1cab56c6d6&scope.project.id=081387ea09d34bfb94fa762df1c2cd1d&role.id=6382a06103714d068409d25cbeb48744 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:55.770539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b30c00-2a2d-4ac5-a568-d85d9687ebff None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:55.770851 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b30c00-2a2d-4ac5-a568-d85d9687ebff None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:55.771076 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b30c00-2a2d-4ac5-a568-d85d9687ebff None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:55.772571 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 131/272] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:55.778358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfbc0b-357d-4c0d-92e5-7f6dbc158b89 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:55.778664 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfbc0b-357d-4c0d-92e5-7f6dbc158b89 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:55.779480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfbc0b-357d-4c0d-92e5-7f6dbc158b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:55.801958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-87cfbc0b-357d-4c0d-92e5-7f6dbc158b89 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:55.803230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-87cfbc0b-357d-4c0d-92e5-7f6dbc158b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:55.898114 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 142/273] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:55.912443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b30c00-2a2d-4ac5-a568-d85d9687ebff None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:55.915668 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:56.064236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b30c00-2a2d-4ac5-a568-d85d9687ebff None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:56.101731 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef1598-24bc-4c07-ba42-200e74672d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:56.102473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef1598-24bc-4c07-ba42-200e74672d9e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:56.102627 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef1598-24bc-4c07-ba42-200e74672d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:56.102898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef1598-24bc-4c07-ba42-200e74672d9e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:56.114810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef1598-24bc-4c07-ba42-200e74672d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-03ef1598-24bc-4c07-ba42-200e74672d9e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:56.120165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:56.122332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:56.124878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:56.124878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:56.124878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:56.124878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:56.124878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:56.124878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:56.124878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:56.124878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:56.124878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:56.124878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:56.124878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:56.124878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:56.126352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 132/274] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:56.129961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfbc0b-357d-4c0d-92e5-7f6dbc158b89 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:56.259274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfbc0b-357d-4c0d-92e5-7f6dbc158b89 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:56.284865 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:56.301096 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41022a-c3e9-49d2-9588-e55898ab1c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:56.301717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41022a-c3e9-49d2-9588-e55898ab1c56 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:56.301999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41022a-c3e9-49d2-9588-e55898ab1c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:56.302271 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41022a-c3e9-49d2-9588-e55898ab1c56 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:56.303131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41022a-c3e9-49d2-9588-e55898ab1c56 None admin] RBAC: Adding query filter params (name=member) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:56.303436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41022a-c3e9-49d2-9588-e55898ab1c56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:56.304971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41022a-c3e9-49d2-9588-e55898ab1c56 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:56.314524 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef1598-24bc-4c07-ba42-200e74672d9e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:56.316579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 143/275] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:56.317862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876fe08-713f-4383-ba5a-f7a43b9ab44b None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:56.318147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876fe08-713f-4383-ba5a-f7a43b9ab44b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:56.318415 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4876fe08-713f-4383-ba5a-f7a43b9ab44b None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:56.319753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 144/276] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:56.322233 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876fe08-713f-4383-ba5a-f7a43b9ab44b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:56.395501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:56.434690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4876fe08-713f-4383-ba5a-f7a43b9ab44b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:56.438498 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef1598-24bc-4c07-ba42-200e74672d9e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:56.471706 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5cf20-7bee-4e34-9857-8ced557ac2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:56.472361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5cf20-7bee-4e34-9857-8ced557ac2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:56.472636 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5cf20-7bee-4e34-9857-8ced557ac2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:56.472935 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db5cf20-7bee-4e34-9857-8ced557ac2e6 None admin] PATH_INFO: `/v3/users/40485ffb9956458bab891a01f1b0886f` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:56.480917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d059bae2-86a1-41f2-92d7-3d6a250a4f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:56.482861 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059bae2-86a1-41f2-92d7-3d6a250a4f34 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:56.483138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059bae2-86a1-41f2-92d7-3d6a250a4f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:56.483408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d059bae2-86a1-41f2-92d7-3d6a250a4f34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:56.484968 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059bae2-86a1-41f2-92d7-3d6a250a4f34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:56.486662 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d059bae2-86a1-41f2-92d7-3d6a250a4f34 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:56.492692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 133/277] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:23:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:56.492850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5cf20-7bee-4e34-9857-8ced557ac2e6 None admin] RBAC: Authorizing `identity:get_user(user_id=40485ffb9956458bab891a01f1b0886f)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:56.492952 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9d8fc-a1fe-40bc-b30f-1c8ce057e2ce None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:56.492952 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9d8fc-a1fe-40bc-b30f-1c8ce057e2ce None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:56.492952 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9d8fc-a1fe-40bc-b30f-1c8ce057e2ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:56.493143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db5cf20-7bee-4e34-9857-8ced557ac2e6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:56.493143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 145/278] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:56 2022] GET /identity/v3/users/40485ffb9956458bab891a01f1b0886f => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:56.494061 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5cf20-7bee-4e34-9857-8ced557ac2e6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:56.511007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-01c9d8fc-a1fe-40bc-b30f-1c8ce057e2ce None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:56.512112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-01c9d8fc-a1fe-40bc-b30f-1c8ce057e2ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:56.539988 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:56.582645 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 134/279] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:56.583557 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9d8fc-a1fe-40bc-b30f-1c8ce057e2ce None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:56.607110 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db5cf20-7bee-4e34-9857-8ced557ac2e6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:56.647616 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e287f1a4-6a7b-442e-826c-0950e786b194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:56.648073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:56.648266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287f1a4-6a7b-442e-826c-0950e786b194 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:56.648507 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287f1a4-6a7b-442e-826c-0950e786b194 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:56.648813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e287f1a4-6a7b-442e-826c-0950e786b194 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:56.649468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287f1a4-6a7b-442e-826c-0950e786b194 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:56.650887 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e287f1a4-6a7b-442e-826c-0950e786b194 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:56.672559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 146/280] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:23:56 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:23:56.673878 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de82bbd-4237-4ddf-83d3-63958745d474 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:56.674163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de82bbd-4237-4ddf-83d3-63958745d474 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:56.674721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de82bbd-4237-4ddf-83d3-63958745d474 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:56.675852 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 147/281] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:56.681840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e058e4-b073-4d0a-b09d-62cf4ad1d2d1 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:56.682136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e058e4-b073-4d0a-b09d-62cf4ad1d2d1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:56.682410 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e058e4-b073-4d0a-b09d-62cf4ad1d2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:56.705769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a1e058e4-b073-4d0a-b09d-62cf4ad1d2d1 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:56.707102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a1e058e4-b073-4d0a-b09d-62cf4ad1d2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:56.708395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9d8fc-a1fe-40bc-b30f-1c8ce057e2ce None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:56.755147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fb39b-e5c4-49c0-8f86-e621bde11cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:56.755873 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fb39b-e5c4-49c0-8f86-e621bde11cdb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:56.756218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fb39b-e5c4-49c0-8f86-e621bde11cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:56.756690 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688fb39b-e5c4-49c0-8f86-e621bde11cdb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:56.757606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fb39b-e5c4-49c0-8f86-e621bde11cdb None admin] RBAC: Adding query filter params (role.id=1147187a70be4f46abe9a5f8d33d98fa, user.id=40485ffb9956458bab891a01f1b0886f, scope.system=all) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:56.758074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fb39b-e5c4-49c0-8f86-e621bde11cdb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:56.759754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688fb39b-e5c4-49c0-8f86-e621bde11cdb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:56.772830 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 135/282] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Sep 13 06:23:56 2022] GET /identity/v3/role_assignments?user.id=40485ffb9956458bab891a01f1b0886f&scope.system=all&role.id=1147187a70be4f46abe9a5f8d33d98fa => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:56.812143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 148/283] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:56.857428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fb39b-e5c4-49c0-8f86-e621bde11cdb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:56.969473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688fb39b-e5c4-49c0-8f86-e621bde11cdb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:56.996572 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:57.011287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1a42d-4b0d-4bf7-a2e6-f94181c58a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:57.011943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1a42d-4b0d-4bf7-a2e6-f94181c58a56 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:57.012218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1a42d-4b0d-4bf7-a2e6-f94181c58a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:57.012488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1a42d-4b0d-4bf7-a2e6-f94181c58a56 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:57.023817 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1a42d-4b0d-4bf7-a2e6-f94181c58a56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-bfb1a42d-4b0d-4bf7-a2e6-f94181c58a56 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:57.028558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:57.030157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:57.031206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:57.031206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:57.031206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:57.031206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:57.031206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:57.031206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:57.031206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:57.031206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:57.031206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:57.031206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:57.031206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:23:57.031206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:57.031206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 136/284] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:57.037226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e058e4-b073-4d0a-b09d-62cf4ad1d2d1 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:57.069089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:57.091948 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1a42d-4b0d-4bf7-a2e6-f94181c58a56 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:57.165454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e058e4-b073-4d0a-b09d-62cf4ad1d2d1 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:57.212705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a5d02-93d5-4f33-972e-9a3e171a7a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:57.213312 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a5d02-93d5-4f33-972e-9a3e171a7a5d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:57.213590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a5d02-93d5-4f33-972e-9a3e171a7a5d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:57.213860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717a5d02-93d5-4f33-972e-9a3e171a7a5d None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:57.214051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1a42d-4b0d-4bf7-a2e6-f94181c58a56 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:57.214544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a5d02-93d5-4f33-972e-9a3e171a7a5d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:57.214822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a5d02-93d5-4f33-972e-9a3e171a7a5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:57.216374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717a5d02-93d5-4f33-972e-9a3e171a7a5d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:57.227393 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 149/285] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:57.233667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a5d02-93d5-4f33-972e-9a3e171a7a5d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:57.258609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae860a41-5578-4a38-ba94-80905e46ad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:57.259249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae860a41-5578-4a38-ba94-80905e46ad8a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:57.259528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae860a41-5578-4a38-ba94-80905e46ad8a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:57.259798 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae860a41-5578-4a38-ba94-80905e46ad8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:57.272050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae860a41-5578-4a38-ba94-80905e46ad8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ae860a41-5578-4a38-ba94-80905e46ad8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:57.276973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:57.278065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:57.279107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:57.279107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:57.279107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:57.279107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:57.279107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:57.279107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:57.279107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:57.279107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:57.279107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:57.279107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:57.279107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:57.279107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:23:57.279107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 137/286] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:23:57.283993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae860a41-5578-4a38-ba94-80905e46ad8a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:57.365020 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:57.387558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:57.406280 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717a5d02-93d5-4f33-972e-9a3e171a7a5d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:57.456630 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50200482-11ab-4a02-9c25-c437810676ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:57.457355 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50200482-11ab-4a02-9c25-c437810676ec None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:57.457632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50200482-11ab-4a02-9c25-c437810676ec None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:57.457901 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50200482-11ab-4a02-9c25-c437810676ec None admin] PATH_INFO: `/v3/users/7613029ab8884d94be47b4efd0880d18` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:57.459528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50200482-11ab-4a02-9c25-c437810676ec None admin] RBAC: Authorizing `identity:get_user(user_id=7613029ab8884d94be47b4efd0880d18)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:57.461303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50200482-11ab-4a02-9c25-c437810676ec None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:57.463217 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 150/287] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:57 2022] GET /identity/v3/users/7613029ab8884d94be47b4efd0880d18 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:57.469640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50200482-11ab-4a02-9c25-c437810676ec None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:57.480255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae860a41-5578-4a38-ba94-80905e46ad8a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:57.554329 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81375f83-f1e5-4870-b48f-498ac457fb0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:57.559611 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375f83-f1e5-4870-b48f-498ac457fb0e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:57.559898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375f83-f1e5-4870-b48f-498ac457fb0e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:57.560742 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81375f83-f1e5-4870-b48f-498ac457fb0e None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:57.561426 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81375f83-f1e5-4870-b48f-498ac457fb0e None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:57.561727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81375f83-f1e5-4870-b48f-498ac457fb0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:57.563115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81375f83-f1e5-4870-b48f-498ac457fb0e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:57.578462 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 138/288] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:57.585855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81375f83-f1e5-4870-b48f-498ac457fb0e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:57.612138 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50200482-11ab-4a02-9c25-c437810676ec None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:57.687339 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d68a3c-f601-44f8-949a-daa91525df9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:57.687980 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d68a3c-f601-44f8-949a-daa91525df9a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:57.688258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d68a3c-f601-44f8-949a-daa91525df9a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:57.688526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d68a3c-f601-44f8-949a-daa91525df9a None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:57.689716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d68a3c-f601-44f8-949a-daa91525df9a None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:57.691201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d68a3c-f601-44f8-949a-daa91525df9a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:57.693175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 151/289] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:57 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:57.701563 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d68a3c-f601-44f8-949a-daa91525df9a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:57.736898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81375f83-f1e5-4870-b48f-498ac457fb0e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:57.750323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:57.773120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:57.795801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37562acf-1b6e-413a-9455-afd2ca8502d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:57.796443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37562acf-1b6e-413a-9455-afd2ca8502d0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:57.796741 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37562acf-1b6e-413a-9455-afd2ca8502d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:57.797017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37562acf-1b6e-413a-9455-afd2ca8502d0 None admin] PATH_INFO: `/v3/users/73ee864e916f42d4ba5b2f1f37c20457` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:57.799756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37562acf-1b6e-413a-9455-afd2ca8502d0 None admin] RBAC: Authorizing `identity:get_user(user_id=73ee864e916f42d4ba5b2f1f37c20457)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:57.802508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37562acf-1b6e-413a-9455-afd2ca8502d0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:57.807745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 139/290] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:23:57 2022] GET /identity/v3/users/73ee864e916f42d4ba5b2f1f37c20457 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:57.814195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37562acf-1b6e-413a-9455-afd2ca8502d0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:57.910417 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d68a3c-f601-44f8-949a-daa91525df9a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:57.972520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68d98d-a064-4ff8-91c4-cf21b42f6913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:57.974430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68d98d-a064-4ff8-91c4-cf21b42f6913 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:57.974707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68d98d-a064-4ff8-91c4-cf21b42f6913 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:57.974978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e68d98d-a064-4ff8-91c4-cf21b42f6913 None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d/users/7613029ab8884d94be47b4efd0880d18/roles/2e9374cdc2f84d6eac42b2dfaf1008a3` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:57.980254 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68d98d-a064-4ff8-91c4-cf21b42f6913 None admin] RBAC: Authorizing `identity:create_grant(project_id=081387ea09d34bfb94fa762df1c2cd1d, user_id=7613029ab8884d94be47b4efd0880d18, role_id=2e9374cdc2f84d6eac42b2dfaf1008a3)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:57.981774 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e68d98d-a064-4ff8-91c4-cf21b42f6913 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:58.005770 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37562acf-1b6e-413a-9455-afd2ca8502d0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:58.006656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 152/291] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:23:57 2022] PUT /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d/users/7613029ab8884d94be47b4efd0880d18/roles/2e9374cdc2f84d6eac42b2dfaf1008a3 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:23:58.056455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665b6fd-be3e-46fa-992e-b5aca83319dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:58.057098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665b6fd-be3e-46fa-992e-b5aca83319dd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:58.057383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665b6fd-be3e-46fa-992e-b5aca83319dd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:58.057655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665b6fd-be3e-46fa-992e-b5aca83319dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:58.161128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:58.167482 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665b6fd-be3e-46fa-992e-b5aca83319dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:58.169128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665b6fd-be3e-46fa-992e-b5aca83319dd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:58.279411 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 140/292] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:23:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:23:58.284870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68d98d-a064-4ff8-91c4-cf21b42f6913 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:58.381805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:58.401974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e68d98d-a064-4ff8-91c4-cf21b42f6913 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:58.442063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14de704-9ecb-409b-b566-84a55f89ef0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:58.442612 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14de704-9ecb-409b-b566-84a55f89ef0e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:58.442888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14de704-9ecb-409b-b566-84a55f89ef0e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:58.443158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14de704-9ecb-409b-b566-84a55f89ef0e None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:58.444267 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14de704-9ecb-409b-b566-84a55f89ef0e None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:58.445731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14de704-9ecb-409b-b566-84a55f89ef0e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:58.447340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 153/293] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:23:58 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:23:58.453961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665b6fd-be3e-46fa-992e-b5aca83319dd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:58.570148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:58.598655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665b6fd-be3e-46fa-992e-b5aca83319dd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:58.646108 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a075ce-a4ca-47e5-856e-0a3bd391d8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:58.646725 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a075ce-a4ca-47e5-856e-0a3bd391d8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:58.647010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a075ce-a4ca-47e5-856e-0a3bd391d8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:58.647285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a075ce-a4ca-47e5-856e-0a3bd391d8e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:58.648023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a075ce-a4ca-47e5-856e-0a3bd391d8e0 None admin] RBAC: Adding query filter params (role.id=1147187a70be4f46abe9a5f8d33d98fa, scope.project.id=081387ea09d34bfb94fa762df1c2cd1d, user.id=73ee864e916f42d4ba5b2f1f37c20457) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:23:58.648337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a075ce-a4ca-47e5-856e-0a3bd391d8e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:23:58.649816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a075ce-a4ca-47e5-856e-0a3bd391d8e0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:23:58.659962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 141/294] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:23:58 2022] GET /identity/v3/role_assignments?user.id=73ee864e916f42d4ba5b2f1f37c20457&scope.project.id=081387ea09d34bfb94fa762df1c2cd1d&role.id=1147187a70be4f46abe9a5f8d33d98fa => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:23:59.280487 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab139e98-96e2-4cb6-9908-88d381789386 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:59.280895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab139e98-96e2-4cb6-9908-88d381789386 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:59.281072 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab139e98-96e2-4cb6-9908-88d381789386 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:59.282421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 154/295] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:59.287848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b4e4d-425c-40a7-98db-30b15c0d71ee None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:59.288297 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b4e4d-425c-40a7-98db-30b15c0d71ee None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:59.288393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b4e4d-425c-40a7-98db-30b15c0d71ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:59.308065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a40b4e4d-425c-40a7-98db-30b15c0d71ee None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:59.309343 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a40b4e4d-425c-40a7-98db-30b15c0d71ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:59.381415 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 142/296] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:23:59.428422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf90f0-bf8e-4b42-8dfc-d3748e334be4 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:59.429394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf90f0-bf8e-4b42-8dfc-d3748e334be4 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:59.429862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bf90f0-bf8e-4b42-8dfc-d3748e334be4 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:59.431383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 155/297] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:59.437237 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301ded3-2d49-4d30-97e2-9cf1bbd492b3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:59.437530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301ded3-2d49-4d30-97e2-9cf1bbd492b3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:59.437809 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301ded3-2d49-4d30-97e2-9cf1bbd492b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:59.456291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8301ded3-2d49-4d30-97e2-9cf1bbd492b3 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:59.457753 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8301ded3-2d49-4d30-97e2-9cf1bbd492b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:59.520261 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:59.525706 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 143/298] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:23:59.661303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf90f0-bf8e-4b42-8dfc-d3748e334be4 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:59.765374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bf90f0-bf8e-4b42-8dfc-d3748e334be4 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:59.797404 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7155e7-b039-43ff-87ad-d329fe39958f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:59.797696 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7155e7-b039-43ff-87ad-d329fe39958f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:59.798005 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7155e7-b039-43ff-87ad-d329fe39958f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:59.799318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fa612-aa4e-42c5-a705-a595eb8da619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:59.799674 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 144/299] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:23:59.799942 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fa612-aa4e-42c5-a705-a595eb8da619 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:59.800222 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fa612-aa4e-42c5-a705-a595eb8da619 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:59.800495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55fa612-aa4e-42c5-a705-a595eb8da619 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:59.805349 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcacd7-d6db-4995-abb2-527dfb64a3d2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:59.805633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcacd7-d6db-4995-abb2-527dfb64a3d2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:59.805912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcacd7-d6db-4995-abb2-527dfb64a3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:23:59.815170 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55fa612-aa4e-42c5-a705-a595eb8da619 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-a55fa612-aa4e-42c5-a705-a595eb8da619 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:23:59.820228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:23:59.821606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:23:59.822627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:23:59.822627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:23:59.822627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:23:59.822627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:23:59.822627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:23:59.822627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:23:59.822627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:23:59.822627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:23:59.822627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:23:59.822627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:23:59.822627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:23:59.822627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:23:59.824560 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 156/300] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:23:59.824684 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d3fcacd7-d6db-4995-abb2-527dfb64a3d2 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:23:59.825583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fa612-aa4e-42c5-a705-a595eb8da619 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:59.825828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d3fcacd7-d6db-4995-abb2-527dfb64a3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:23:59.846455 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:23:59.897747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 145/301] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:23:59.898870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcacd7-d6db-4995-abb2-527dfb64a3d2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:23:59.956070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55fa612-aa4e-42c5-a705-a595eb8da619 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:23:59.992988 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad3558-38b0-4944-a2dc-90f5ac6d0934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:23:59.994554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad3558-38b0-4944-a2dc-90f5ac6d0934 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:23:59.995013 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad3558-38b0-4944-a2dc-90f5ac6d0934 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:23:59.995671 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ad3558-38b0-4944-a2dc-90f5ac6d0934 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:00.010468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ad3558-38b0-4944-a2dc-90f5ac6d0934 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:00.014093 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcacd7-d6db-4995-abb2-527dfb64a3d2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-b7ad3558-38b0-4944-a2dc-90f5ac6d0934 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:00.017225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:00.018148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:00.018955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:00.018955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:00.018955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:00.018955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:00.018955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:00.018955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:00.018955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:00.018955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:00.018955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:00.018955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:00.018955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:24:00.018955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:00.020813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 157/302] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:23:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:00.023945 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad3558-38b0-4944-a2dc-90f5ac6d0934 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:00.051562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:00.065591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ccb3f-64c4-4d6d-819f-ca16b025a721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:00.067275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ccb3f-64c4-4d6d-819f-ca16b025a721 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:00.068022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ccb3f-64c4-4d6d-819f-ca16b025a721 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:00.068499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ccb3f-64c4-4d6d-819f-ca16b025a721 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:00.069404 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ccb3f-64c4-4d6d-819f-ca16b025a721 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:00.070162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ccb3f-64c4-4d6d-819f-ca16b025a721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:00.072775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5ccb3f-64c4-4d6d-819f-ca16b025a721 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:00.089187 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 146/303] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:23:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:00.091012 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ccb3f-64c4-4d6d-819f-ca16b025a721 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:00.119032 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:00.145123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ad3558-38b0-4944-a2dc-90f5ac6d0934 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:00.181627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12845b3a-9928-4b86-ae0e-d753596922ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:00.182239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12845b3a-9928-4b86-ae0e-d753596922ea None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:00.182518 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12845b3a-9928-4b86-ae0e-d753596922ea None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:00.182793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12845b3a-9928-4b86-ae0e-d753596922ea None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:00.183588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12845b3a-9928-4b86-ae0e-d753596922ea None admin] RBAC: Adding query filter params (name=reader) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:00.183778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12845b3a-9928-4b86-ae0e-d753596922ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:00.185720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12845b3a-9928-4b86-ae0e-d753596922ea None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:00.194456 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 158/304] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:24:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:00.197638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12845b3a-9928-4b86-ae0e-d753596922ea None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:00.228061 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ccb3f-64c4-4d6d-819f-ca16b025a721 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:00.264314 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597a348-4dd4-46c5-9bde-2342692cce89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:00.264989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597a348-4dd4-46c5-9bde-2342692cce89 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:00.265268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597a348-4dd4-46c5-9bde-2342692cce89 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:00.265540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597a348-4dd4-46c5-9bde-2342692cce89 None admin] PATH_INFO: `/v3/users/40485ffb9956458bab891a01f1b0886f` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:00.266676 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597a348-4dd4-46c5-9bde-2342692cce89 None admin] RBAC: Authorizing `identity:get_user(user_id=40485ffb9956458bab891a01f1b0886f)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:00.268107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597a348-4dd4-46c5-9bde-2342692cce89 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:00.269912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 147/305] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:24:00 2022] GET /identity/v3/users/40485ffb9956458bab891a01f1b0886f => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:00.270509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597a348-4dd4-46c5-9bde-2342692cce89 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:00.308373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12845b3a-9928-4b86-ae0e-d753596922ea None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:00.342321 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:00.347629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34443688-3d94-4809-8d21-56b683d900ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:00.348260 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34443688-3d94-4809-8d21-56b683d900ee None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:00.348538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34443688-3d94-4809-8d21-56b683d900ee None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:00.348841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34443688-3d94-4809-8d21-56b683d900ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:00.349942 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34443688-3d94-4809-8d21-56b683d900ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:00.351372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34443688-3d94-4809-8d21-56b683d900ee None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:00.353152 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 159/306] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:00.353703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34443688-3d94-4809-8d21-56b683d900ee None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:00.361619 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:00.392364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597a348-4dd4-46c5-9bde-2342692cce89 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:00.428978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643ab6f-2deb-4661-a5f9-fc4b032e2e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:00.429645 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643ab6f-2deb-4661-a5f9-fc4b032e2e43 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:00.429929 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643ab6f-2deb-4661-a5f9-fc4b032e2e43 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:00.430209 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643ab6f-2deb-4661-a5f9-fc4b032e2e43 None admin] PATH_INFO: `/v3/users/d5a99fb536e5437d82f1fb52033f52ba` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:00.449941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643ab6f-2deb-4661-a5f9-fc4b032e2e43 None admin] RBAC: Authorizing `identity:get_user(user_id=d5a99fb536e5437d82f1fb52033f52ba)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:00.452269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643ab6f-2deb-4661-a5f9-fc4b032e2e43 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:00.454190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 148/307] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:24:00 2022] GET /identity/v3/users/d5a99fb536e5437d82f1fb52033f52ba => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:00.454990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643ab6f-2deb-4661-a5f9-fc4b032e2e43 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:00.471728 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34443688-3d94-4809-8d21-56b683d900ee None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:00.508449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55e6cc-4327-4bda-8e2f-3dff5186ee4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:00.509129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55e6cc-4327-4bda-8e2f-3dff5186ee4c None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:00.509411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55e6cc-4327-4bda-8e2f-3dff5186ee4c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:00.509689 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55e6cc-4327-4bda-8e2f-3dff5186ee4c None admin] PATH_INFO: `/v3/system/users/40485ffb9956458bab891a01f1b0886f/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:00.511105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55e6cc-4327-4bda-8e2f-3dff5186ee4c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=40485ffb9956458bab891a01f1b0886f, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:00.512471 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55e6cc-4327-4bda-8e2f-3dff5186ee4c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:00.522663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 160/308] 10.222.0.42 () {58 vars in 1334 bytes} [Tue Sep 13 06:24:00 2022] PUT /identity/v3/system/users/40485ffb9956458bab891a01f1b0886f/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:24:00.523734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55e6cc-4327-4bda-8e2f-3dff5186ee4c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:00.586749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643ab6f-2deb-4661-a5f9-fc4b032e2e43 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:00.599673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:00.609978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:00.634689 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b54efe-a162-4eef-9222-e9f1150c6769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:00.635310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b54efe-a162-4eef-9222-e9f1150c6769 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:00.635603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b54efe-a162-4eef-9222-e9f1150c6769 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:00.635854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b54efe-a162-4eef-9222-e9f1150c6769 None admin] PATH_INFO: `/v3/groups` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:00.636494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b54efe-a162-4eef-9222-e9f1150c6769 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:00.637973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b54efe-a162-4eef-9222-e9f1150c6769 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:00.640566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55e6cc-4327-4bda-8e2f-3dff5186ee4c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:00.665911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 149/309] 10.222.0.42 () {60 vars in 1134 bytes} [Tue Sep 13 06:24:00 2022] POST /identity/v3/groups => generated 229 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:24:00.665911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea1753-0ab7-4c66-a8c8-140106fefddb None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:00.665911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea1753-0ab7-4c66-a8c8-140106fefddb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:00.665911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffea1753-0ab7-4c66-a8c8-140106fefddb None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:00.665911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 150/310] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:00.667980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731debf8-929c-4b3a-8594-3a3659b1b9fa None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:00.668306 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731debf8-929c-4b3a-8594-3a3659b1b9fa None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:00.668701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731debf8-929c-4b3a-8594-3a3659b1b9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:00.691020 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-731debf8-929c-4b3a-8594-3a3659b1b9fa None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:00.692934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-731debf8-929c-4b3a-8594-3a3659b1b9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:00.700281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a958a-89e1-4a80-98a5-bb7f9badd438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:00.701461 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a958a-89e1-4a80-98a5-bb7f9badd438 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:00.701461 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a958a-89e1-4a80-98a5-bb7f9badd438 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:00.701461 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a958a-89e1-4a80-98a5-bb7f9badd438 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:00.702175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a958a-89e1-4a80-98a5-bb7f9badd438 None admin] RBAC: Adding query filter params (role.id=2e9374cdc2f84d6eac42b2dfaf1008a3, user.id=d5a99fb536e5437d82f1fb52033f52ba, scope.system=all) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:00.702495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a958a-89e1-4a80-98a5-bb7f9badd438 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:00.703988 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a958a-89e1-4a80-98a5-bb7f9badd438 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:00.710863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 161/311] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Sep 13 06:24:00 2022] GET /identity/v3/role_assignments?user.id=d5a99fb536e5437d82f1fb52033f52ba&scope.system=all&role.id=2e9374cdc2f84d6eac42b2dfaf1008a3 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:00.788162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 151/312] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:01.059547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a958a-89e1-4a80-98a5-bb7f9badd438 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:01.164304 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a958a-89e1-4a80-98a5-bb7f9badd438 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:01.195171 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:01.201332 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f28d8-b9a9-4ac8-92b1-0518c9628c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:01.201976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f28d8-b9a9-4ac8-92b1-0518c9628c51 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:01.202248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f28d8-b9a9-4ac8-92b1-0518c9628c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:01.202514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f28d8-b9a9-4ac8-92b1-0518c9628c51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:01.213517 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f28d8-b9a9-4ac8-92b1-0518c9628c51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-0a7f28d8-b9a9-4ac8-92b1-0518c9628c51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:01.218940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:01.219822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:01.220608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:01.220608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:01.220608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:01.220608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:01.220608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:01.220608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:01.220608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:01.220608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:01.220608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:01.220608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:01.220608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:24:01.220608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:01.220608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 162/313] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:01.226155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731debf8-929c-4b3a-8594-3a3659b1b9fa None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:01.334105 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731debf8-929c-4b3a-8594-3a3659b1b9fa None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:01.342139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:01.379941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e777ce9-10f0-4163-b32f-1f6cff788fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:01.380732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e777ce9-10f0-4163-b32f-1f6cff788fc9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:01.380987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e777ce9-10f0-4163-b32f-1f6cff788fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:01.381265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e777ce9-10f0-4163-b32f-1f6cff788fc9 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:01.381925 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e777ce9-10f0-4163-b32f-1f6cff788fc9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:01.382227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e777ce9-10f0-4163-b32f-1f6cff788fc9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:01.383584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e777ce9-10f0-4163-b32f-1f6cff788fc9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:01.392170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 152/314] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:24:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:01.397795 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f28d8-b9a9-4ac8-92b1-0518c9628c51 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:01.512340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f28d8-b9a9-4ac8-92b1-0518c9628c51 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:01.548465 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b53ed2-eeb3-42ba-a845-64239f8494d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:01.549131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53ed2-eeb3-42ba-a845-64239f8494d4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:01.549410 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53ed2-eeb3-42ba-a845-64239f8494d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:01.549685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b53ed2-eeb3-42ba-a845-64239f8494d4 None admin] PATH_INFO: `/v3/users/7613029ab8884d94be47b4efd0880d18` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:01.550812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b53ed2-eeb3-42ba-a845-64239f8494d4 None admin] RBAC: Authorizing `identity:get_user(user_id=7613029ab8884d94be47b4efd0880d18)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:01.552450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b53ed2-eeb3-42ba-a845-64239f8494d4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:01.554499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 163/315] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:24:01 2022] GET /identity/v3/users/7613029ab8884d94be47b4efd0880d18 => generated 297 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:01.560016 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e777ce9-10f0-4163-b32f-1f6cff788fc9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:01.670626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e777ce9-10f0-4163-b32f-1f6cff788fc9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:01.707624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ddac1-5166-4cf8-8eb1-6c1e3641b33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:01.708278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ddac1-5166-4cf8-8eb1-6c1e3641b33a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:01.708565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ddac1-5166-4cf8-8eb1-6c1e3641b33a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:01.708865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ddac1-5166-4cf8-8eb1-6c1e3641b33a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:01.745713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:01.782605 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ddac1-5166-4cf8-8eb1-6c1e3641b33a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:01.784140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ddac1-5166-4cf8-8eb1-6c1e3641b33a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:01.892815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 153/316] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:01.898686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b53ed2-eeb3-42ba-a845-64239f8494d4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:01.961407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:02.006894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b53ed2-eeb3-42ba-a845-64239f8494d4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:02.042363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b1d198-cf79-47df-8391-3344934032b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:02.043038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d198-cf79-47df-8391-3344934032b3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:02.043320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d198-cf79-47df-8391-3344934032b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:02.043590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b1d198-cf79-47df-8391-3344934032b3 None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:02.044798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1d198-cf79-47df-8391-3344934032b3 None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:02.046244 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b1d198-cf79-47df-8391-3344934032b3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:02.048167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 164/317] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:01 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:02.054086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ddac1-5166-4cf8-8eb1-6c1e3641b33a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:02.124068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:02.160539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ddac1-5166-4cf8-8eb1-6c1e3641b33a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:02.199352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c5c9a6-7972-4143-8db0-3220d2a17b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:02.199966 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5c9a6-7972-4143-8db0-3220d2a17b7a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:02.200246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5c9a6-7972-4143-8db0-3220d2a17b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:02.200518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c5c9a6-7972-4143-8db0-3220d2a17b7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:02.201829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5c9a6-7972-4143-8db0-3220d2a17b7a None admin] RBAC: Adding query filter params (role.id=2e9374cdc2f84d6eac42b2dfaf1008a3, scope.project.id=081387ea09d34bfb94fa762df1c2cd1d, user.id=7613029ab8884d94be47b4efd0880d18) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:02.202134 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5c9a6-7972-4143-8db0-3220d2a17b7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:02.203548 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c5c9a6-7972-4143-8db0-3220d2a17b7a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:02.209836 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 154/318] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:24:02 2022] GET /identity/v3/role_assignments?user.id=7613029ab8884d94be47b4efd0880d18&scope.project.id=081387ea09d34bfb94fa762df1c2cd1d&role.id=2e9374cdc2f84d6eac42b2dfaf1008a3 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:02.758167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b38651-f3d8-4048-b450-90b609002d1b None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:02.758732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b38651-f3d8-4048-b450-90b609002d1b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:02.758732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b38651-f3d8-4048-b450-90b609002d1b None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:02.760197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 165/319] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:02.765203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2f6d5-612e-485e-a383-048d8818e4ba None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:02.765624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2f6d5-612e-485e-a383-048d8818e4ba None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:02.765827 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad2f6d5-612e-485e-a383-048d8818e4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:02.785617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3ad2f6d5-612e-485e-a383-048d8818e4ba None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:02.786854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3ad2f6d5-612e-485e-a383-048d8818e4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:02.862612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 155/320] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:02.901019 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e60e1-33dd-4656-8434-f4c47837a46c None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:02.901290 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e60e1-33dd-4656-8434-f4c47837a46c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:02.901493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155e60e1-33dd-4656-8434-f4c47837a46c None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:02.902959 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 166/321] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:02.908611 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056246d-606c-45b4-ab01-ac05b49a5073 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:02.908936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056246d-606c-45b4-ab01-ac05b49a5073 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:02.909206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c056246d-606c-45b4-ab01-ac05b49a5073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:02.927465 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c056246d-606c-45b4-ab01-ac05b49a5073 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:02.928654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c056246d-606c-45b4-ab01-ac05b49a5073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:02.977328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa69785-0a41-4435-8762-2d2660a80972 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:02.978281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa69785-0a41-4435-8762-2d2660a80972 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:02.978281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa69785-0a41-4435-8762-2d2660a80972 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:02.981259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 167/322] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:24:02.984928 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4e99b-af13-4d87-973d-697bf151a6e0 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:02.985211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4e99b-af13-4d87-973d-697bf151a6e0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:02.985490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4e99b-af13-4d87-973d-697bf151a6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:02.987986 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:03.001644 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 156/323] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:03.005091 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-1fd4e99b-af13-4d87-973d-697bf151a6e0 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:03.006363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1fd4e99b-af13-4d87-973d-697bf151a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:03.072047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 168/324] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:24:03.131458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056246d-606c-45b4-ab01-ac05b49a5073 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:03.235274 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c056246d-606c-45b4-ab01-ac05b49a5073 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:03.268264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405884a7-4a8f-4e76-a0ee-3b901e9c6bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:03.268911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405884a7-4a8f-4e76-a0ee-3b901e9c6bff None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:03.269191 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405884a7-4a8f-4e76-a0ee-3b901e9c6bff None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:03.269460 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405884a7-4a8f-4e76-a0ee-3b901e9c6bff None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:03.276324 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4e99b-af13-4d87-973d-697bf151a6e0 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:03.279719 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405884a7-4a8f-4e76-a0ee-3b901e9c6bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-405884a7-4a8f-4e76-a0ee-3b901e9c6bff None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:03.284582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:03.286142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:03.287775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:03.287775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:03.287775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:03.287775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:03.287775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:03.287775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:03.287775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:03.287775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:03.287775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:03.287775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:03.287775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:24:03.287775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:03.287775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 157/325] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:03.291271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405884a7-4a8f-4e76-a0ee-3b901e9c6bff None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:03.341500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:03.350695 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:03.383725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4e99b-af13-4d87-973d-697bf151a6e0 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:03.397647 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405884a7-4a8f-4e76-a0ee-3b901e9c6bff None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:03.416829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f7903-2427-4589-bb05-a53f5cc5bb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:03.417456 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f7903-2427-4589-bb05-a53f5cc5bb2e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:03.417737 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f7903-2427-4589-bb05-a53f5cc5bb2e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:03.418013 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f7903-2427-4589-bb05-a53f5cc5bb2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:03.419103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f7903-2427-4589-bb05-a53f5cc5bb2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:03.421089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50f7903-2427-4589-bb05-a53f5cc5bb2e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:03.422650 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 169/326] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:03.423405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f7903-2427-4589-bb05-a53f5cc5bb2e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:03.430920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5907ac-6ff4-4682-8dd5-7db35085c1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:03.431530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5907ac-6ff4-4682-8dd5-7db35085c1eb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:03.431811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5907ac-6ff4-4682-8dd5-7db35085c1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:03.432085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5907ac-6ff4-4682-8dd5-7db35085c1eb None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:03.433090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5907ac-6ff4-4682-8dd5-7db35085c1eb None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:03.433090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5907ac-6ff4-4682-8dd5-7db35085c1eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:03.434422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5907ac-6ff4-4682-8dd5-7db35085c1eb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:03.444170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 158/327] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:24:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:03.445014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5907ac-6ff4-4682-8dd5-7db35085c1eb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:03.527876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f7903-2427-4589-bb05-a53f5cc5bb2e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:03.545453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5907ac-6ff4-4682-8dd5-7db35085c1eb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:03.553151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:03.558755 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:03.562924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff0c44-c10f-405b-bf2d-961820105578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:03.563544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff0c44-c10f-405b-bf2d-961820105578 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:03.563821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff0c44-c10f-405b-bf2d-961820105578 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:03.564087 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ff0c44-c10f-405b-bf2d-961820105578 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:03.574121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ff0c44-c10f-405b-bf2d-961820105578 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:03.579239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e528c-c979-4e8a-b213-fc1e94a679ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-48ff0c44-c10f-405b-bf2d-961820105578 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:03.579370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:03.580418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:03.581470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:03.581470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:03.581470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:03.581470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:03.581470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:03.581470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:03.581470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:03.581470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:03.581470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:03.581470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:03.581470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:24:03.581470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:03.582245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e528c-c979-4e8a-b213-fc1e94a679ae None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:03.582245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e528c-c979-4e8a-b213-fc1e94a679ae None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:03.582245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e528c-c979-4e8a-b213-fc1e94a679ae None admin] PATH_INFO: `/v3/groups` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:03.582451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 170/328] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:03.582451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff0c44-c10f-405b-bf2d-961820105578 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:03.585257 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e528c-c979-4e8a-b213-fc1e94a679ae None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:03.586885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e528c-c979-4e8a-b213-fc1e94a679ae None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:03.602632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 159/329] 10.222.0.42 () {60 vars in 1134 bytes} [Tue Sep 13 06:24:03 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:24:03.603434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e528c-c979-4e8a-b213-fc1e94a679ae None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:03.706573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ff0c44-c10f-405b-bf2d-961820105578 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:03.731064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e528c-c979-4e8a-b213-fc1e94a679ae None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:03.745559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e0cfe-bbf1-42b1-9ec8-283c93d04e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:03.746203 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e0cfe-bbf1-42b1-9ec8-283c93d04e5e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:03.746484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e0cfe-bbf1-42b1-9ec8-283c93d04e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:03.746762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e0cfe-bbf1-42b1-9ec8-283c93d04e5e None admin] PATH_INFO: `/v3/users/40485ffb9956458bab891a01f1b0886f` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:03.748079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e0cfe-bbf1-42b1-9ec8-283c93d04e5e None admin] RBAC: Authorizing `identity:get_user(user_id=40485ffb9956458bab891a01f1b0886f)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:03.749607 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766e0cfe-bbf1-42b1-9ec8-283c93d04e5e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:03.751266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 171/330] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:24:03 2022] GET /identity/v3/users/40485ffb9956458bab891a01f1b0886f => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:03.757350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e0cfe-bbf1-42b1-9ec8-283c93d04e5e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:03.774507 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bbe5e-a322-40d9-bebd-f76384194d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:03.775121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bbe5e-a322-40d9-bebd-f76384194d2f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:03.775407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bbe5e-a322-40d9-bebd-f76384194d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:03.775676 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bbe5e-a322-40d9-bebd-f76384194d2f None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:03.776342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bbe5e-a322-40d9-bebd-f76384194d2f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:03.776652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bbe5e-a322-40d9-bebd-f76384194d2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:03.778138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566bbe5e-a322-40d9-bebd-f76384194d2f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:03.787400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 160/331] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:24:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:03.793498 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bbe5e-a322-40d9-bebd-f76384194d2f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:03.822085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:03.834664 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:03.874340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766e0cfe-bbf1-42b1-9ec8-283c93d04e5e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:03.917478 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93a9d9-f589-4897-bfc6-0422fde95085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:03.918084 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93a9d9-f589-4897-bfc6-0422fde95085 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:03.918364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93a9d9-f589-4897-bfc6-0422fde95085 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:03.918634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b93a9d9-f589-4897-bfc6-0422fde95085 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:03.919361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93a9d9-f589-4897-bfc6-0422fde95085 None admin] RBAC: Adding query filter params (role.id=1147187a70be4f46abe9a5f8d33d98fa, user.id=40485ffb9956458bab891a01f1b0886f, scope.system=all) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:03.920209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93a9d9-f589-4897-bfc6-0422fde95085 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:03.921696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b93a9d9-f589-4897-bfc6-0422fde95085 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:03.922449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566bbe5e-a322-40d9-bebd-f76384194d2f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:03.936297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 172/332] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Sep 13 06:24:03 2022] GET /identity/v3/role_assignments?user.id=40485ffb9956458bab891a01f1b0886f&scope.system=all&role.id=1147187a70be4f46abe9a5f8d33d98fa => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:03.963004 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ae625-36af-4e1c-a2f6-cc6f0b1bba00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:03.964029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ae625-36af-4e1c-a2f6-cc6f0b1bba00 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:03.964441 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ae625-36af-4e1c-a2f6-cc6f0b1bba00 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:03.964888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ae625-36af-4e1c-a2f6-cc6f0b1bba00 None admin] PATH_INFO: `/v3/users/d5a99fb536e5437d82f1fb52033f52ba` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:03.966400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ae625-36af-4e1c-a2f6-cc6f0b1bba00 None admin] RBAC: Authorizing `identity:get_user(user_id=d5a99fb536e5437d82f1fb52033f52ba)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:03.968079 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ae625-36af-4e1c-a2f6-cc6f0b1bba00 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:03.970023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 161/333] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:24:03 2022] GET /identity/v3/users/d5a99fb536e5437d82f1fb52033f52ba => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:03.976048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93a9d9-f589-4897-bfc6-0422fde95085 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:04.097270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b93a9d9-f589-4897-bfc6-0422fde95085 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:04.113447 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:04.140098 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ccd083-68d1-4f92-9822-4655dd9daf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:04.140789 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccd083-68d1-4f92-9822-4655dd9daf47 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:04.141070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccd083-68d1-4f92-9822-4655dd9daf47 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:04.141347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ccd083-68d1-4f92-9822-4655dd9daf47 None admin] PATH_INFO: `/v3/system/users/d5a99fb536e5437d82f1fb52033f52ba/roles/2e9374cdc2f84d6eac42b2dfaf1008a3` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:04.143723 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccd083-68d1-4f92-9822-4655dd9daf47 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d5a99fb536e5437d82f1fb52033f52ba, role_id=2e9374cdc2f84d6eac42b2dfaf1008a3)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:04.145206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ccd083-68d1-4f92-9822-4655dd9daf47 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:04.154247 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 173/334] 10.222.0.42 () {58 vars in 1334 bytes} [Tue Sep 13 06:24:03 2022] PUT /identity/v3/system/users/d5a99fb536e5437d82f1fb52033f52ba/roles/2e9374cdc2f84d6eac42b2dfaf1008a3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:24:06.458808 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dd46c-86d7-4556-b132-04c95bbc466d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:06.459360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dd46c-86d7-4556-b132-04c95bbc466d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:06.459360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dd46c-86d7-4556-b132-04c95bbc466d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:06.460998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 162/335] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:06.470532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd05e23-bc6f-49e3-9c88-0b646c111ed2 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:06.471018 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd05e23-bc6f-49e3-9c88-0b646c111ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:06.471093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd05e23-bc6f-49e3-9c88-0b646c111ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:06.494856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ddd05e23-bc6f-49e3-9c88-0b646c111ed2 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:06.496042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ddd05e23-bc6f-49e3-9c88-0b646c111ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:06.587235 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 174/336] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:06.697316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212fe1-f501-41b7-860d-b65797c7a41f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:06.699213 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212fe1-f501-41b7-860d-b65797c7a41f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:06.699213 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7212fe1-f501-41b7-860d-b65797c7a41f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:06.699679 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 163/337] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:06.706708 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec65a80-b73f-4e47-a8b4-53d4a533ccac None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:06.707174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec65a80-b73f-4e47-a8b4-53d4a533ccac None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:06.707621 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec65a80-b73f-4e47-a8b4-53d4a533ccac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:06.737378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2ec65a80-b73f-4e47-a8b4-53d4a533ccac None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:06.738802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2ec65a80-b73f-4e47-a8b4-53d4a533ccac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:06.826361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 175/338] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:06.954715 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c5575-9656-489f-b27f-eae3be5fce84 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:06.955262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c5575-9656-489f-b27f-eae3be5fce84 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:06.955682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c5575-9656-489f-b27f-eae3be5fce84 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:06.957208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 164/339] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:06.962756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1011388-3437-4e7e-ade1-9c6edf087bf4 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:06.963281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1011388-3437-4e7e-ade1-9c6edf087bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:06.963768 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1011388-3437-4e7e-ade1-9c6edf087bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:06.998436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f1011388-3437-4e7e-ade1-9c6edf087bf4 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:07.000040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f1011388-3437-4e7e-ade1-9c6edf087bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:07.030698 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:07.057608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b2834-06ef-4bb3-950c-91f4a1b09b20 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:07.058280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b2834-06ef-4bb3-950c-91f4a1b09b20 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:07.058792 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b2834-06ef-4bb3-950c-91f4a1b09b20 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:07.060712 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 165/340] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:07.066034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1f025-f62f-4c87-931f-8061a0172efb None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:07.066574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1f025-f62f-4c87-931f-8061a0172efb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:07.067045 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d1f025-f62f-4c87-931f-8061a0172efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:07.101779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-94d1f025-f62f-4c87-931f-8061a0172efb None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:07.103254 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 176/341] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:24:07.103577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-94d1f025-f62f-4c87-931f-8061a0172efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:07.209603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 166/342] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:07.231206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1011388-3437-4e7e-ade1-9c6edf087bf4 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:07.297186 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1f025-f62f-4c87-931f-8061a0172efb None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:07.333985 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:07.408402 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1011388-3437-4e7e-ade1-9c6edf087bf4 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:07.432731 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d1f025-f62f-4c87-931f-8061a0172efb None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:07.489377 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d9281-31a8-4b57-951a-cf6176e2f692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:07.490013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d9281-31a8-4b57-951a-cf6176e2f692 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:07.490596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d9281-31a8-4b57-951a-cf6176e2f692 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:07.491014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d9281-31a8-4b57-951a-cf6176e2f692 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:07.498305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d0009-766f-4df1-984f-a9d29a6a82e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:07.499421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d0009-766f-4df1-984f-a9d29a6a82e3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:07.499870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d0009-766f-4df1-984f-a9d29a6a82e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:07.500286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d0009-766f-4df1-984f-a9d29a6a82e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:07.505992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241d9281-31a8-4b57-951a-cf6176e2f692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-241d9281-31a8-4b57-951a-cf6176e2f692 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:07.510912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:07.512009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:07.512997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:07.512997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:07.512997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:07.512997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:07.512997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:07.512997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:07.512997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:07.512997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:07.512997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:07.512997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:07.512997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 06:24:07.512997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:07.515307 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 167/343] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:24:07.516230 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d9281-31a8-4b57-951a-cf6176e2f692 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:07.537672 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d0009-766f-4df1-984f-a9d29a6a82e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-395d0009-766f-4df1-984f-a9d29a6a82e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:07.547306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:07.548392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:07.549405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:07.549405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:07.549405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:07.549405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:07.549405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:07.549405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:07.549405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:07.549405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:07.549405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:07.549405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:07.549405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:24:07.549405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:07.551524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 177/344] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:07.552451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d0009-766f-4df1-984f-a9d29a6a82e3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:07.605903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:07.671477 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:07.678553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d9281-31a8-4b57-951a-cf6176e2f692 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:07.704634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d0009-766f-4df1-984f-a9d29a6a82e3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:07.717490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157a9ae-73df-43c8-be25-522dd9f4fec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:07.718133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157a9ae-73df-43c8-be25-522dd9f4fec6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:07.718412 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157a9ae-73df-43c8-be25-522dd9f4fec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:07.718680 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a157a9ae-73df-43c8-be25-522dd9f4fec6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:07.729896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a157a9ae-73df-43c8-be25-522dd9f4fec6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a157a9ae-73df-43c8-be25-522dd9f4fec6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:07.735738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:07.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:07.737515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:07.737515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:07.737515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:07.737515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:07.737515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:07.737515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:07.737515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:07.737515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:07.737515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:07.737515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:07.737515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:24:07.737515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:07.737515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 168/345] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:24:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:07.738262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157a9ae-73df-43c8-be25-522dd9f4fec6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:07.745833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dd6be-e2ec-45b2-9678-71276b6d30b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:07.746673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dd6be-e2ec-45b2-9678-71276b6d30b8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:07.747098 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dd6be-e2ec-45b2-9678-71276b6d30b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:07.748191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953dd6be-e2ec-45b2-9678-71276b6d30b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:07.749117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dd6be-e2ec-45b2-9678-71276b6d30b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:07.749599 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dd6be-e2ec-45b2-9678-71276b6d30b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:07.751301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953dd6be-e2ec-45b2-9678-71276b6d30b8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:07.760805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 178/346] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:24:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:07.764307 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dd6be-e2ec-45b2-9678-71276b6d30b8 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:07.843974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a157a9ae-73df-43c8-be25-522dd9f4fec6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:07.864063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:07.880809 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953dd6be-e2ec-45b2-9678-71276b6d30b8 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:07.886816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84a289-8876-4a2e-b8c5-f079d6e8c98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:07.887434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84a289-8876-4a2e-b8c5-f079d6e8c98c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:07.887717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84a289-8876-4a2e-b8c5-f079d6e8c98c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:07.887988 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84a289-8876-4a2e-b8c5-f079d6e8c98c None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:07.889704 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84a289-8876-4a2e-b8c5-f079d6e8c98c None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:07.890215 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84a289-8876-4a2e-b8c5-f079d6e8c98c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:07.892131 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84a289-8876-4a2e-b8c5-f079d6e8c98c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:07.902503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 169/347] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:24:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:07.905140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa51891-b624-4ded-99f4-ddfe7a864183 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:07.905610 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa51891-b624-4ded-99f4-ddfe7a864183 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:07.906067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa51891-b624-4ded-99f4-ddfe7a864183 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:07.907853 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 170/348] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:07.908874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa51891-b624-4ded-99f4-ddfe7a864183 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:07.926953 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72cf67-5f60-41c0-a943-ed77adc1074c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:07.927815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72cf67-5f60-41c0-a943-ed77adc1074c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:07.927815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72cf67-5f60-41c0-a943-ed77adc1074c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:07.927979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a72cf67-5f60-41c0-a943-ed77adc1074c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:07.932230 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:07.941258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a72cf67-5f60-41c0-a943-ed77adc1074c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-7a72cf67-5f60-41c0-a943-ed77adc1074c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:07.946929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:07.947810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:07.948604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:07.948604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:07.948604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:07.948604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:07.948604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:07.948604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:07.948604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:07.948604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:07.948604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:07.948604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:07.948604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:24:07.948604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:07.948604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 179/349] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:07.949287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72cf67-5f60-41c0-a943-ed77adc1074c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:08.039641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa51891-b624-4ded-99f4-ddfe7a864183 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:08.077382 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a72cf67-5f60-41c0-a943-ed77adc1074c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:08.091059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e9cec-0d1f-4c53-aa72-44879020387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:08.091784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e9cec-0d1f-4c53-aa72-44879020387a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:08.092069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e9cec-0d1f-4c53-aa72-44879020387a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:08.092269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36e9cec-0d1f-4c53-aa72-44879020387a None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:08.092977 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e9cec-0d1f-4c53-aa72-44879020387a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:08.093285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e9cec-0d1f-4c53-aa72-44879020387a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:08.094726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36e9cec-0d1f-4c53-aa72-44879020387a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:08.107100 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 171/350] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:08.108153 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e9cec-0d1f-4c53-aa72-44879020387a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:08.130613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b442917-55cb-47b5-b850-5de2ee79f6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:08.131247 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b442917-55cb-47b5-b850-5de2ee79f6ac None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:08.131523 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b442917-55cb-47b5-b850-5de2ee79f6ac None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:08.131793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b442917-55cb-47b5-b850-5de2ee79f6ac None admin] PATH_INFO: `/v3/users/d5a99fb536e5437d82f1fb52033f52ba` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:08.133246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b442917-55cb-47b5-b850-5de2ee79f6ac None admin] RBAC: Authorizing `identity:get_user(user_id=d5a99fb536e5437d82f1fb52033f52ba)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:08.134497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b442917-55cb-47b5-b850-5de2ee79f6ac None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:08.136438 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 180/351] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:24:07 2022] GET /identity/v3/users/d5a99fb536e5437d82f1fb52033f52ba => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:08.137421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c99666-286d-4700-949d-2e79423f85a1 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:08.137697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c99666-286d-4700-949d-2e79423f85a1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:08.137963 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c99666-286d-4700-949d-2e79423f85a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:08.157775 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-98c99666-286d-4700-949d-2e79423f85a1 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:08.158963 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-98c99666-286d-4700-949d-2e79423f85a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:08.172921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:08.211369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:08.238763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36e9cec-0d1f-4c53-aa72-44879020387a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:08.241679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 181/352] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:08.242415 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c99666-286d-4700-949d-2e79423f85a1 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:08.289704 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4d3ba-93d0-43bd-ad39-c2adb31cc3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:08.290374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d3ba-93d0-43bd-ad39-c2adb31cc3ce None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:08.290655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d3ba-93d0-43bd-ad39-c2adb31cc3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:08.290930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c4d3ba-93d0-43bd-ad39-c2adb31cc3ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:08.363380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c99666-286d-4700-949d-2e79423f85a1 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:08.380506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4d3ba-93d0-43bd-ad39-c2adb31cc3ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:08.381983 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c4d3ba-93d0-43bd-ad39-c2adb31cc3ce None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:08.407989 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0b9a6-47a9-4b94-be4e-d9db5acc35bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:08.408785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0b9a6-47a9-4b94-be4e-d9db5acc35bf None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:08.409067 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0b9a6-47a9-4b94-be4e-d9db5acc35bf None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:08.409336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e0b9a6-47a9-4b94-be4e-d9db5acc35bf None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:08.410135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0b9a6-47a9-4b94-be4e-d9db5acc35bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:08.410437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0b9a6-47a9-4b94-be4e-d9db5acc35bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:08.412461 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e0b9a6-47a9-4b94-be4e-d9db5acc35bf None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:08.425221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 182/353] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:24:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:08.426074 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0b9a6-47a9-4b94-be4e-d9db5acc35bf None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:08.439395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:08.486357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:08.516811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 172/354] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:08.517881 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4d3ba-93d0-43bd-ad39-c2adb31cc3ce None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:08.552880 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e0b9a6-47a9-4b94-be4e-d9db5acc35bf None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:08.598467 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc27cb-d72e-4ece-9bb7-ad4453118dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:08.599093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc27cb-d72e-4ece-9bb7-ad4453118dd4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:08.599361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc27cb-d72e-4ece-9bb7-ad4453118dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:08.599628 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc27cb-d72e-4ece-9bb7-ad4453118dd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:08.648474 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c4d3ba-93d0-43bd-ad39-c2adb31cc3ce None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:08.686920 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc27cb-d72e-4ece-9bb7-ad4453118dd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:08.687130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718037e-bb18-45fa-b8b9-6e39d8ef5ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:08.687699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718037e-bb18-45fa-b8b9-6e39d8ef5ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:08.687976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718037e-bb18-45fa-b8b9-6e39d8ef5ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:08.688246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718037e-bb18-45fa-b8b9-6e39d8ef5ea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:08.688413 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc27cb-d72e-4ece-9bb7-ad4453118dd4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:08.689070 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718037e-bb18-45fa-b8b9-6e39d8ef5ea0 None admin] RBAC: Adding query filter params (role.id=2e9374cdc2f84d6eac42b2dfaf1008a3, user.id=d5a99fb536e5437d82f1fb52033f52ba, scope.system=all) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:08.689379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718037e-bb18-45fa-b8b9-6e39d8ef5ea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:08.691820 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0718037e-bb18-45fa-b8b9-6e39d8ef5ea0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:08.705358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:08.708560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 173/355] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Sep 13 06:24:08 2022] GET /identity/v3/role_assignments?user.id=d5a99fb536e5437d82f1fb52033f52ba&scope.system=all&role.id=2e9374cdc2f84d6eac42b2dfaf1008a3 => generated 510 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:08.709400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718037e-bb18-45fa-b8b9-6e39d8ef5ea0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:08.757851 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:08.811440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 183/356] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:08.812558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc27cb-d72e-4ece-9bb7-ad4453118dd4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:08.854474 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0718037e-bb18-45fa-b8b9-6e39d8ef5ea0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:08.900888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6c421-489a-4f1e-ba52-35d5c41ca94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:08.901641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6c421-489a-4f1e-ba52-35d5c41ca94a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:08.901938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6c421-489a-4f1e-ba52-35d5c41ca94a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:08.902208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6c421-489a-4f1e-ba52-35d5c41ca94a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:08.967415 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc27cb-d72e-4ece-9bb7-ad4453118dd4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:08.978745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:08.994547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6c421-489a-4f1e-ba52-35d5c41ca94a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:08.995014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e6c421-489a-4f1e-ba52-35d5c41ca94a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:09.009919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abc4cd-c9b1-4acc-a3a9-543fabb6d1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:09.010545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abc4cd-c9b1-4acc-a3a9-543fabb6d1e2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:09.010818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abc4cd-c9b1-4acc-a3a9-543fabb6d1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:09.011085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8abc4cd-c9b1-4acc-a3a9-543fabb6d1e2 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:09.013164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abc4cd-c9b1-4acc-a3a9-543fabb6d1e2 None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:09.014602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8abc4cd-c9b1-4acc-a3a9-543fabb6d1e2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:09.016208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 184/357] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:08 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:09.017140 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abc4cd-c9b1-4acc-a3a9-543fabb6d1e2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:09.039904 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:09.119432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 174/358] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:09.122279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4bc15-9b8a-4748-a87e-841ffb881739 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:09.122704 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4bc15-9b8a-4748-a87e-841ffb881739 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:09.123093 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4bc15-9b8a-4748-a87e-841ffb881739 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:09.124541 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 175/359] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:09.125370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4bc15-9b8a-4748-a87e-841ffb881739 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:09.132243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8abc4cd-c9b1-4acc-a3a9-543fabb6d1e2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:09.174879 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05357dea-ce52-48bc-a911-557d84ba153d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:09.176335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05357dea-ce52-48bc-a911-557d84ba153d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:09.176335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05357dea-ce52-48bc-a911-557d84ba153d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:09.176335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05357dea-ce52-48bc-a911-557d84ba153d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:09.187477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05357dea-ce52-48bc-a911-557d84ba153d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-05357dea-ce52-48bc-a911-557d84ba153d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:09.192430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:09.193618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:09.194437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:09.194437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:09.194437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:09.194437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:09.194437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:09.194437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:09.194437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:09.194437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:09.194437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:09.194437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:09.194437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:24:09.194437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:09.194437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 185/360] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:24:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:09.195144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05357dea-ce52-48bc-a911-557d84ba153d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:09.236501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:09.248584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4bc15-9b8a-4748-a87e-841ffb881739 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:09.290968 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb626e-a290-49ec-bc75-a06b3f29a8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:09.291603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb626e-a290-49ec-bc75-a06b3f29a8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:09.291886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb626e-a290-49ec-bc75-a06b3f29a8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:09.292161 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cb626e-a290-49ec-bc75-a06b3f29a8c9 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:09.293323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb626e-a290-49ec-bc75-a06b3f29a8c9 None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:09.294800 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cb626e-a290-49ec-bc75-a06b3f29a8c9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:09.296797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 176/361] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:09 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:09.297297 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb626e-a290-49ec-bc75-a06b3f29a8c9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:09.303629 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:09.317731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05357dea-ce52-48bc-a911-557d84ba153d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:09.356162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f953b-0558-4f77-82fa-35dc23436960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:09.356947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f953b-0558-4f77-82fa-35dc23436960 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:09.357232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f953b-0558-4f77-82fa-35dc23436960 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:09.357509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f953b-0558-4f77-82fa-35dc23436960 None admin] PATH_INFO: `/v3/groups/7e6e9e756463478ebd1b8d84b5231530` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:09.364659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f953b-0558-4f77-82fa-35dc23436960 None admin] RBAC: Authorizing `identity:get_group(group_id=7e6e9e756463478ebd1b8d84b5231530)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:09.365523 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f953b-0558-4f77-82fa-35dc23436960 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:09.370373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 186/362] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 13 06:24:09 2022] GET /identity/v3/groups/7e6e9e756463478ebd1b8d84b5231530 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:09.370373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3818644-8dae-464a-b9e4-5e0eb4ab6e64 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:09.370373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3818644-8dae-464a-b9e4-5e0eb4ab6e64 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:09.370373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3818644-8dae-464a-b9e4-5e0eb4ab6e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:09.388979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b3818644-8dae-464a-b9e4-5e0eb4ab6e64 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:09.390172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b3818644-8dae-464a-b9e4-5e0eb4ab6e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:09.422912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cb626e-a290-49ec-bc75-a06b3f29a8c9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:09.465187 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b33ec2-7c7f-4a04-a56c-c3b2a5c2197b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:09.465613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 187/363] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:09.465782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b33ec2-7c7f-4a04-a56c-c3b2a5c2197b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:09.466024 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b33ec2-7c7f-4a04-a56c-c3b2a5c2197b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:09.466404 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b33ec2-7c7f-4a04-a56c-c3b2a5c2197b None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:09.467064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3818644-8dae-464a-b9e4-5e0eb4ab6e64 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:09.468129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b33ec2-7c7f-4a04-a56c-c3b2a5c2197b None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:09.469810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b33ec2-7c7f-4a04-a56c-c3b2a5c2197b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:09.476774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 177/364] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:09 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:09.476774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b33ec2-7c7f-4a04-a56c-c3b2a5c2197b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:09.501434 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:09.565226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:09.592303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3818644-8dae-464a-b9e4-5e0eb4ab6e64 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:09.607261 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b33ec2-7c7f-4a04-a56c-c3b2a5c2197b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:09.638837 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b00d4d-81d3-4ee7-9b5e-fc3ebc0166b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:09.639442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b00d4d-81d3-4ee7-9b5e-fc3ebc0166b1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:09.639717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b00d4d-81d3-4ee7-9b5e-fc3ebc0166b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:09.639986 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b00d4d-81d3-4ee7-9b5e-fc3ebc0166b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:09.640697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b00d4d-81d3-4ee7-9b5e-fc3ebc0166b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:09.640990 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b00d4d-81d3-4ee7-9b5e-fc3ebc0166b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:09.643273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b00d4d-81d3-4ee7-9b5e-fc3ebc0166b1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:09.654367 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 188/365] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:09.655425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b00d4d-81d3-4ee7-9b5e-fc3ebc0166b1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:09.662317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf41034-5fb2-490a-9d0b-03979832349f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:09.662960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf41034-5fb2-490a-9d0b-03979832349f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:09.663297 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf41034-5fb2-490a-9d0b-03979832349f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:09.663569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf41034-5fb2-490a-9d0b-03979832349f None admin] PATH_INFO: `/v3/groups/7e6e9e756463478ebd1b8d84b5231530` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:09.665152 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf41034-5fb2-490a-9d0b-03979832349f None admin] RBAC: Authorizing `identity:get_group(group_id=7e6e9e756463478ebd1b8d84b5231530)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:09.666941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf41034-5fb2-490a-9d0b-03979832349f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:09.669395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 178/366] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 13 06:24:09 2022] GET /identity/v3/groups/7e6e9e756463478ebd1b8d84b5231530 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:09.669971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf41034-5fb2-490a-9d0b-03979832349f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:09.760037 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:09.771573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b00d4d-81d3-4ee7-9b5e-fc3ebc0166b1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:09.788024 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf41034-5fb2-490a-9d0b-03979832349f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:09.812856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d863426-2af9-4601-92ed-ace44b8db575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:09.813784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d863426-2af9-4601-92ed-ace44b8db575 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:09.814567 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d863426-2af9-4601-92ed-ace44b8db575 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:09.814846 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d863426-2af9-4601-92ed-ace44b8db575 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:09.815579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d863426-2af9-4601-92ed-ace44b8db575 None admin] RBAC: Adding query filter params (group.id=7e6e9e756463478ebd1b8d84b5231530, role.id=1147187a70be4f46abe9a5f8d33d98fa, scope.project.id=15e11565450444f8bd36291d4e8e3385) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:09.815889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d863426-2af9-4601-92ed-ace44b8db575 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:09.817344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d863426-2af9-4601-92ed-ace44b8db575 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:09.823818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 189/367] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 13 06:24:09 2022] GET /identity/v3/role_assignments?group.id=7e6e9e756463478ebd1b8d84b5231530&scope.project.id=15e11565450444f8bd36291d4e8e3385&role.id=1147187a70be4f46abe9a5f8d33d98fa => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:09.824970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d863426-2af9-4601-92ed-ace44b8db575 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:09.829599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7094574-323e-4a2d-8ab9-715332192468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:09.830311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7094574-323e-4a2d-8ab9-715332192468 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:09.830531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7094574-323e-4a2d-8ab9-715332192468 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:09.830806 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7094574-323e-4a2d-8ab9-715332192468 None admin] PATH_INFO: `/v3/groups/7e6e9e756463478ebd1b8d84b5231530` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:09.832060 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7094574-323e-4a2d-8ab9-715332192468 None admin] RBAC: Authorizing `identity:get_group(group_id=7e6e9e756463478ebd1b8d84b5231530)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:09.833650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7094574-323e-4a2d-8ab9-715332192468 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:09.835338 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 179/368] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 13 06:24:09 2022] GET /identity/v3/groups/7e6e9e756463478ebd1b8d84b5231530 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:09.836157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7094574-323e-4a2d-8ab9-715332192468 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:09.858353 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:09.968099 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d863426-2af9-4601-92ed-ace44b8db575 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:09.986291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7094574-323e-4a2d-8ab9-715332192468 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:10.011313 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b87bb-a3aa-4004-9d8f-c39734d856cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:10.011847 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b87bb-a3aa-4004-9d8f-c39734d856cf None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:10.012113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b87bb-a3aa-4004-9d8f-c39734d856cf None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:10.012381 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b87bb-a3aa-4004-9d8f-c39734d856cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:10.030395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bd7ad-3146-44b7-9654-0dd50e12d471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:10.031284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bd7ad-3146-44b7-9654-0dd50e12d471 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:10.031696 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bd7ad-3146-44b7-9654-0dd50e12d471 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:10.032103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4bd7ad-3146-44b7-9654-0dd50e12d471 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:10.032930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bd7ad-3146-44b7-9654-0dd50e12d471 None admin] RBAC: Adding query filter params (group.id=7e6e9e756463478ebd1b8d84b5231530, role.id=8727ddb8ab8e4ae4bf2145352def3fb6, scope.project.id=15e11565450444f8bd36291d4e8e3385) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:10.033243 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bd7ad-3146-44b7-9654-0dd50e12d471 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:10.034708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4bd7ad-3146-44b7-9654-0dd50e12d471 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:10.041028 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 180/369] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 13 06:24:09 2022] GET /identity/v3/role_assignments?group.id=7e6e9e756463478ebd1b8d84b5231530&scope.project.id=15e11565450444f8bd36291d4e8e3385&role.id=8727ddb8ab8e4ae4bf2145352def3fb6 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:10.041820 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bd7ad-3146-44b7-9654-0dd50e12d471 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:10.051632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:10.120886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b87bb-a3aa-4004-9d8f-c39734d856cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:10.123784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4b87bb-a3aa-4004-9d8f-c39734d856cf None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:10.158160 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:10.199066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4bd7ad-3146-44b7-9654-0dd50e12d471 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:10.244240 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7c58d-911d-4e21-906b-25904c0924ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:10.245199 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7c58d-911d-4e21-906b-25904c0924ec None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:10.245651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7c58d-911d-4e21-906b-25904c0924ec None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:10.245827 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 190/370] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:10.246230 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd7c58d-911d-4e21-906b-25904c0924ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:10.246853 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b87bb-a3aa-4004-9d8f-c39734d856cf None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:10.259503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd7c58d-911d-4e21-906b-25904c0924ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-0dd7c58d-911d-4e21-906b-25904c0924ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:10.266430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:10.267371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:10.268616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:10.268616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:10.268616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:10.268616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:10.268616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:10.268616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:10.268616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:10.268616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:10.268616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:10.268616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:10.268616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:24:10.268616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:10.268616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 181/371] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:24:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:10.268616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7c58d-911d-4e21-906b-25904c0924ec None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:10.329720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:10.392792 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b87bb-a3aa-4004-9d8f-c39734d856cf None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:10.404465 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd7c58d-911d-4e21-906b-25904c0924ec None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:10.430763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e54a1d-70ee-4a8b-b15b-8fdd0ae9cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:10.431364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e54a1d-70ee-4a8b-b15b-8fdd0ae9cae9 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:10.431640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e54a1d-70ee-4a8b-b15b-8fdd0ae9cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:10.431908 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e54a1d-70ee-4a8b-b15b-8fdd0ae9cae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:10.432632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e54a1d-70ee-4a8b-b15b-8fdd0ae9cae9 None admin] RBAC: Adding query filter params (group.id=7e6e9e756463478ebd1b8d84b5231530, role.id=1147187a70be4f46abe9a5f8d33d98fa, scope.project.id=081387ea09d34bfb94fa762df1c2cd1d) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:10.432986 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e54a1d-70ee-4a8b-b15b-8fdd0ae9cae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:10.434408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e54a1d-70ee-4a8b-b15b-8fdd0ae9cae9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:10.440815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 191/372] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 13 06:24:10 2022] GET /identity/v3/role_assignments?group.id=7e6e9e756463478ebd1b8d84b5231530&scope.project.id=081387ea09d34bfb94fa762df1c2cd1d&role.id=1147187a70be4f46abe9a5f8d33d98fa => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:10.441391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e54a1d-70ee-4a8b-b15b-8fdd0ae9cae9 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:10.449212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:10.464731 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8728e52-eec1-4e50-b57f-43a1b9224fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:10.465394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8728e52-eec1-4e50-b57f-43a1b9224fb5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:10.465670 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8728e52-eec1-4e50-b57f-43a1b9224fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:10.465939 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8728e52-eec1-4e50-b57f-43a1b9224fb5 None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:10.468697 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8728e52-eec1-4e50-b57f-43a1b9224fb5 None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:10.470152 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8728e52-eec1-4e50-b57f-43a1b9224fb5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:10.473154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 182/373] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:10 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:10.477975 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8728e52-eec1-4e50-b57f-43a1b9224fb5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:10.610350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e54a1d-70ee-4a8b-b15b-8fdd0ae9cae9 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:10.636698 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:10.660895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc953f-8540-4c06-8cbc-418ea5ab1c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:10.661527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc953f-8540-4c06-8cbc-418ea5ab1c58 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:10.661806 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc953f-8540-4c06-8cbc-418ea5ab1c58 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:10.662081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc953f-8540-4c06-8cbc-418ea5ab1c58 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:10.662769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc953f-8540-4c06-8cbc-418ea5ab1c58 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:10.663076 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc953f-8540-4c06-8cbc-418ea5ab1c58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:10.669394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc953f-8540-4c06-8cbc-418ea5ab1c58 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:10.686995 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 192/374] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:10.694062 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc953f-8540-4c06-8cbc-418ea5ab1c58 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:10.746797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8728e52-eec1-4e50-b57f-43a1b9224fb5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:10.817357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90ad77-d87c-48b6-9dc5-bac7cfc00981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:10.817996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90ad77-d87c-48b6-9dc5-bac7cfc00981 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:10.818275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90ad77-d87c-48b6-9dc5-bac7cfc00981 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:10.818550 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90ad77-d87c-48b6-9dc5-bac7cfc00981 None admin] PATH_INFO: `/v3/groups/7e6e9e756463478ebd1b8d84b5231530` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:10.820286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90ad77-d87c-48b6-9dc5-bac7cfc00981 None admin] RBAC: Authorizing `identity:get_group(group_id=7e6e9e756463478ebd1b8d84b5231530)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:10.823121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90ad77-d87c-48b6-9dc5-bac7cfc00981 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:10.826355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 183/375] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 13 06:24:10 2022] GET /identity/v3/groups/7e6e9e756463478ebd1b8d84b5231530 => generated 226 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:10.831103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90ad77-d87c-48b6-9dc5-bac7cfc00981 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:10.833517 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc953f-8540-4c06-8cbc-418ea5ab1c58 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:10.905070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874266bd-b591-4322-855b-016a757784ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:10.905705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874266bd-b591-4322-855b-016a757784ca None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:10.905982 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874266bd-b591-4322-855b-016a757784ca None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:10.906260 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874266bd-b591-4322-855b-016a757784ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:10.936510 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:10.974755 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90ad77-d87c-48b6-9dc5-bac7cfc00981 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:10.992500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:11.012982 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a59166-50c5-44e1-8241-55340a9c1b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:11.014505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a59166-50c5-44e1-8241-55340a9c1b50 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:11.014944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a59166-50c5-44e1-8241-55340a9c1b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:11.015381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a59166-50c5-44e1-8241-55340a9c1b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:11.016292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a59166-50c5-44e1-8241-55340a9c1b50 None admin] RBAC: Adding query filter params (group.id=7e6e9e756463478ebd1b8d84b5231530, role.id=8727ddb8ab8e4ae4bf2145352def3fb6, scope.project.id=081387ea09d34bfb94fa762df1c2cd1d) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:11.016797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a59166-50c5-44e1-8241-55340a9c1b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:11.018448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a59166-50c5-44e1-8241-55340a9c1b50 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:11.025860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 184/376] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 13 06:24:10 2022] GET /identity/v3/role_assignments?group.id=7e6e9e756463478ebd1b8d84b5231530&scope.project.id=081387ea09d34bfb94fa762df1c2cd1d&role.id=8727ddb8ab8e4ae4bf2145352def3fb6 => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:11.036715 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874266bd-b591-4322-855b-016a757784ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:11.038231 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874266bd-b591-4322-855b-016a757784ca None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:11.179946 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 193/377] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:11.185951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a59166-50c5-44e1-8241-55340a9c1b50 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:11.312871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a59166-50c5-44e1-8241-55340a9c1b50 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:11.351574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:11.359076 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfc205-52ce-4e92-ac73-c258c5443884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:11.359987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfc205-52ce-4e92-ac73-c258c5443884 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:11.360530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfc205-52ce-4e92-ac73-c258c5443884 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:11.361037 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfc205-52ce-4e92-ac73-c258c5443884 None admin] PATH_INFO: `/v3/projects/275d03b5a7094075b5f8d560d8a5be83` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:11.362432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfc205-52ce-4e92-ac73-c258c5443884 None admin] RBAC: Authorizing `identity:get_project(project_id=275d03b5a7094075b5f8d560d8a5be83)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:11.364066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfc205-52ce-4e92-ac73-c258c5443884 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:11.366263 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 185/378] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:11 2022] GET /identity/v3/projects/275d03b5a7094075b5f8d560d8a5be83 => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:11.371817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874266bd-b591-4322-855b-016a757784ca None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:11.460168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:11.484701 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874266bd-b591-4322-855b-016a757784ca None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:11.527697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec44a4-0500-47fc-a460-8fd8f2ff4085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:11.528335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec44a4-0500-47fc-a460-8fd8f2ff4085 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:11.528617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec44a4-0500-47fc-a460-8fd8f2ff4085 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:11.530264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec44a4-0500-47fc-a460-8fd8f2ff4085 None admin] PATH_INFO: `/v3/groups/b0c5f6f023084ade9459edf59fc5ec07` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:11.541448 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec44a4-0500-47fc-a460-8fd8f2ff4085 None admin] RBAC: Authorizing `identity:get_group(group_id=b0c5f6f023084ade9459edf59fc5ec07)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:11.542894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec44a4-0500-47fc-a460-8fd8f2ff4085 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:11.544848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 194/379] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 13 06:24:11 2022] GET /identity/v3/groups/b0c5f6f023084ade9459edf59fc5ec07 => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:11.550485 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfc205-52ce-4e92-ac73-c258c5443884 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:11.703084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfc205-52ce-4e92-ac73-c258c5443884 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:11.740214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694194d2-c337-4c35-8d4d-40b046a9baa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:11.740771 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694194d2-c337-4c35-8d4d-40b046a9baa3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:11.741050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694194d2-c337-4c35-8d4d-40b046a9baa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:11.741318 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694194d2-c337-4c35-8d4d-40b046a9baa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:11.742052 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694194d2-c337-4c35-8d4d-40b046a9baa3 None admin] RBAC: Adding query filter params (group.id=b0c5f6f023084ade9459edf59fc5ec07, role.id=6382a06103714d068409d25cbeb48744, scope.project.id=275d03b5a7094075b5f8d560d8a5be83) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:11.742358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694194d2-c337-4c35-8d4d-40b046a9baa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:11.743783 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694194d2-c337-4c35-8d4d-40b046a9baa3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:11.753124 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 186/380] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 13 06:24:11 2022] GET /identity/v3/role_assignments?group.id=b0c5f6f023084ade9459edf59fc5ec07&scope.project.id=275d03b5a7094075b5f8d560d8a5be83&role.id=6382a06103714d068409d25cbeb48744 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:12.495058 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fac0d-9b48-4523-99f6-bfefb09f1a9a None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:12.495603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fac0d-9b48-4523-99f6-bfefb09f1a9a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:12.495603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50fac0d-9b48-4523-99f6-bfefb09f1a9a None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:12.497228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 195/381] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:12.502329 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380eabc-64f9-48ec-977a-6cb3afb5fc43 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:12.502613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380eabc-64f9-48ec-977a-6cb3afb5fc43 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:12.502884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380eabc-64f9-48ec-977a-6cb3afb5fc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:12.525641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e380eabc-64f9-48ec-977a-6cb3afb5fc43 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:12.526839 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e380eabc-64f9-48ec-977a-6cb3afb5fc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:12.541311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3496a-a20a-43c1-ab36-2b0f778b636c None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:12.541583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3496a-a20a-43c1-ab36-2b0f778b636c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:12.541856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3496a-a20a-43c1-ab36-2b0f778b636c None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:12.543452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 196/382] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:24:12.548490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73bfc3-32e4-42b0-b0f6-4f51937aa2a8 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:12.548807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73bfc3-32e4-42b0-b0f6-4f51937aa2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:12.549083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73bfc3-32e4-42b0-b0f6-4f51937aa2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:12.581016 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-1b73bfc3-32e4-42b0-b0f6-4f51937aa2a8 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:12.582218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1b73bfc3-32e4-42b0-b0f6-4f51937aa2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:12.624853 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:12.643010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 187/383] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:12.713135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 197/384] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:13.015504 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380eabc-64f9-48ec-977a-6cb3afb5fc43 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:13.028294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e822e-1692-4046-b3ad-b93b9abcdb03 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:13.029480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e822e-1692-4046-b3ad-b93b9abcdb03 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:13.029961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e822e-1692-4046-b3ad-b93b9abcdb03 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:13.032027 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 198/385] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:13.038712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e76b86-fb07-4b31-89c2-e17d519fcdb7 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:13.039258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e76b86-fb07-4b31-89c2-e17d519fcdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:13.043744 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e76b86-fb07-4b31-89c2-e17d519fcdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:13.069133 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-71e76b86-fb07-4b31-89c2-e17d519fcdb7 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:13.070661 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-71e76b86-fb07-4b31-89c2-e17d519fcdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:13.171520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380eabc-64f9-48ec-977a-6cb3afb5fc43 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:13.177244 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 199/386] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:24:13.184689 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e76b86-fb07-4b31-89c2-e17d519fcdb7 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:13.186372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:13.249011 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88796c9b-c139-4dd1-8277-8032131dee79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:13.250033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88796c9b-c139-4dd1-8277-8032131dee79 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:13.250540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88796c9b-c139-4dd1-8277-8032131dee79 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:13.251015 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88796c9b-c139-4dd1-8277-8032131dee79 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:13.269998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88796c9b-c139-4dd1-8277-8032131dee79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-88796c9b-c139-4dd1-8277-8032131dee79 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:13.275216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:13.276101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:13.276913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:13.276913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:13.276913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:13.276913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:13.276913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:13.276913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:13.276913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:13.276913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:13.276913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:13.276913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:13.276913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:24:13.276913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:13.279533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 188/387] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:24:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:13.286231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88796c9b-c139-4dd1-8277-8032131dee79 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:13.355265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e76b86-fb07-4b31-89c2-e17d519fcdb7 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:13.392272 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de344a-3059-4882-bdfb-9f34615eec44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:13.393191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de344a-3059-4882-bdfb-9f34615eec44 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:13.393678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de344a-3059-4882-bdfb-9f34615eec44 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:13.394137 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17de344a-3059-4882-bdfb-9f34615eec44 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:13.404884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17de344a-3059-4882-bdfb-9f34615eec44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-17de344a-3059-4882-bdfb-9f34615eec44 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:13.409904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:13.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:13.411679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:13.411679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:13.411679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:13.411679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:13.411679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:13.411679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:13.411679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:13.411679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:13.411679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:13.411679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:13.411679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:24:13.411679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:13.414273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 200/388] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:13.414377 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:13.420810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de344a-3059-4882-bdfb-9f34615eec44 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:13.488111 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88796c9b-c139-4dd1-8277-8032131dee79 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:13.528533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de22c6-0a88-4728-a2cf-3f268df2d1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:13.529435 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de22c6-0a88-4728-a2cf-3f268df2d1ac None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:13.529862 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de22c6-0a88-4728-a2cf-3f268df2d1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:13.530293 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de22c6-0a88-4728-a2cf-3f268df2d1ac None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:13.531107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de22c6-0a88-4728-a2cf-3f268df2d1ac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:13.531581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de22c6-0a88-4728-a2cf-3f268df2d1ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:13.532093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:13.534280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de22c6-0a88-4728-a2cf-3f268df2d1ac None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:13.543073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 189/389] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:13.548505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de22c6-0a88-4728-a2cf-3f268df2d1ac None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:13.570407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17de344a-3059-4882-bdfb-9f34615eec44 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:13.622177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c426bd-c30e-445b-aa18-ce4c47b28925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:13.630240 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c426bd-c30e-445b-aa18-ce4c47b28925 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:13.630710 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c426bd-c30e-445b-aa18-ce4c47b28925 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:13.631082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c426bd-c30e-445b-aa18-ce4c47b28925 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:13.632180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c426bd-c30e-445b-aa18-ce4c47b28925 None admin] RBAC: Adding query filter params (name=member) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:13.632812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c426bd-c30e-445b-aa18-ce4c47b28925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:13.639573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c426bd-c30e-445b-aa18-ce4c47b28925 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:13.654375 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 201/390] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:24:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:13.655534 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c426bd-c30e-445b-aa18-ce4c47b28925 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:13.673309 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de22c6-0a88-4728-a2cf-3f268df2d1ac None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:13.693411 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:13.714210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8cfb2-d9a6-4c7b-9dc3-7271035e5e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:13.715267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8cfb2-d9a6-4c7b-9dc3-7271035e5e5c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:13.715727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8cfb2-d9a6-4c7b-9dc3-7271035e5e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:13.716176 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a8cfb2-d9a6-4c7b-9dc3-7271035e5e5c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:13.727747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a8cfb2-d9a6-4c7b-9dc3-7271035e5e5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-62a8cfb2-d9a6-4c7b-9dc3-7271035e5e5c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:13.734369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:13.735327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:13.736146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:13.736146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:13.736146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:13.736146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:13.736146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:13.736146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:13.736146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:13.736146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:13.736146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:13.736146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:13.736146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:24:13.736146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:13.737920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 190/391] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:13.738735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8cfb2-d9a6-4c7b-9dc3-7271035e5e5c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:13.779654 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c426bd-c30e-445b-aa18-ce4c47b28925 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:13.808481 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:13.818730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a5022-ebfd-4f20-8628-93da7e25afc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:13.819372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a5022-ebfd-4f20-8628-93da7e25afc8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:13.819998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a5022-ebfd-4f20-8628-93da7e25afc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:13.820282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a5022-ebfd-4f20-8628-93da7e25afc8 None admin] PATH_INFO: `/v3/groups/7e6e9e756463478ebd1b8d84b5231530` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:13.821744 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a5022-ebfd-4f20-8628-93da7e25afc8 None admin] RBAC: Authorizing `identity:get_group(group_id=7e6e9e756463478ebd1b8d84b5231530)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:13.823195 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8a5022-ebfd-4f20-8628-93da7e25afc8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:13.824995 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 202/392] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 13 06:24:13 2022] GET /identity/v3/groups/7e6e9e756463478ebd1b8d84b5231530 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:13.830205 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14ddca-9ba6-4b1e-848f-4d634a3e1931 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:13.830494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14ddca-9ba6-4b1e-848f-4d634a3e1931 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:13.830890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f14ddca-9ba6-4b1e-848f-4d634a3e1931 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:13.832174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 203/393] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:13.836396 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14ddca-9ba6-4b1e-848f-4d634a3e1931 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:13.847553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a8cfb2-d9a6-4c7b-9dc3-7271035e5e5c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:13.884935 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df609d31-bee2-495e-8217-cdc0b8df01d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:13.885650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df609d31-bee2-495e-8217-cdc0b8df01d8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:13.885962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df609d31-bee2-495e-8217-cdc0b8df01d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:13.886246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df609d31-bee2-495e-8217-cdc0b8df01d8 None admin] PATH_INFO: `/v3/groups/7e6e9e756463478ebd1b8d84b5231530` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:13.887456 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df609d31-bee2-495e-8217-cdc0b8df01d8 None admin] RBAC: Authorizing `identity:get_group(group_id=7e6e9e756463478ebd1b8d84b5231530)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:13.889103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df609d31-bee2-495e-8217-cdc0b8df01d8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:13.891075 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 191/394] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 13 06:24:13 2022] GET /identity/v3/groups/7e6e9e756463478ebd1b8d84b5231530 => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:13.891894 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df609d31-bee2-495e-8217-cdc0b8df01d8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:13.936476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f14ddca-9ba6-4b1e-848f-4d634a3e1931 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:13.940953 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:13.971521 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632933e0-2378-4c92-ad80-da04d57f200e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:13.972122 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632933e0-2378-4c92-ad80-da04d57f200e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:13.972412 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632933e0-2378-4c92-ad80-da04d57f200e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:13.972688 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632933e0-2378-4c92-ad80-da04d57f200e None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:13.973357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632933e0-2378-4c92-ad80-da04d57f200e None admin] RBAC: Adding query filter params (name=member) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:13.973661 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632933e0-2378-4c92-ad80-da04d57f200e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:13.975010 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632933e0-2378-4c92-ad80-da04d57f200e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:13.987426 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 204/395] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:24:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:13.987426 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af82c83-5026-448e-8ff2-56bd0073538f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:13.987426 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af82c83-5026-448e-8ff2-56bd0073538f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:13.987426 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af82c83-5026-448e-8ff2-56bd0073538f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:14.003334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9af82c83-5026-448e-8ff2-56bd0073538f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:14.004515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9af82c83-5026-448e-8ff2-56bd0073538f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:14.005472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df609d31-bee2-495e-8217-cdc0b8df01d8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:14.042607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e1cea-339c-49f6-a041-63381a1674d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:14.043227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e1cea-339c-49f6-a041-63381a1674d8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:14.043463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e1cea-339c-49f6-a041-63381a1674d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:14.043702 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e1cea-339c-49f6-a041-63381a1674d8 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:14.045405 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e1cea-339c-49f6-a041-63381a1674d8 None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:14.046840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e1cea-339c-49f6-a041-63381a1674d8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:14.048757 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 192/396] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:13 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:14.049405 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e1cea-339c-49f6-a041-63381a1674d8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:14.064029 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:14.088696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 205/397] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:14.088696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af82c83-5026-448e-8ff2-56bd0073538f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:14.169306 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e1cea-339c-49f6-a041-63381a1674d8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:14.189843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:14.214116 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af82c83-5026-448e-8ff2-56bd0073538f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:14.216057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa01d4a-bcaa-4e1f-83e9-259d01e88a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:14.218144 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa01d4a-bcaa-4e1f-83e9-259d01e88a4d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:14.218503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa01d4a-bcaa-4e1f-83e9-259d01e88a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:14.218844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa01d4a-bcaa-4e1f-83e9-259d01e88a4d None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:14.220043 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa01d4a-bcaa-4e1f-83e9-259d01e88a4d None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:14.221607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa01d4a-bcaa-4e1f-83e9-259d01e88a4d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:14.223749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 193/398] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:14 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:14.224617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa01d4a-bcaa-4e1f-83e9-259d01e88a4d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:14.253326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f78e5-7a75-43ce-bf96-424fb50e76e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:14.254055 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f78e5-7a75-43ce-bf96-424fb50e76e1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:14.254403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f78e5-7a75-43ce-bf96-424fb50e76e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:14.254751 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f78e5-7a75-43ce-bf96-424fb50e76e1 None admin] PATH_INFO: `/v3/groups/7e6e9e756463478ebd1b8d84b5231530` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:14.256215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f78e5-7a75-43ce-bf96-424fb50e76e1 None admin] RBAC: Authorizing `identity:get_group(group_id=7e6e9e756463478ebd1b8d84b5231530)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:14.257825 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f78e5-7a75-43ce-bf96-424fb50e76e1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:14.260030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 206/399] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 13 06:24:14 2022] GET /identity/v3/groups/7e6e9e756463478ebd1b8d84b5231530 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:14.260921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f78e5-7a75-43ce-bf96-424fb50e76e1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:14.320566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:14.338613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa01d4a-bcaa-4e1f-83e9-259d01e88a4d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:14.368232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f78e5-7a75-43ce-bf96-424fb50e76e1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:14.376146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a01f70-6161-48d5-91d1-747af24d8277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:14.376954 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a01f70-6161-48d5-91d1-747af24d8277 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:14.377358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a01f70-6161-48d5-91d1-747af24d8277 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:14.377779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a01f70-6161-48d5-91d1-747af24d8277 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385/groups/7e6e9e756463478ebd1b8d84b5231530/roles/8727ddb8ab8e4ae4bf2145352def3fb6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:14.380113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a01f70-6161-48d5-91d1-747af24d8277 None admin] RBAC: Authorizing `identity:create_grant(project_id=15e11565450444f8bd36291d4e8e3385, group_id=7e6e9e756463478ebd1b8d84b5231530, role_id=8727ddb8ab8e4ae4bf2145352def3fb6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:14.381911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a01f70-6161-48d5-91d1-747af24d8277 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:14.397801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 194/400] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Sep 13 06:24:14 2022] PUT /identity/v3/projects/15e11565450444f8bd36291d4e8e3385/groups/7e6e9e756463478ebd1b8d84b5231530/roles/8727ddb8ab8e4ae4bf2145352def3fb6 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:24:14.398351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a01f70-6161-48d5-91d1-747af24d8277 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:14.407365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e5618-3242-44f6-a511-0aaff678146c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:14.408047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e5618-3242-44f6-a511-0aaff678146c None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:14.408328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e5618-3242-44f6-a511-0aaff678146c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:14.408604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e5618-3242-44f6-a511-0aaff678146c None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385/groups/7e6e9e756463478ebd1b8d84b5231530/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:14.410715 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e5618-3242-44f6-a511-0aaff678146c None admin] RBAC: Authorizing `identity:create_grant(project_id=15e11565450444f8bd36291d4e8e3385, group_id=7e6e9e756463478ebd1b8d84b5231530, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:14.412208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e5618-3242-44f6-a511-0aaff678146c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:14.428327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 207/401] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Sep 13 06:24:14 2022] PUT /identity/v3/projects/15e11565450444f8bd36291d4e8e3385/groups/7e6e9e756463478ebd1b8d84b5231530/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:24:14.429921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a32d23-113f-4030-8e1b-e0f08c5d8306 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:14.430364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a32d23-113f-4030-8e1b-e0f08c5d8306 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:14.430781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a32d23-113f-4030-8e1b-e0f08c5d8306 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:14.432298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 208/402] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:14.433433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a32d23-113f-4030-8e1b-e0f08c5d8306 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:14.462121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:14.547439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a01f70-6161-48d5-91d1-747af24d8277 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:14.582840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a32d23-113f-4030-8e1b-e0f08c5d8306 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:14.594010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04601c1c-2ebe-4039-ae1f-33f3237bee85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:14.594667 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04601c1c-2ebe-4039-ae1f-33f3237bee85 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:14.594947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04601c1c-2ebe-4039-ae1f-33f3237bee85 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:14.595331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04601c1c-2ebe-4039-ae1f-33f3237bee85 None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:14.596560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04601c1c-2ebe-4039-ae1f-33f3237bee85 None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:14.598137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04601c1c-2ebe-4039-ae1f-33f3237bee85 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:14.600834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 195/403] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:14 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:14.602186 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4b5df-6449-4499-994d-993f5e22fa05 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:14.602470 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4b5df-6449-4499-994d-993f5e22fa05 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:14.602745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f4b5df-6449-4499-994d-993f5e22fa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:14.603211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:14.628546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d5f4b5df-6449-4499-994d-993f5e22fa05 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:14.629505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d5f4b5df-6449-4499-994d-993f5e22fa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:14.634313 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fc1d6-d023-4482-a324-6c1513e38abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:14.634952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fc1d6-d023-4482-a324-6c1513e38abd None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:14.635971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fc1d6-d023-4482-a324-6c1513e38abd None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:14.636256 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fc1d6-d023-4482-a324-6c1513e38abd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:14.652651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fc1d6-d023-4482-a324-6c1513e38abd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-cf6fc1d6-d023-4482-a324-6c1513e38abd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:14.657830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:14.658740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:14.659656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:14.659656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:14.659656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:14.659656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:14.659656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:14.659656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:14.659656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:14.659656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:14.659656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:14.659656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:14.659656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:24:14.659656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:14.659656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 209/404] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:24:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:14.660315 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fc1d6-d023-4482-a324-6c1513e38abd None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:14.711722 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 196/405] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:14.717127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4b5df-6449-4499-994d-993f5e22fa05 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:14.784266 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:14.785798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fc1d6-d023-4482-a324-6c1513e38abd None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:14.826804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fbead-5374-4988-b4cc-8d9f0cd63b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:14.828866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fbead-5374-4988-b4cc-8d9f0cd63b1f None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:14.828866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fbead-5374-4988-b4cc-8d9f0cd63b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:14.828866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68fbead-5374-4988-b4cc-8d9f0cd63b1f None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d/groups/7e6e9e756463478ebd1b8d84b5231530/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:14.830212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fbead-5374-4988-b4cc-8d9f0cd63b1f None admin] RBAC: Authorizing `identity:create_grant(project_id=081387ea09d34bfb94fa762df1c2cd1d, group_id=7e6e9e756463478ebd1b8d84b5231530, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:14.831665 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68fbead-5374-4988-b4cc-8d9f0cd63b1f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:14.859097 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 210/406] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Sep 13 06:24:14 2022] PUT /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d/groups/7e6e9e756463478ebd1b8d84b5231530/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:24:14.880067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f4b5df-6449-4499-994d-993f5e22fa05 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:14.921652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c01597-7945-451f-b0a9-c12dbe746222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:14.922655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c01597-7945-451f-b0a9-c12dbe746222 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:14.923217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c01597-7945-451f-b0a9-c12dbe746222 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:14.923687 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c01597-7945-451f-b0a9-c12dbe746222 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:14.924602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c01597-7945-451f-b0a9-c12dbe746222 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:14.925130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c01597-7945-451f-b0a9-c12dbe746222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:14.926711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c01597-7945-451f-b0a9-c12dbe746222 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:14.937519 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 197/407] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:14.944631 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fbead-5374-4988-b4cc-8d9f0cd63b1f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:15.015444 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:15.033509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c01597-7945-451f-b0a9-c12dbe746222 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:15.133967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68fbead-5374-4988-b4cc-8d9f0cd63b1f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:15.175299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:15.178583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb3655-4227-45c2-8509-6a5c5654c153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:15.179359 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb3655-4227-45c2-8509-6a5c5654c153 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:15.179638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb3655-4227-45c2-8509-6a5c5654c153 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:15.179909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fb3655-4227-45c2-8509-6a5c5654c153 None admin] PATH_INFO: `/v3/groups/7e6e9e756463478ebd1b8d84b5231530` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:15.181086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb3655-4227-45c2-8509-6a5c5654c153 None admin] RBAC: Authorizing `identity:get_group(group_id=7e6e9e756463478ebd1b8d84b5231530)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:15.181822 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c01597-7945-451f-b0a9-c12dbe746222 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:15.182943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fb3655-4227-45c2-8509-6a5c5654c153 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:15.184551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 211/408] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 13 06:24:14 2022] GET /identity/v3/groups/7e6e9e756463478ebd1b8d84b5231530 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:15.191284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb3655-4227-45c2-8509-6a5c5654c153 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:15.245394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a657497-edef-4c86-bca7-d7c07037b61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:15.246035 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a657497-edef-4c86-bca7-d7c07037b61f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:15.246314 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a657497-edef-4c86-bca7-d7c07037b61f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:15.246588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a657497-edef-4c86-bca7-d7c07037b61f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:15.271260 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a657497-edef-4c86-bca7-d7c07037b61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-9a657497-edef-4c86-bca7-d7c07037b61f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:15.276608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:15.277561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:15.278384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:15.278384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:15.278384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:15.278384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:15.278384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:15.278384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:15.278384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:15.278384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:15.278384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:15.278384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:15.278384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:24:15.278384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:15.279699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 198/409] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:24:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:15.292644 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a657497-edef-4c86-bca7-d7c07037b61f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:15.398909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fb3655-4227-45c2-8509-6a5c5654c153 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:15.413560 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:15.456192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a657497-edef-4c86-bca7-d7c07037b61f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:15.494323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9b21e-344a-46d8-afb2-fa40fd84da87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:15.495095 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9b21e-344a-46d8-afb2-fa40fd84da87 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:15.495484 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9b21e-344a-46d8-afb2-fa40fd84da87 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:15.495618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31c869-1d54-40a8-8027-05f356ba2155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:15.495965 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f9b21e-344a-46d8-afb2-fa40fd84da87 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:15.496231 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31c869-1d54-40a8-8027-05f356ba2155 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:15.496515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31c869-1d54-40a8-8027-05f356ba2155 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:15.496816 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc31c869-1d54-40a8-8027-05f356ba2155 None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:15.497059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9b21e-344a-46d8-afb2-fa40fd84da87 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:15.497462 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9b21e-344a-46d8-afb2-fa40fd84da87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:15.498961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f9b21e-344a-46d8-afb2-fa40fd84da87 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:15.501365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31c869-1d54-40a8-8027-05f356ba2155 None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:15.502801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc31c869-1d54-40a8-8027-05f356ba2155 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:15.504779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 212/410] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:15 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:15.510347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31c869-1d54-40a8-8027-05f356ba2155 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:15.515768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 199/411] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:15.516405 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9b21e-344a-46d8-afb2-fa40fd84da87 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:15.545277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:15.666888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f9b21e-344a-46d8-afb2-fa40fd84da87 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:15.690715 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc31c869-1d54-40a8-8027-05f356ba2155 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:15.732659 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a3edc-b995-4a7c-8633-de3ea2c82f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:15.733711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a3edc-b995-4a7c-8633-de3ea2c82f47 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:15.735282 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a3edc-b995-4a7c-8633-de3ea2c82f47 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:15.735772 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a3edc-b995-4a7c-8633-de3ea2c82f47 None admin] PATH_INFO: `/v3/groups/b0c5f6f023084ade9459edf59fc5ec07` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:15.738016 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a3edc-b995-4a7c-8633-de3ea2c82f47 None admin] RBAC: Authorizing `identity:get_group(group_id=b0c5f6f023084ade9459edf59fc5ec07)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:15.740399 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a3edc-b995-4a7c-8633-de3ea2c82f47 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:15.749006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 200/412] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 13 06:24:15 2022] GET /identity/v3/groups/b0c5f6f023084ade9459edf59fc5ec07 => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:15.751734 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a3edc-b995-4a7c-8633-de3ea2c82f47 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:15.757643 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6374dfb-56b0-4f79-92a7-3f49397f51c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:15.759360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6374dfb-56b0-4f79-92a7-3f49397f51c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:15.765046 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6374dfb-56b0-4f79-92a7-3f49397f51c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:15.765785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6374dfb-56b0-4f79-92a7-3f49397f51c9 None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d/groups/7e6e9e756463478ebd1b8d84b5231530/roles/8727ddb8ab8e4ae4bf2145352def3fb6` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:15.769113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6374dfb-56b0-4f79-92a7-3f49397f51c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=081387ea09d34bfb94fa762df1c2cd1d, group_id=7e6e9e756463478ebd1b8d84b5231530, role_id=8727ddb8ab8e4ae4bf2145352def3fb6)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:15.770771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6374dfb-56b0-4f79-92a7-3f49397f51c9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:15.815094 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 213/413] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Sep 13 06:24:15 2022] PUT /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d/groups/7e6e9e756463478ebd1b8d84b5231530/roles/8727ddb8ab8e4ae4bf2145352def3fb6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:24:15.869250 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:15.880391 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a3edc-b995-4a7c-8633-de3ea2c82f47 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:15.919532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337d3b0f-baa2-4e69-83f7-b3be25e572df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:15.920696 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d3b0f-baa2-4e69-83f7-b3be25e572df None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:15.921185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d3b0f-baa2-4e69-83f7-b3be25e572df None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:15.921674 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337d3b0f-baa2-4e69-83f7-b3be25e572df None admin] PATH_INFO: `/v3/projects/275d03b5a7094075b5f8d560d8a5be83` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:15.923216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d3b0f-baa2-4e69-83f7-b3be25e572df None admin] RBAC: Authorizing `identity:get_project(project_id=275d03b5a7094075b5f8d560d8a5be83)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:15.925069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337d3b0f-baa2-4e69-83f7-b3be25e572df None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:15.927567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 201/414] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:15 2022] GET /identity/v3/projects/275d03b5a7094075b5f8d560d8a5be83 => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:15.937838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6374dfb-56b0-4f79-92a7-3f49397f51c9 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:15.993865 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:16.113860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6374dfb-56b0-4f79-92a7-3f49397f51c9 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:16.169384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b687f90-4e5d-4b43-b042-d3eafb654c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:16.170619 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b687f90-4e5d-4b43-b042-d3eafb654c38 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:16.170843 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b687f90-4e5d-4b43-b042-d3eafb654c38 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:16.171117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b687f90-4e5d-4b43-b042-d3eafb654c38 None admin] PATH_INFO: `/v3/projects/275d03b5a7094075b5f8d560d8a5be83/groups/b0c5f6f023084ade9459edf59fc5ec07/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:16.177095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b687f90-4e5d-4b43-b042-d3eafb654c38 None admin] RBAC: Authorizing `identity:create_grant(project_id=275d03b5a7094075b5f8d560d8a5be83, group_id=b0c5f6f023084ade9459edf59fc5ec07, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:16.178529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b687f90-4e5d-4b43-b042-d3eafb654c38 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:16.194721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 214/415] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Sep 13 06:24:15 2022] PUT /identity/v3/projects/275d03b5a7094075b5f8d560d8a5be83/groups/b0c5f6f023084ade9459edf59fc5ec07/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:24:16.874966 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c70550-ef3d-4cc6-8dc9-f16d6f61ad29 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:16.876005 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c70550-ef3d-4cc6-8dc9-f16d6f61ad29 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:16.876511 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c70550-ef3d-4cc6-8dc9-f16d6f61ad29 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:16.878082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 202/416] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:16.887792 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb69da-0be4-4293-ab32-37d6cac4d0ca None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:16.888727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb69da-0be4-4293-ab32-37d6cac4d0ca None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:16.889206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb69da-0be4-4293-ab32-37d6cac4d0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:16.917704 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-61cb69da-0be4-4293-ab32-37d6cac4d0ca None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:16.919443 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-61cb69da-0be4-4293-ab32-37d6cac4d0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:16.920903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d5dd5-d185-480c-a8ce-1ff52d1a7982 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:16.921194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d5dd5-d185-480c-a8ce-1ff52d1a7982 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:16.921474 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261d5dd5-d185-480c-a8ce-1ff52d1a7982 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:16.923028 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 203/417] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:16.934531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16df76-af4c-4ef9-bfba-3bc1c0370041 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:16.934818 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16df76-af4c-4ef9-bfba-3bc1c0370041 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:16.935636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc16df76-af4c-4ef9-bfba-3bc1c0370041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:16.973144 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bc16df76-af4c-4ef9-bfba-3bc1c0370041 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:16.975438 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bc16df76-af4c-4ef9-bfba-3bc1c0370041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:17.041028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 215/418] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:17.072239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 204/419] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:24:17.383763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb69da-0be4-4293-ab32-37d6cac4d0ca None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:17.414364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:17.460179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16df76-af4c-4ef9-bfba-3bc1c0370041 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:17.504364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb69da-0be4-4293-ab32-37d6cac4d0ca None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:17.543932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfb70c-b073-4566-8aa1-3b008038db9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:17.544648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfb70c-b073-4566-8aa1-3b008038db9c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:17.550881 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfb70c-b073-4566-8aa1-3b008038db9c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:17.552162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfb70c-b073-4566-8aa1-3b008038db9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:17.567104 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfb70c-b073-4566-8aa1-3b008038db9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-00dfb70c-b073-4566-8aa1-3b008038db9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:17.572283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:17.573191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:17.573983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:17.573983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:17.573983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:17.573983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:17.573983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:17.573983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:17.573983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:17.573983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:17.573983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:17.573983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:17.573983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:24:17.573983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:17.577141 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 216/420] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:24:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:17.583406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfb70c-b073-4566-8aa1-3b008038db9c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:17.651247 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc16df76-af4c-4ef9-bfba-3bc1c0370041 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:17.665749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:17.689124 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420add2-5b45-49e3-8064-d1cc912fc918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:17.689762 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420add2-5b45-49e3-8064-d1cc912fc918 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:17.690046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420add2-5b45-49e3-8064-d1cc912fc918 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:17.690321 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420add2-5b45-49e3-8064-d1cc912fc918 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:17.701794 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:17.702641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420add2-5b45-49e3-8064-d1cc912fc918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-9420add2-5b45-49e3-8064-d1cc912fc918 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:17.707489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:17.713471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:17.714344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:17.714344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:17.714344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:17.714344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:17.714344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:17.714344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:17.714344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:17.714344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:17.714344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:17.714344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:17.714344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:24:17.714344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:17.714344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 205/421] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:24:17.714344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4736d6-e2df-4c95-907e-5dc4cba6f36a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:17.715078 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4736d6-e2df-4c95-907e-5dc4cba6f36a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:17.715078 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4736d6-e2df-4c95-907e-5dc4cba6f36a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:17.716784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 206/422] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:17.717560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4736d6-e2df-4c95-907e-5dc4cba6f36a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:17.732896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfb70c-b073-4566-8aa1-3b008038db9c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:17.781094 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f0c046-6522-452d-9e7e-aee84b01102f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:17.782292 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c046-6522-452d-9e7e-aee84b01102f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:17.783028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c046-6522-452d-9e7e-aee84b01102f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:17.783854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f0c046-6522-452d-9e7e-aee84b01102f None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:17.785478 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0c046-6522-452d-9e7e-aee84b01102f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:17.785970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0c046-6522-452d-9e7e-aee84b01102f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:17.788752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f0c046-6522-452d-9e7e-aee84b01102f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:17.802083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 217/423] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:17.804422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b6ef4-997e-4b0d-9622-dd63fbb58025 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:17.804764 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b6ef4-997e-4b0d-9622-dd63fbb58025 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:17.805031 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b6ef4-997e-4b0d-9622-dd63fbb58025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:17.824470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-465b6ef4-997e-4b0d-9622-dd63fbb58025 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:17.826033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-465b6ef4-997e-4b0d-9622-dd63fbb58025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:17.844805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4736d6-e2df-4c95-907e-5dc4cba6f36a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:17.887176 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751783fc-2c6d-4717-ace8-9027bc0da5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:17.888642 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751783fc-2c6d-4717-ace8-9027bc0da5da None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:17.889194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751783fc-2c6d-4717-ace8-9027bc0da5da None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:17.889681 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751783fc-2c6d-4717-ace8-9027bc0da5da None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:17.890606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751783fc-2c6d-4717-ace8-9027bc0da5da None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:17.891140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751783fc-2c6d-4717-ace8-9027bc0da5da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:17.892795 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751783fc-2c6d-4717-ace8-9027bc0da5da None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:17.906865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 207/425] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:24:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:17.908134 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751783fc-2c6d-4717-ace8-9027bc0da5da None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:17.908826 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 218/425] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:17.909668 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b6ef4-997e-4b0d-9622-dd63fbb58025 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:17.933637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:18.054858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:18.065878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751783fc-2c6d-4717-ace8-9027bc0da5da None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:18.110787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b720a-3b03-4c37-bc93-cc10ae45eaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:18.111692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b720a-3b03-4c37-bc93-cc10ae45eaca None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:18.112437 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b720a-3b03-4c37-bc93-cc10ae45eaca None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:18.113019 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b720a-3b03-4c37-bc93-cc10ae45eaca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:18.121653 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b6ef4-997e-4b0d-9622-dd63fbb58025 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:18.179056 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3148c-6e8f-4f1c-a540-28c0bb653462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:18.179900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3148c-6e8f-4f1c-a540-28c0bb653462 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:18.180388 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3148c-6e8f-4f1c-a540-28c0bb653462 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:18.180833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3148c-6e8f-4f1c-a540-28c0bb653462 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:18.262978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3148c-6e8f-4f1c-a540-28c0bb653462 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:18.264686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3148c-6e8f-4f1c-a540-28c0bb653462 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:18.269047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b720a-3b03-4c37-bc93-cc10ae45eaca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:18.270489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b720a-3b03-4c37-bc93-cc10ae45eaca None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:18.282838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:18.349081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:18.379737 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 219/426] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:18.380937 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3148c-6e8f-4f1c-a540-28c0bb653462 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:18.389372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 208/427] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:18.393776 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b720a-3b03-4c37-bc93-cc10ae45eaca None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:18.508470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3148c-6e8f-4f1c-a540-28c0bb653462 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:18.527165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b720a-3b03-4c37-bc93-cc10ae45eaca None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:18.542900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:18.548246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53245d-cdfd-4007-84bb-2bfb92d871da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:18.549212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53245d-cdfd-4007-84bb-2bfb92d871da None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:18.549632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53245d-cdfd-4007-84bb-2bfb92d871da None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:18.550046 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53245d-cdfd-4007-84bb-2bfb92d871da None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:18.561771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53245d-cdfd-4007-84bb-2bfb92d871da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-0c53245d-cdfd-4007-84bb-2bfb92d871da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:18.567273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:18.568202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:18.569044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:18.569044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:18.569044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:18.569044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:18.569044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:18.569044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:18.569044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:18.569044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:18.569044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:18.569044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:18.569044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 06:24:18.569044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:18.571432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13870c8c-0e40-4052-aeff-c24ba644383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:18.571907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 220/428] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:18.572948 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53245d-cdfd-4007-84bb-2bfb92d871da None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:18.577167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870c8c-0e40-4052-aeff-c24ba644383e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:18.577453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870c8c-0e40-4052-aeff-c24ba644383e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:18.577727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13870c8c-0e40-4052-aeff-c24ba644383e None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:18.579268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13870c8c-0e40-4052-aeff-c24ba644383e None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:18.580736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13870c8c-0e40-4052-aeff-c24ba644383e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:18.582693 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 209/429] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:18 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:18.584239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13870c8c-0e40-4052-aeff-c24ba644383e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:18.617672 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:18.689337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53245d-cdfd-4007-84bb-2bfb92d871da None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:18.697145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13870c8c-0e40-4052-aeff-c24ba644383e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:18.724361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dafb9-cc5c-4dd0-a1a8-48aeb53bb6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:18.725013 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dafb9-cc5c-4dd0-a1a8-48aeb53bb6c2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:18.725288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dafb9-cc5c-4dd0-a1a8-48aeb53bb6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:18.725562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dafb9-cc5c-4dd0-a1a8-48aeb53bb6c2 None admin] PATH_INFO: `/v3/projects/15e11565450444f8bd36291d4e8e3385` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:18.726685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dafb9-cc5c-4dd0-a1a8-48aeb53bb6c2 None admin] RBAC: Authorizing `identity:get_project(project_id=15e11565450444f8bd36291d4e8e3385)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:18.728125 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dafb9-cc5c-4dd0-a1a8-48aeb53bb6c2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:18.729943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 221/430] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:18 2022] GET /identity/v3/projects/15e11565450444f8bd36291d4e8e3385 => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:18.730530 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dafb9-cc5c-4dd0-a1a8-48aeb53bb6c2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:18.740282 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd3f87-fa2b-4dec-8dbf-e491705b9b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:18.741036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd3f87-fa2b-4dec-8dbf-e491705b9b36 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:18.741324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd3f87-fa2b-4dec-8dbf-e491705b9b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:18.741593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd3f87-fa2b-4dec-8dbf-e491705b9b36 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:18.742269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd3f87-fa2b-4dec-8dbf-e491705b9b36 None admin] RBAC: Adding query filter params (name=member) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:18.742574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd3f87-fa2b-4dec-8dbf-e491705b9b36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:18.743953 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd3f87-fa2b-4dec-8dbf-e491705b9b36 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:18.762537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 210/431] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:24:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:18.762537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c128e73-d896-4739-8721-a8e95bceb030 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:18.762537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c128e73-d896-4739-8721-a8e95bceb030 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:18.762537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c128e73-d896-4739-8721-a8e95bceb030 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:18.762537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 211/432] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:18.762537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c128e73-d896-4739-8721-a8e95bceb030 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:18.805970 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:18.847204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dafb9-cc5c-4dd0-a1a8-48aeb53bb6c2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:18.848739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:18.875923 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c128e73-d896-4739-8721-a8e95bceb030 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:18.881695 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11287aa-2868-4f72-996a-8f5cbeb1cb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:18.882312 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11287aa-2868-4f72-996a-8f5cbeb1cb9b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:18.882585 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11287aa-2868-4f72-996a-8f5cbeb1cb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:18.882852 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11287aa-2868-4f72-996a-8f5cbeb1cb9b None admin] PATH_INFO: `/v3/groups/7e6e9e756463478ebd1b8d84b5231530` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:18.883970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11287aa-2868-4f72-996a-8f5cbeb1cb9b None admin] RBAC: Authorizing `identity:get_group(group_id=7e6e9e756463478ebd1b8d84b5231530)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:18.885418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11287aa-2868-4f72-996a-8f5cbeb1cb9b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:18.887147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 222/433] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 13 06:24:18 2022] GET /identity/v3/groups/7e6e9e756463478ebd1b8d84b5231530 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:18.888755 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc826a-5534-4fa9-be2a-03b7f6760661 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:18.889038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc826a-5534-4fa9-be2a-03b7f6760661 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:18.889326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccc826a-5534-4fa9-be2a-03b7f6760661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:18.906907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-eccc826a-5534-4fa9-be2a-03b7f6760661 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:18.908074 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-eccc826a-5534-4fa9-be2a-03b7f6760661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:18.912857 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69442a-9b6e-4cc4-8482-46ce2d8b48f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:18.913488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69442a-9b6e-4cc4-8482-46ce2d8b48f1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:18.913769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69442a-9b6e-4cc4-8482-46ce2d8b48f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:18.914039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d69442a-9b6e-4cc4-8482-46ce2d8b48f1 None admin] PATH_INFO: `/v3/groups/7e6e9e756463478ebd1b8d84b5231530` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:18.915628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69442a-9b6e-4cc4-8482-46ce2d8b48f1 None admin] RBAC: Authorizing `identity:get_group(group_id=7e6e9e756463478ebd1b8d84b5231530)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:18.917458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d69442a-9b6e-4cc4-8482-46ce2d8b48f1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:18.919394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 212/434] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 13 06:24:18 2022] GET /identity/v3/groups/7e6e9e756463478ebd1b8d84b5231530 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:18.920464 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69442a-9b6e-4cc4-8482-46ce2d8b48f1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:18.974060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 223/435] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:18.975472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797aa57-634d-4f0e-952d-103e1a5ee696 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:18.975758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797aa57-634d-4f0e-952d-103e1a5ee696 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:18.976030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797aa57-634d-4f0e-952d-103e1a5ee696 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:18.977293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 224/436] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:18.977980 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797aa57-634d-4f0e-952d-103e1a5ee696 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:19.026133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d69442a-9b6e-4cc4-8482-46ce2d8b48f1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:19.035209 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:19.062717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdbc7f-c4ee-4197-856a-71b318ca68d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:19.063407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdbc7f-c4ee-4197-856a-71b318ca68d5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:19.063686 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdbc7f-c4ee-4197-856a-71b318ca68d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:19.063954 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdbc7f-c4ee-4197-856a-71b318ca68d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:19.097135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:19.101518 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797aa57-634d-4f0e-952d-103e1a5ee696 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:19.136145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdbc7f-c4ee-4197-856a-71b318ca68d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:19.137726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdbc7f-c4ee-4197-856a-71b318ca68d5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:19.139283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca05647-988a-4556-a684-970b87ca6050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:19.139895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca05647-988a-4556-a684-970b87ca6050 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:19.140176 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca05647-988a-4556-a684-970b87ca6050 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:19.140416 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca05647-988a-4556-a684-970b87ca6050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:19.141593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca05647-988a-4556-a684-970b87ca6050 None admin] RBAC: Adding query filter params (group.id=7e6e9e756463478ebd1b8d84b5231530, role.id=1147187a70be4f46abe9a5f8d33d98fa, scope.project.id=15e11565450444f8bd36291d4e8e3385) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:19.141593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca05647-988a-4556-a684-970b87ca6050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:19.142840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca05647-988a-4556-a684-970b87ca6050 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:19.156710 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 225/437] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 13 06:24:18 2022] GET /identity/v3/role_assignments?group.id=7e6e9e756463478ebd1b8d84b5231530&scope.project.id=15e11565450444f8bd36291d4e8e3385&role.id=1147187a70be4f46abe9a5f8d33d98fa => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:19.156710 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca05647-988a-4556-a684-970b87ca6050 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:19.260893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca05647-988a-4556-a684-970b87ca6050 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:19.277215 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 213/438] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:19.277215 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8095d-2b25-40be-9afc-b173adab7b87 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:19.277477 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8095d-2b25-40be-9afc-b173adab7b87 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:19.277549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e8095d-2b25-40be-9afc-b173adab7b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:19.297952 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d9e8095d-2b25-40be-9afc-b173adab7b87 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:19.299003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8c463-d0c4-495f-bc8d-144555ea6eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:19.299247 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d9e8095d-2b25-40be-9afc-b173adab7b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:19.299625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8c463-d0c4-495f-bc8d-144555ea6eb9 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:19.299899 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8c463-d0c4-495f-bc8d-144555ea6eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:19.300166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8c463-d0c4-495f-bc8d-144555ea6eb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:19.300947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8c463-d0c4-495f-bc8d-144555ea6eb9 None admin] RBAC: Adding query filter params (group.id=7e6e9e756463478ebd1b8d84b5231530, role.id=8727ddb8ab8e4ae4bf2145352def3fb6, scope.project.id=15e11565450444f8bd36291d4e8e3385) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:19.301258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8c463-d0c4-495f-bc8d-144555ea6eb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:19.301652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:19.302697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8c463-d0c4-495f-bc8d-144555ea6eb9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:19.309855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 226/439] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 13 06:24:19 2022] GET /identity/v3/role_assignments?group.id=7e6e9e756463478ebd1b8d84b5231530&scope.project.id=15e11565450444f8bd36291d4e8e3385&role.id=8727ddb8ab8e4ae4bf2145352def3fb6 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:19.310944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8c463-d0c4-495f-bc8d-144555ea6eb9 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:19.350650 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:19.404775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 214/440] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:19.404775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8095d-2b25-40be-9afc-b173adab7b87 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:19.460088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8c463-d0c4-495f-bc8d-144555ea6eb9 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:19.502462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dde2e0-59aa-429c-ba42-58ae3b13f120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:19.503101 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dde2e0-59aa-429c-ba42-58ae3b13f120 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:19.503380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dde2e0-59aa-429c-ba42-58ae3b13f120 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:19.503652 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dde2e0-59aa-429c-ba42-58ae3b13f120 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:19.515526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dde2e0-59aa-429c-ba42-58ae3b13f120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-51dde2e0-59aa-429c-ba42-58ae3b13f120 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:19.521228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:19.522132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:19.522947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:19.522947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:19.522947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:19.522947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:19.522947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:19.522947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:19.522947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:19.522947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:19.522947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:19.522947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:19.522947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:24:19.522947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:19.523567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e8095d-2b25-40be-9afc-b173adab7b87 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:19.523640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 227/441] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:24:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:19.528339 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dde2e0-59aa-429c-ba42-58ae3b13f120 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:19.562344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64848a-8fd2-446a-b9b7-591cedd6afd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:19.562986 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64848a-8fd2-446a-b9b7-591cedd6afd3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:19.563262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64848a-8fd2-446a-b9b7-591cedd6afd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:19.563534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64848a-8fd2-446a-b9b7-591cedd6afd3 None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:19.566619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64848a-8fd2-446a-b9b7-591cedd6afd3 None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:19.568058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b64848a-8fd2-446a-b9b7-591cedd6afd3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:19.570012 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 215/442] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:19 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:19.575357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64848a-8fd2-446a-b9b7-591cedd6afd3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:19.587578 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:19.649464 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:19.666300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dde2e0-59aa-429c-ba42-58ae3b13f120 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:19.710093 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64848a-8fd2-446a-b9b7-591cedd6afd3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:19.715590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490145d-1dec-4a3a-8852-f0f8d42553bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:19.716768 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490145d-1dec-4a3a-8852-f0f8d42553bd None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:19.717100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490145d-1dec-4a3a-8852-f0f8d42553bd None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:19.717373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490145d-1dec-4a3a-8852-f0f8d42553bd None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:19.718210 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490145d-1dec-4a3a-8852-f0f8d42553bd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:19.718334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490145d-1dec-4a3a-8852-f0f8d42553bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:19.719694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490145d-1dec-4a3a-8852-f0f8d42553bd None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:19.728997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 228/443] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:19.729821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490145d-1dec-4a3a-8852-f0f8d42553bd None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:19.751079 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2e22f-4b97-46bd-9534-2ff34ef446ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:19.751854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2e22f-4b97-46bd-9534-2ff34ef446ba None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:19.752139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2e22f-4b97-46bd-9534-2ff34ef446ba None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:19.752414 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa2e22f-4b97-46bd-9534-2ff34ef446ba None admin] PATH_INFO: `/v3/groups/7e6e9e756463478ebd1b8d84b5231530` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:19.753567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2e22f-4b97-46bd-9534-2ff34ef446ba None admin] RBAC: Authorizing `identity:get_group(group_id=7e6e9e756463478ebd1b8d84b5231530)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:19.754988 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa2e22f-4b97-46bd-9534-2ff34ef446ba None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:19.756731 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 216/444] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 13 06:24:19 2022] GET /identity/v3/groups/7e6e9e756463478ebd1b8d84b5231530 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:19.757490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2e22f-4b97-46bd-9534-2ff34ef446ba None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:19.844212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490145d-1dec-4a3a-8852-f0f8d42553bd None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:19.847025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:19.876587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa2e22f-4b97-46bd-9534-2ff34ef446ba None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:19.886638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d96bdc-2f41-4964-8e32-d9614f8a68b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:19.887271 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d96bdc-2f41-4964-8e32-d9614f8a68b0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:19.887554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d96bdc-2f41-4964-8e32-d9614f8a68b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:19.889077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d96bdc-2f41-4964-8e32-d9614f8a68b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:19.902680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d96bdc-2f41-4964-8e32-d9614f8a68b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-31d96bdc-2f41-4964-8e32-d9614f8a68b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:19.906048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:19.906916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:19.907727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:19.907727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:19.907727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:19.907727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:19.907727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:19.907727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:19.907727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:19.907727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:19.907727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:19.907727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:19.907727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:24:19.907727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:19.907727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 229/445] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:24:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:19.908379 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d96bdc-2f41-4964-8e32-d9614f8a68b0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:19.919571 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9a3c2-4c1d-481d-837e-ecf1b72bcb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:19.920187 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9a3c2-4c1d-481d-837e-ecf1b72bcb7f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:19.920471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9a3c2-4c1d-481d-837e-ecf1b72bcb7f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:19.920778 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c9a3c2-4c1d-481d-837e-ecf1b72bcb7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:19.921408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:19.987779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9a3c2-4c1d-481d-837e-ecf1b72bcb7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:19.989265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c9a3c2-4c1d-481d-837e-ecf1b72bcb7f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:20.017240 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d96bdc-2f41-4964-8e32-d9614f8a68b0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:20.050213 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ee4b4-5724-4127-a12d-5f046cb3d4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:20.050802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ee4b4-5724-4127-a12d-5f046cb3d4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:20.051076 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ee4b4-5724-4127-a12d-5f046cb3d4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:20.051348 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ee4b4-5724-4127-a12d-5f046cb3d4d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:20.052062 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ee4b4-5724-4127-a12d-5f046cb3d4d2 None admin] RBAC: Adding query filter params (group.id=7e6e9e756463478ebd1b8d84b5231530, role.id=1147187a70be4f46abe9a5f8d33d98fa, scope.project.id=081387ea09d34bfb94fa762df1c2cd1d) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:20.052365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ee4b4-5724-4127-a12d-5f046cb3d4d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:20.053815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ee4b4-5724-4127-a12d-5f046cb3d4d2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:20.059406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 230/446] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 13 06:24:19 2022] GET /identity/v3/role_assignments?group.id=7e6e9e756463478ebd1b8d84b5231530&scope.project.id=081387ea09d34bfb94fa762df1c2cd1d&role.id=1147187a70be4f46abe9a5f8d33d98fa => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:20.060212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ee4b4-5724-4127-a12d-5f046cb3d4d2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:20.060843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:20.102129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 217/447] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:20.107602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9a3c2-4c1d-481d-837e-ecf1b72bcb7f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:20.148966 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:20.177660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ee4b4-5724-4127-a12d-5f046cb3d4d2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:20.214152 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116e89d-e965-44a7-892a-4f21eacb72bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:20.214773 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116e89d-e965-44a7-892a-4f21eacb72bf None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:20.215051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116e89d-e965-44a7-892a-4f21eacb72bf None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:20.215322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116e89d-e965-44a7-892a-4f21eacb72bf None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:20.215416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c9a3c2-4c1d-481d-837e-ecf1b72bcb7f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:20.215999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116e89d-e965-44a7-892a-4f21eacb72bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:20.216895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116e89d-e965-44a7-892a-4f21eacb72bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:20.218330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116e89d-e965-44a7-892a-4f21eacb72bf None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:20.229007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 231/448] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:20.232871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116e89d-e965-44a7-892a-4f21eacb72bf None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:20.256931 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b048131-d49b-4d1e-8a1f-cf16073e013c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:20.257572 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b048131-d49b-4d1e-8a1f-cf16073e013c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:20.257843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b048131-d49b-4d1e-8a1f-cf16073e013c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:20.258113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b048131-d49b-4d1e-8a1f-cf16073e013c None admin] PATH_INFO: `/v3/projects/081387ea09d34bfb94fa762df1c2cd1d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:20.259244 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b048131-d49b-4d1e-8a1f-cf16073e013c None admin] RBAC: Authorizing `identity:get_project(project_id=081387ea09d34bfb94fa762df1c2cd1d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:20.260733 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b048131-d49b-4d1e-8a1f-cf16073e013c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:20.262483 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 218/449] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:20 2022] GET /identity/v3/projects/081387ea09d34bfb94fa762df1c2cd1d => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:20.268600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b048131-d49b-4d1e-8a1f-cf16073e013c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:20.320726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:20.345590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116e89d-e965-44a7-892a-4f21eacb72bf None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:20.386327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d183e-2d75-4fe1-8bee-964a873475df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:20.387535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d183e-2d75-4fe1-8bee-964a873475df None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:20.387535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d183e-2d75-4fe1-8bee-964a873475df None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:20.387535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d183e-2d75-4fe1-8bee-964a873475df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:20.389245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b048131-d49b-4d1e-8a1f-cf16073e013c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:20.391587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:20.438468 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8de56-10de-4001-9443-84ce92a63ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:20.439289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8de56-10de-4001-9443-84ce92a63ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:20.439577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8de56-10de-4001-9443-84ce92a63ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:20.440237 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e8de56-10de-4001-9443-84ce92a63ff0 None admin] PATH_INFO: `/v3/groups/7e6e9e756463478ebd1b8d84b5231530` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:20.441700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8de56-10de-4001-9443-84ce92a63ff0 None admin] RBAC: Authorizing `identity:get_group(group_id=7e6e9e756463478ebd1b8d84b5231530)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:20.443695 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e8de56-10de-4001-9443-84ce92a63ff0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:20.445579 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 219/450] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 13 06:24:20 2022] GET /identity/v3/groups/7e6e9e756463478ebd1b8d84b5231530 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:20.451297 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8de56-10de-4001-9443-84ce92a63ff0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:20.461154 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d183e-2d75-4fe1-8bee-964a873475df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:20.462611 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d183e-2d75-4fe1-8bee-964a873475df None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:20.548677 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e8de56-10de-4001-9443-84ce92a63ff0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:20.558904 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:20.564138 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 232/451] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 06:24:20.565113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d183e-2d75-4fe1-8bee-964a873475df None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:20.582208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbb8d3-1f3e-4a17-8612-f6df9880429b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:20.582807 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbb8d3-1f3e-4a17-8612-f6df9880429b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:20.583082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbb8d3-1f3e-4a17-8612-f6df9880429b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:20.583343 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbb8d3-1f3e-4a17-8612-f6df9880429b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:20.584056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbb8d3-1f3e-4a17-8612-f6df9880429b None admin] RBAC: Adding query filter params (group.id=7e6e9e756463478ebd1b8d84b5231530, role.id=8727ddb8ab8e4ae4bf2145352def3fb6, scope.project.id=081387ea09d34bfb94fa762df1c2cd1d) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:20.584359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbb8d3-1f3e-4a17-8612-f6df9880429b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:20.585795 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbb8d3-1f3e-4a17-8612-f6df9880429b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:20.597046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 220/452] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 13 06:24:20 2022] GET /identity/v3/role_assignments?group.id=7e6e9e756463478ebd1b8d84b5231530&scope.project.id=081387ea09d34bfb94fa762df1c2cd1d&role.id=8727ddb8ab8e4ae4bf2145352def3fb6 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:20.599377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:20.674761 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d183e-2d75-4fe1-8bee-964a873475df None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:20.712970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17159b7d-e67b-4caa-99b2-d8026f38bf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:20.713611 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17159b7d-e67b-4caa-99b2-d8026f38bf70 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:20.713895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17159b7d-e67b-4caa-99b2-d8026f38bf70 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:20.714169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17159b7d-e67b-4caa-99b2-d8026f38bf70 None admin] PATH_INFO: `/v3/projects/275d03b5a7094075b5f8d560d8a5be83` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:20.715385 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17159b7d-e67b-4caa-99b2-d8026f38bf70 None admin] RBAC: Authorizing `identity:get_project(project_id=275d03b5a7094075b5f8d560d8a5be83)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:20.716925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17159b7d-e67b-4caa-99b2-d8026f38bf70 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:20.718619 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 233/453] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:24:20 2022] GET /identity/v3/projects/275d03b5a7094075b5f8d560d8a5be83 => generated 344 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:20.724431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbb8d3-1f3e-4a17-8612-f6df9880429b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:20.826183 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbb8d3-1f3e-4a17-8612-f6df9880429b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:20.860229 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a767015-7c30-4793-bb59-c82ec99e9842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:20.860889 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a767015-7c30-4793-bb59-c82ec99e9842 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:20.861167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a767015-7c30-4793-bb59-c82ec99e9842 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:20.861438 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a767015-7c30-4793-bb59-c82ec99e9842 None admin] PATH_INFO: `/v3/groups/b0c5f6f023084ade9459edf59fc5ec07` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:20.862636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a767015-7c30-4793-bb59-c82ec99e9842 None admin] RBAC: Authorizing `identity:get_group(group_id=b0c5f6f023084ade9459edf59fc5ec07)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:20.864074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a767015-7c30-4793-bb59-c82ec99e9842 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:20.865784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 221/454] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 13 06:24:20 2022] GET /identity/v3/groups/b0c5f6f023084ade9459edf59fc5ec07 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:20.872009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17159b7d-e67b-4caa-99b2-d8026f38bf70 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:20.971170 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17159b7d-e67b-4caa-99b2-d8026f38bf70 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:20.973481 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:21.005308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34e7b8f-0f43-43f2-8069-c0dd2c66e7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:21.005930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e7b8f-0f43-43f2-8069-c0dd2c66e7eb None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:21.006210 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e7b8f-0f43-43f2-8069-c0dd2c66e7eb None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:21.006484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34e7b8f-0f43-43f2-8069-c0dd2c66e7eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:21.007206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e7b8f-0f43-43f2-8069-c0dd2c66e7eb None admin] RBAC: Adding query filter params (group.id=b0c5f6f023084ade9459edf59fc5ec07, role.id=6382a06103714d068409d25cbeb48744, scope.project.id=275d03b5a7094075b5f8d560d8a5be83) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:21.007515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e7b8f-0f43-43f2-8069-c0dd2c66e7eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:21.008956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34e7b8f-0f43-43f2-8069-c0dd2c66e7eb None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:21.014619 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 234/455] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 13 06:24:20 2022] GET /identity/v3/role_assignments?group.id=b0c5f6f023084ade9459edf59fc5ec07&scope.project.id=275d03b5a7094075b5f8d560d8a5be83&role.id=6382a06103714d068409d25cbeb48744 => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:24.377730 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4fb06-4b2c-44ea-ab4a-46375f21bdd4 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:24.378845 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4fb06-4b2c-44ea-ab4a-46375f21bdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:24.379326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4fb06-4b2c-44ea-ab4a-46375f21bdd4 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:24.381372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 222/456] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:24.388300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69015eea-614d-4eaa-a102-6e8b32837bb7 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:24.389309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69015eea-614d-4eaa-a102-6e8b32837bb7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:24.389783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69015eea-614d-4eaa-a102-6e8b32837bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:24.414804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-69015eea-614d-4eaa-a102-6e8b32837bb7 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:24.416359 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-69015eea-614d-4eaa-a102-6e8b32837bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:24.473862 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc464e-2104-487a-864f-4d01b3b4fda0 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:24.474304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc464e-2104-487a-864f-4d01b3b4fda0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:24.475087 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfc464e-2104-487a-864f-4d01b3b4fda0 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:24.478058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 223/457] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:24.492972 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b37b5a-4676-4aa3-8268-f44718ad05d8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:24.493555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b37b5a-4676-4aa3-8268-f44718ad05d8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:24.494545 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b37b5a-4676-4aa3-8268-f44718ad05d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:24.507621 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 235/458] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:24.548381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c0b37b5a-4676-4aa3-8268-f44718ad05d8 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:24.550658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c0b37b5a-4676-4aa3-8268-f44718ad05d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:24.633348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:24.678084 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cfa24-dd95-4890-9d91-0f6497d026f2 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:24.678645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cfa24-dd95-4890-9d91-0f6497d026f2 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:24.679121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85cfa24-dd95-4890-9d91-0f6497d026f2 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:24.680705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 236/459] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:24:24.690458 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9342001-050a-4c8a-a2aa-35bcb367aaf7 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:24.690996 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9342001-050a-4c8a-a2aa-35bcb367aaf7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:24.691465 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9342001-050a-4c8a-a2aa-35bcb367aaf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:24.709034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 224/460] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:24.728105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f9342001-050a-4c8a-a2aa-35bcb367aaf7 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:24.730105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f9342001-050a-4c8a-a2aa-35bcb367aaf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:24.812509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b37b5a-4676-4aa3-8268-f44718ad05d8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:24.883500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 237/461] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:24.987833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9342001-050a-4c8a-a2aa-35bcb367aaf7 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:25.015284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b37b5a-4676-4aa3-8268-f44718ad05d8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:25.046332 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:25.087125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84c8d1d-f850-48fc-9ce8-0bc5e0534f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:25.088355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c8d1d-f850-48fc-9ce8-0bc5e0534f5d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:25.088850 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c8d1d-f850-48fc-9ce8-0bc5e0534f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:25.089300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c8d1d-f850-48fc-9ce8-0bc5e0534f5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:25.112794 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c8d1d-f850-48fc-9ce8-0bc5e0534f5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:25.116446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84c8d1d-f850-48fc-9ce8-0bc5e0534f5d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:25.127174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9342001-050a-4c8a-a2aa-35bcb367aaf7 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f84c8d1d-f850-48fc-9ce8-0bc5e0534f5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:25.151955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:25.152936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:25.154375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:25.154375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:25.154375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:25.154970 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 225/462] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:24:25.157161 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83a4d1-2618-43e0-b6de-5311fdef496a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:25.157472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83a4d1-2618-43e0-b6de-5311fdef496a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:25.157721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c83a4d1-2618-43e0-b6de-5311fdef496a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:25.159006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 226/463] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:25.164393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83a4d1-2618-43e0-b6de-5311fdef496a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:25.173682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcf81fa-00ad-4bc1-a8ff-ec2d03bc7bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:25.174309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf81fa-00ad-4bc1-a8ff-ec2d03bc7bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:25.174584 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf81fa-00ad-4bc1-a8ff-ec2d03bc7bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:25.174851 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcf81fa-00ad-4bc1-a8ff-ec2d03bc7bc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:25.186756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf81fa-00ad-4bc1-a8ff-ec2d03bc7bc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:25.188241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcf81fa-00ad-4bc1-a8ff-ec2d03bc7bc7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:25.197402 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-5dcf81fa-00ad-4bc1-a8ff-ec2d03bc7bc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:25.205544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:25.206466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:25.207333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:25.207333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:25.207333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:25.211491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 238/464] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:24:25.212788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bedd6f-1b97-4353-bb6f-daf8e42ad62e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:25.213069 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bedd6f-1b97-4353-bb6f-daf8e42ad62e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:25.213428 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bedd6f-1b97-4353-bb6f-daf8e42ad62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:25.232470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-70bedd6f-1b97-4353-bb6f-daf8e42ad62e None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:25.233773 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-70bedd6f-1b97-4353-bb6f-daf8e42ad62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:25.295092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c83a4d1-2618-43e0-b6de-5311fdef496a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:25.311532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 239/465] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:25.312965 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bedd6f-1b97-4353-bb6f-daf8e42ad62e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:25.327389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:25.350763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b700d-6312-4917-89ec-1a4260376c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:25.352303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b700d-6312-4917-89ec-1a4260376c3b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:25.352940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b700d-6312-4917-89ec-1a4260376c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:25.353393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b700d-6312-4917-89ec-1a4260376c3b None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:25.354218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b700d-6312-4917-89ec-1a4260376c3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:25.354889 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b700d-6312-4917-89ec-1a4260376c3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:25.357973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7b700d-6312-4917-89ec-1a4260376c3b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:25.374544 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 227/466] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:25.375711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b700d-6312-4917-89ec-1a4260376c3b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:25.445346 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bedd6f-1b97-4353-bb6f-daf8e42ad62e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:25.478805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:25.490049 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91b806-c5af-491f-aec2-8419cedd9da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:25.490973 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91b806-c5af-491f-aec2-8419cedd9da3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:25.491494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91b806-c5af-491f-aec2-8419cedd9da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:25.491771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc91b806-c5af-491f-aec2-8419cedd9da3 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:25.492417 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91b806-c5af-491f-aec2-8419cedd9da3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:25.492748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91b806-c5af-491f-aec2-8419cedd9da3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:25.494853 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc91b806-c5af-491f-aec2-8419cedd9da3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:25.501080 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7b700d-6312-4917-89ec-1a4260376c3b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:25.512525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 240/467] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:25.514397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91b806-c5af-491f-aec2-8419cedd9da3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:25.543782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59a9d-9786-4043-b40d-5b45da3000bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:25.545452 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59a9d-9786-4043-b40d-5b45da3000bf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:25.546245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59a9d-9786-4043-b40d-5b45da3000bf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:25.546727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59a9d-9786-4043-b40d-5b45da3000bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:25.563637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba59a9d-9786-4043-b40d-5b45da3000bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:25.566976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba59a9d-9786-4043-b40d-5b45da3000bf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-3ba59a9d-9786-4043-b40d-5b45da3000bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:25.590119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:25.591067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:25.592499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:25.592499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:25.592499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:25.592499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 228/468] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:25.593195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59a9d-9786-4043-b40d-5b45da3000bf None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:25.605205 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:25.642213 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc91b806-c5af-491f-aec2-8419cedd9da3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:25.683026 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a6738-8cc0-453b-acb5-af370c722894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:25.683642 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a6738-8cc0-453b-acb5-af370c722894 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:25.683915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a6738-8cc0-453b-acb5-af370c722894 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:25.684183 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987a6738-8cc0-453b-acb5-af370c722894 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:25.684903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a6738-8cc0-453b-acb5-af370c722894 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:25.687127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987a6738-8cc0-453b-acb5-af370c722894 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:25.716805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 241/469] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:24:25 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:24:25.716805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a6738-8cc0-453b-acb5-af370c722894 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:25.721798 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59a9d-9786-4043-b40d-5b45da3000bf None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:25.764324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9f759-697c-48ca-9b78-42d586c033ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:25.765435 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f759-697c-48ca-9b78-42d586c033ca None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:25.766127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f759-697c-48ca-9b78-42d586c033ca None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:25.766609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae9f759-697c-48ca-9b78-42d586c033ca None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:25.767576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9f759-697c-48ca-9b78-42d586c033ca None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:25.769339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae9f759-697c-48ca-9b78-42d586c033ca None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:25.780659 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:25.796734 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 229/470] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:24:25 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:24:25.797186 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9f759-697c-48ca-9b78-42d586c033ca None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:25.870480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987a6738-8cc0-453b-acb5-af370c722894 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:25.910639 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:25.922956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caee536-de20-4f54-931f-e6842a4b0e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:25.924009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caee536-de20-4f54-931f-e6842a4b0e07 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:25.924458 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caee536-de20-4f54-931f-e6842a4b0e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:25.925052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caee536-de20-4f54-931f-e6842a4b0e07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:25.934094 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae9f759-697c-48ca-9b78-42d586c033ca None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:25.940843 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caee536-de20-4f54-931f-e6842a4b0e07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:25.941816 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caee536-de20-4f54-931f-e6842a4b0e07 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-9caee536-de20-4f54-931f-e6842a4b0e07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:25.959323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:25.960287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:25.961534 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:25.961534 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:25.961534 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:25.961534 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 242/471] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:25.961883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0954-5f75-4f39-98a6-c4a8f884b471 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:25.962165 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0954-5f75-4f39-98a6-c4a8f884b471 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:25.962440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331f0954-5f75-4f39-98a6-c4a8f884b471 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:25.965640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 243/472] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:25.970389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be2ae6-0fbd-4d19-ade8-ba681d9f81fc None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:25.970635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be2ae6-0fbd-4d19-ade8-ba681d9f81fc None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:25.970861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be2ae6-0fbd-4d19-ade8-ba681d9f81fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:25.984147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c31e7-41e8-48f0-918b-f3ec3cf735c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:25.984816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c31e7-41e8-48f0-918b-f3ec3cf735c1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:25.985094 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c31e7-41e8-48f0-918b-f3ec3cf735c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:25.985364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959c31e7-41e8-48f0-918b-f3ec3cf735c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:25.986012 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c31e7-41e8-48f0-918b-f3ec3cf735c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:25.986312 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c31e7-41e8-48f0-918b-f3ec3cf735c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:25.987674 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959c31e7-41e8-48f0-918b-f3ec3cf735c1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:25.997196 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-c6be2ae6-0fbd-4d19-ade8-ba681d9f81fc None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:25.998968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c6be2ae6-0fbd-4d19-ade8-ba681d9f81fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:26.003320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 230/473] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:26.004161 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c31e7-41e8-48f0-918b-f3ec3cf735c1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:26.066829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:26.083941 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 244/474] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:26.084835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be2ae6-0fbd-4d19-ade8-ba681d9f81fc None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:26.126338 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959c31e7-41e8-48f0-918b-f3ec3cf735c1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:26.165375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23372684-afac-4bd0-8f03-34b7e983eec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:26.166281 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23372684-afac-4bd0-8f03-34b7e983eec8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:26.166577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23372684-afac-4bd0-8f03-34b7e983eec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:26.166847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23372684-afac-4bd0-8f03-34b7e983eec8 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:26.167585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23372684-afac-4bd0-8f03-34b7e983eec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:26.167981 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23372684-afac-4bd0-8f03-34b7e983eec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:26.169990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23372684-afac-4bd0-8f03-34b7e983eec8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:26.183683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 231/475] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:26.189785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23372684-afac-4bd0-8f03-34b7e983eec8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:26.228379 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be2ae6-0fbd-4d19-ade8-ba681d9f81fc None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:26.261020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:26.315999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd1126-7ecc-4004-b729-dc07f805d126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:26.316701 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd1126-7ecc-4004-b729-dc07f805d126 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:26.317008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd1126-7ecc-4004-b729-dc07f805d126 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:26.317336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd1126-7ecc-4004-b729-dc07f805d126 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:26.317989 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd1126-7ecc-4004-b729-dc07f805d126 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:26.319507 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd1126-7ecc-4004-b729-dc07f805d126 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:26.363228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 245/476] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:24:26 2022] POST /identity/v3/users => generated 248 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:24:26.373510 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23372684-afac-4bd0-8f03-34b7e983eec8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:26.395273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd1126-7ecc-4004-b729-dc07f805d126 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:26.397756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:26.432109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526536fe-d9a7-457b-8f20-318941c6b0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:26.434164 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526536fe-d9a7-457b-8f20-318941c6b0dc None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:26.436122 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526536fe-d9a7-457b-8f20-318941c6b0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:26.436697 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526536fe-d9a7-457b-8f20-318941c6b0dc None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:26.437741 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526536fe-d9a7-457b-8f20-318941c6b0dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:26.439475 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526536fe-d9a7-457b-8f20-318941c6b0dc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:26.489738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 232/477] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:24:26 2022] POST /identity/v3/users => generated 249 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:24:26.591939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd1126-7ecc-4004-b729-dc07f805d126 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:26.637888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a861c1-1f7f-4f04-bcab-7b156d109843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:26.638588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a861c1-1f7f-4f04-bcab-7b156d109843 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:26.638863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a861c1-1f7f-4f04-bcab-7b156d109843 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:26.639134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a861c1-1f7f-4f04-bcab-7b156d109843 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:26.639820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a861c1-1f7f-4f04-bcab-7b156d109843 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:26.641296 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a861c1-1f7f-4f04-bcab-7b156d109843 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:26.654561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.sql.core [None req-e8a861c1-1f7f-4f04-bcab-7b156d109843 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 06:24:26.654561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 06:24:26.654561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [parameters: {'id': '8d5247df6da04a288b31cf13bf86131a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 06:24:26.654561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81461) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 06:24:26.672532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-e8a861c1-1f7f-4f04-bcab-7b156d109843 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 06:24:26.672532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:26.672532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 06:24:26.672532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 06:24:26.672532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 06:24:26.672532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 06:24:26.672532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 06:24:26.672532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 06:24:26.672532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 06:24:26.672532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application conn.query(q) Sep 13 06:24:26.672532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 06:24:26.672532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 06:24:26.672532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 06:24:26.672532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application result.read() Sep 13 06:24:26.672532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return ref.to_dict() Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 06:24:26.673719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application next(self.gen) Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application yield resource Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application next(self.gen) Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise self.value Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application session.commit() Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 06:24:26.674838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self.session.flush() Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application compat.raise_( Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 06:24:26.675886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 06:24:26.676838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application conn.query(q) Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application result.read() Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 06:24:26.678712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [parameters: {'id': '8d5247df6da04a288b31cf13bf86131a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:26.680812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 06:24:26.682786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:26.684816 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 246/478] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Sep 13 06:24:26 2022] POST /identity/v3/roles => generated 144 bytes in 284 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:24:26.685874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526536fe-d9a7-457b-8f20-318941c6b0dc None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:26.806877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526536fe-d9a7-457b-8f20-318941c6b0dc None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:26.843886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1f47cf-811a-40fa-9ae9-2227546061d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:26.844934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f47cf-811a-40fa-9ae9-2227546061d1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:26.845454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f47cf-811a-40fa-9ae9-2227546061d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:26.845918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1f47cf-811a-40fa-9ae9-2227546061d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:26.857652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1f47cf-811a-40fa-9ae9-2227546061d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-5b1f47cf-811a-40fa-9ae9-2227546061d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:26.863357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:26.864330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:26.865196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:26.865196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:26.865196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:26.865196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:26.865196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:26.865196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:26.865196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:26.865196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:26.865196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:26.865196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:26.865196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 06:24:26.865196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:26.867908 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 233/479] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:24:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:26.875150 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a861c1-1f7f-4f04-bcab-7b156d109843 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:26.916770 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:27.024267 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a861c1-1f7f-4f04-bcab-7b156d109843 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:27.072851 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f625745-8424-4c4b-b60b-0013ad861223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:27.073730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f625745-8424-4c4b-b60b-0013ad861223 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:27.074148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f625745-8424-4c4b-b60b-0013ad861223 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:27.074608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f625745-8424-4c4b-b60b-0013ad861223 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:27.075424 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f625745-8424-4c4b-b60b-0013ad861223 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:27.076396 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f625745-8424-4c4b-b60b-0013ad861223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:27.077900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f625745-8424-4c4b-b60b-0013ad861223 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:27.086354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 247/480] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:28.524222 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d129949-3b25-4dca-b938-be8677a9257c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:28.524222 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d129949-3b25-4dca-b938-be8677a9257c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:28.524222 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d129949-3b25-4dca-b938-be8677a9257c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:28.525182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 234/481] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:28.530822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7e433-ce85-4713-a585-120167614290 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:28.531224 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7e433-ce85-4713-a585-120167614290 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:28.531386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd7e433-ce85-4713-a585-120167614290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:28.561644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ffd7e433-ce85-4713-a585-120167614290 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:28.562887 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ffd7e433-ce85-4713-a585-120167614290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:28.571788 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce4ab3-e893-446a-892a-84d04efd1a0d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:28.572361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce4ab3-e893-446a-892a-84d04efd1a0d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:28.572874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ce4ab3-e893-446a-892a-84d04efd1a0d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:28.574382 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 235/482] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:24:28.579734 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1a1a3-609f-440e-ae5b-b6db078e361f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:28.580257 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1a1a3-609f-440e-ae5b-b6db078e361f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:28.580816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d1a1a3-609f-440e-ae5b-b6db078e361f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:28.625696 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-44d1a1a3-609f-440e-ae5b-b6db078e361f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:28.627284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-44d1a1a3-609f-440e-ae5b-b6db078e361f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:28.649361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 248/483] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:28.689028 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:28.742266 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 236/484] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:24:28.962121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7e433-ce85-4713-a585-120167614290 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:28.985371 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:29.068523 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1a1a3-609f-440e-ae5b-b6db078e361f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:29.071227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd7e433-ce85-4713-a585-120167614290 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:29.109274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4dbb4-b57f-4d61-8f62-98971c57f8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:29.109911 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4dbb4-b57f-4d61-8f62-98971c57f8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:29.110185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4dbb4-b57f-4d61-8f62-98971c57f8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:29.110453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4dbb4-b57f-4d61-8f62-98971c57f8d0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:29.123087 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf4dbb4-b57f-4d61-8f62-98971c57f8d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-0cf4dbb4-b57f-4d61-8f62-98971c57f8d0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:29.128227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:29.129155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:29.129962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:29.129962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:29.129962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:29.129962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:29.129962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:29.129962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:29.129962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:29.129962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:29.129962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:29.129962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:29.129962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:29.129962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:29.130568 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 249/485] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:29.134996 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4dbb4-b57f-4d61-8f62-98971c57f8d0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:29.256831 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:29.270085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4dbb4-b57f-4d61-8f62-98971c57f8d0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:29.283963 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d1a1a3-609f-440e-ae5b-b6db078e361f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:29.317287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15a08b0-45de-4bae-8da2-49cc9e4eb804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:29.317930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a08b0-45de-4bae-8da2-49cc9e4eb804 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:29.318289 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a08b0-45de-4bae-8da2-49cc9e4eb804 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:29.318563 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a08b0-45de-4bae-8da2-49cc9e4eb804 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:29.319401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a08b0-45de-4bae-8da2-49cc9e4eb804 None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:29.319707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a08b0-45de-4bae-8da2-49cc9e4eb804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:29.321102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15a08b0-45de-4bae-8da2-49cc9e4eb804 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:29.330809 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14233b2-62ec-476e-9f06-379fafcf020d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:29.331095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 250/486] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:29.331613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14233b2-62ec-476e-9f06-379fafcf020d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:29.331959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14233b2-62ec-476e-9f06-379fafcf020d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:29.332240 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14233b2-62ec-476e-9f06-379fafcf020d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:29.332419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25298e-2d8d-4d62-bbd5-6a72d22f95d8 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:29.332702 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25298e-2d8d-4d62-bbd5-6a72d22f95d8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:29.333208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f25298e-2d8d-4d62-bbd5-6a72d22f95d8 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:29.334553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 251/487] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:29.339660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25298e-2d8d-4d62-bbd5-6a72d22f95d8 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:29.343954 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14233b2-62ec-476e-9f06-379fafcf020d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d14233b2-62ec-476e-9f06-379fafcf020d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:29.348779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:29.349673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:29.350765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:29.350765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:29.350765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:29.350765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:29.350765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:29.350765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:29.350765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:29.350765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:29.350765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:29.350765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:29.350765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:29.350765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:29.350765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 237/488] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:24:29.351663 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354a177-a74d-4f42-af6e-ca861f500b01 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:29.351663 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354a177-a74d-4f42-af6e-ca861f500b01 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:29.351663 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4354a177-a74d-4f42-af6e-ca861f500b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:29.370940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4354a177-a74d-4f42-af6e-ca861f500b01 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:29.372284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4354a177-a74d-4f42-af6e-ca861f500b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:29.386777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:29.442318 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 238/489] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:29.443809 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b6e34-16b3-4086-8ef2-9625bb70e998 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:29.444222 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b6e34-16b3-4086-8ef2-9625bb70e998 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:29.444623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b6e34-16b3-4086-8ef2-9625bb70e998 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:29.446008 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 239/490] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:29.446826 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b6e34-16b3-4086-8ef2-9625bb70e998 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:29.473330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f25298e-2d8d-4d62-bbd5-6a72d22f95d8 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:29.521132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ac44d2-674b-4415-bdaa-0bfea0084a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:29.522102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac44d2-674b-4415-bdaa-0bfea0084a11 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:29.522681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac44d2-674b-4415-bdaa-0bfea0084a11 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:29.523279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ac44d2-674b-4415-bdaa-0bfea0084a11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:29.534739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac44d2-674b-4415-bdaa-0bfea0084a11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:29.536290 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ac44d2-674b-4415-bdaa-0bfea0084a11 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:29.538270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-71ac44d2-674b-4415-bdaa-0bfea0084a11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:29.553167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:29.554335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:29.555411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:29.555411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:29.555411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:29.560912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 252/491] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:29.560912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b1dfc-8be9-4e30-b835-13ed9e662af1 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:29.560912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b1dfc-8be9-4e30-b835-13ed9e662af1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:29.560912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101b1dfc-8be9-4e30-b835-13ed9e662af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:29.576807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-101b1dfc-8be9-4e30-b835-13ed9e662af1 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:29.578141 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-101b1dfc-8be9-4e30-b835-13ed9e662af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:29.592255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b6e34-16b3-4086-8ef2-9625bb70e998 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:29.656190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ff4b6-766e-495f-95bf-6bc7c52cc955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:29.656859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ff4b6-766e-495f-95bf-6bc7c52cc955 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:29.657141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ff4b6-766e-495f-95bf-6bc7c52cc955 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:29.657413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221ff4b6-766e-495f-95bf-6bc7c52cc955 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:29.658082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ff4b6-766e-495f-95bf-6bc7c52cc955 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:29.658385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ff4b6-766e-495f-95bf-6bc7c52cc955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:29.659736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221ff4b6-766e-495f-95bf-6bc7c52cc955 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:29.660155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 253/492] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:29.661340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b1dfc-8be9-4e30-b835-13ed9e662af1 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:29.683205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 240/493] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:29.688843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ff4b6-766e-495f-95bf-6bc7c52cc955 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:29.710392 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:29.792929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101b1dfc-8be9-4e30-b835-13ed9e662af1 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:29.818874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221ff4b6-766e-495f-95bf-6bc7c52cc955 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:29.827543 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:29.842150 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03486e-e2ae-4488-89d7-36390231130a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:29.843072 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03486e-e2ae-4488-89d7-36390231130a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:29.843629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03486e-e2ae-4488-89d7-36390231130a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:29.844073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e03486e-e2ae-4488-89d7-36390231130a None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:29.845463 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03486e-e2ae-4488-89d7-36390231130a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:29.845919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03486e-e2ae-4488-89d7-36390231130a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:29.847955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e03486e-e2ae-4488-89d7-36390231130a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:29.855639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97508bb-007d-410c-bac2-7ea6ce167927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:29.856421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97508bb-007d-410c-bac2-7ea6ce167927 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:29.857589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97508bb-007d-410c-bac2-7ea6ce167927 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:29.857816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97508bb-007d-410c-bac2-7ea6ce167927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:29.868132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 254/494] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:29.869265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03486e-e2ae-4488-89d7-36390231130a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:29.872181 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97508bb-007d-410c-bac2-7ea6ce167927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:29.873994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97508bb-007d-410c-bac2-7ea6ce167927 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a97508bb-007d-410c-bac2-7ea6ce167927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:29.893311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:29.894463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:29.895476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:29.895476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:29.895476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:29.901018 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 241/495] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:29.902104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97508bb-007d-410c-bac2-7ea6ce167927 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:29.981417 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:29.990185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e03486e-e2ae-4488-89d7-36390231130a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:30.025431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af302a-4e0a-494a-b374-76629c2e2abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:30.025658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97508bb-007d-410c-bac2-7ea6ce167927 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:30.026060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af302a-4e0a-494a-b374-76629c2e2abb None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:30.026335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af302a-4e0a-494a-b374-76629c2e2abb None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:30.026603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af302a-4e0a-494a-b374-76629c2e2abb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:30.037502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af302a-4e0a-494a-b374-76629c2e2abb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-d7af302a-4e0a-494a-b374-76629c2e2abb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:30.042680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:30.043632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:30.044503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:30.044503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:30.044503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:30.044503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:30.044503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:30.044503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:30.044503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:30.044503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:30.044503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:30.044503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:30.044503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:30.044503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:30.044503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 255/496] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:30.045208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af302a-4e0a-494a-b374-76629c2e2abb None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:30.067029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68517da-935a-4934-96f9-e81b471525de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:30.068102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68517da-935a-4934-96f9-e81b471525de None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:30.068388 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68517da-935a-4934-96f9-e81b471525de None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:30.068684 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68517da-935a-4934-96f9-e81b471525de None admin] PATH_INFO: `/v3/users/nova` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:30.077873 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68517da-935a-4934-96f9-e81b471525de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:30.079344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68517da-935a-4934-96f9-e81b471525de None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a68517da-935a-4934-96f9-e81b471525de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:30.093951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:30.094936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:30.095829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:30.095829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:30.095829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:30.095829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:30.095829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:30.095829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:30.095829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:30.095829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:30.095829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:24:30.095829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:30.097625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:30.100265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 242/497] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 13 06:24:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:30.101279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68517da-935a-4934-96f9-e81b471525de None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:30.156896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af302a-4e0a-494a-b374-76629c2e2abb None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:30.192497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a71b48-6724-4136-8b50-fb91629fb0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:30.193131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71b48-6724-4136-8b50-fb91629fb0ca None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:30.193410 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71b48-6724-4136-8b50-fb91629fb0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:30.193741 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a71b48-6724-4136-8b50-fb91629fb0ca None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:30.194387 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a71b48-6724-4136-8b50-fb91629fb0ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:30.194684 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a71b48-6724-4136-8b50-fb91629fb0ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:30.196046 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a71b48-6724-4136-8b50-fb91629fb0ca None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:30.207419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68517da-935a-4934-96f9-e81b471525de None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:30.208374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 256/498] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:30.209065 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a71b48-6724-4136-8b50-fb91629fb0ca None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:30.233632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:30.245709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de5b29-ca70-4b59-9345-38cf10746d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:30.246339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de5b29-ca70-4b59-9345-38cf10746d3a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:30.246616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de5b29-ca70-4b59-9345-38cf10746d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:30.246886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96de5b29-ca70-4b59-9345-38cf10746d3a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:30.257963 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96de5b29-ca70-4b59-9345-38cf10746d3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-96de5b29-ca70-4b59-9345-38cf10746d3a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:30.263148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:30.264748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:30.265569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:30.265569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:30.265569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:30.265569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:30.265569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:30.265569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:30.265569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:30.265569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:30.265569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:30.265569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:30.265569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:30.265569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:30.265569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 243/499] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:30.266226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de5b29-ca70-4b59-9345-38cf10746d3a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:30.310934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a71b48-6724-4136-8b50-fb91629fb0ca None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:30.313157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:30.345391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d052f0b-2460-494b-aa9b-d28a96c827da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:30.345995 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d052f0b-2460-494b-aa9b-d28a96c827da None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:30.346276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d052f0b-2460-494b-aa9b-d28a96c827da None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:30.346547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d052f0b-2460-494b-aa9b-d28a96c827da None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:30.347199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d052f0b-2460-494b-aa9b-d28a96c827da None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:30.347499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d052f0b-2460-494b-aa9b-d28a96c827da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:30.348883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d052f0b-2460-494b-aa9b-d28a96c827da None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:30.356529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 257/500] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:30.357815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d667b91-5260-4d8d-9e80-73181e120440 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:30.358098 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d667b91-5260-4d8d-9e80-73181e120440 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:30.358371 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d667b91-5260-4d8d-9e80-73181e120440 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:30.359710 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 258/501] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:30.360307 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d667b91-5260-4d8d-9e80-73181e120440 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:30.368918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96de5b29-ca70-4b59-9345-38cf10746d3a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:30.405974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f700ae5-21bb-47ea-883b-9ec4d051fb98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:30.406675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f700ae5-21bb-47ea-883b-9ec4d051fb98 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:30.406956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f700ae5-21bb-47ea-883b-9ec4d051fb98 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:30.407223 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f700ae5-21bb-47ea-883b-9ec4d051fb98 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:30.408299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f700ae5-21bb-47ea-883b-9ec4d051fb98 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:30.408602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f700ae5-21bb-47ea-883b-9ec4d051fb98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:30.410459 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f700ae5-21bb-47ea-883b-9ec4d051fb98 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:30.447744 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 244/502] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 13 06:24:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:30.448574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f700ae5-21bb-47ea-883b-9ec4d051fb98 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:30.469292 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d667b91-5260-4d8d-9e80-73181e120440 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:30.489383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:30.504151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9d6b-5f43-4a4b-aa0f-47c50c45e694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:30.504793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9d6b-5f43-4a4b-aa0f-47c50c45e694 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:30.505074 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9d6b-5f43-4a4b-aa0f-47c50c45e694 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:30.505342 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb9d6b-5f43-4a4b-aa0f-47c50c45e694 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:30.512529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb9d6b-5f43-4a4b-aa0f-47c50c45e694 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:30.514540 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeb9d6b-5f43-4a4b-aa0f-47c50c45e694 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-feeb9d6b-5f43-4a4b-aa0f-47c50c45e694 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:30.527199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:30.528214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:30.529738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:30.529738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:30.529738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:30.529738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:30.529738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:30.529738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:30.529738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:30.529738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:30.529738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:24:30.529738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:30.529738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 259/503] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:30.533799 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9d6b-5f43-4a4b-aa0f-47c50c45e694 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:30.548490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f700ae5-21bb-47ea-883b-9ec4d051fb98 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:30.561136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:30.582490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b41210-7f55-4e01-9a2e-f452e1dc3c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:30.583085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b41210-7f55-4e01-9a2e-f452e1dc3c13 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:30.583367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b41210-7f55-4e01-9a2e-f452e1dc3c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:30.583636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b41210-7f55-4e01-9a2e-f452e1dc3c13 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:30.584292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b41210-7f55-4e01-9a2e-f452e1dc3c13 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:30.584597 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b41210-7f55-4e01-9a2e-f452e1dc3c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:30.585973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b41210-7f55-4e01-9a2e-f452e1dc3c13 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:30.594507 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 245/504] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:30.595711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f941da2-f906-46a3-901e-6bee4fc8a5b8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:30.595994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f941da2-f906-46a3-901e-6bee4fc8a5b8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:30.596264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f941da2-f906-46a3-901e-6bee4fc8a5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:30.613246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0f941da2-f906-46a3-901e-6bee4fc8a5b8 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:30.614428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0f941da2-f906-46a3-901e-6bee4fc8a5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:30.635075 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb9d6b-5f43-4a4b-aa0f-47c50c45e694 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:30.669867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aab74c-501a-4094-ae93-60e15c30fa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:30.670495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aab74c-501a-4094-ae93-60e15c30fa1d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:30.670769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aab74c-501a-4094-ae93-60e15c30fa1d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:30.671038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aab74c-501a-4094-ae93-60e15c30fa1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:30.680849 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 246/505] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:30.681696 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f941da2-f906-46a3-901e-6bee4fc8a5b8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:30.681927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aab74c-501a-4094-ae93-60e15c30fa1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:30.683381 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aab74c-501a-4094-ae93-60e15c30fa1d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-d2aab74c-501a-4094-ae93-60e15c30fa1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:30.697206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:30.698300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:30.699148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:30.699148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:30.699148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:30.699148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 260/506] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:30.699358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aab74c-501a-4094-ae93-60e15c30fa1d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:30.725597 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:30.786603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:30.800698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f941da2-f906-46a3-901e-6bee4fc8a5b8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:30.808889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aab74c-501a-4094-ae93-60e15c30fa1d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:30.838999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433a7fe-19ff-4fc8-8122-4c6ba8d7e046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:30.839525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433a7fe-19ff-4fc8-8122-4c6ba8d7e046 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:30.839806 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433a7fe-19ff-4fc8-8122-4c6ba8d7e046 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:30.840121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433a7fe-19ff-4fc8-8122-4c6ba8d7e046 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:30.841999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d622c66-75ce-43bf-b8e6-06d128492ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:30.842592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d622c66-75ce-43bf-b8e6-06d128492ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:30.842865 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d622c66-75ce-43bf-b8e6-06d128492ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:30.843137 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d622c66-75ce-43bf-b8e6-06d128492ef6 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:30.843855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d622c66-75ce-43bf-b8e6-06d128492ef6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:30.844144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d622c66-75ce-43bf-b8e6-06d128492ef6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:30.845596 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d622c66-75ce-43bf-b8e6-06d128492ef6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:30.886498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 261/507] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Sep 13 06:24:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:30.887367 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d622c66-75ce-43bf-b8e6-06d128492ef6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:30.915191 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433a7fe-19ff-4fc8-8122-4c6ba8d7e046 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:30.916703 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433a7fe-19ff-4fc8-8122-4c6ba8d7e046 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:30.947158 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:30.995609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d622c66-75ce-43bf-b8e6-06d128492ef6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:31.015974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 247/508] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:31.016838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433a7fe-19ff-4fc8-8122-4c6ba8d7e046 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:31.034054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88456ab4-bf81-4b48-b300-191f273caafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:31.034696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88456ab4-bf81-4b48-b300-191f273caafb None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:31.034971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88456ab4-bf81-4b48-b300-191f273caafb None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:31.035237 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88456ab4-bf81-4b48-b300-191f273caafb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:31.037925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:31.046152 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88456ab4-bf81-4b48-b300-191f273caafb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:31.047603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88456ab4-bf81-4b48-b300-191f273caafb None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-88456ab4-bf81-4b48-b300-191f273caafb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:31.062580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:31.063494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:31.069479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:31.069479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:31.069479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:31.069479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 262/509] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:31.069479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88456ab4-bf81-4b48-b300-191f273caafb None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:31.111998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433a7fe-19ff-4fc8-8122-4c6ba8d7e046 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:31.141294 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:31.146553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884f8ac-5746-48a4-a1d2-61788bfc6a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:31.147145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884f8ac-5746-48a4-a1d2-61788bfc6a20 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:31.147422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884f8ac-5746-48a4-a1d2-61788bfc6a20 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:31.147691 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f884f8ac-5746-48a4-a1d2-61788bfc6a20 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:31.148323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884f8ac-5746-48a4-a1d2-61788bfc6a20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:31.148622 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884f8ac-5746-48a4-a1d2-61788bfc6a20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:31.150006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f884f8ac-5746-48a4-a1d2-61788bfc6a20 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:31.161053 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 248/510] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:31.161829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884f8ac-5746-48a4-a1d2-61788bfc6a20 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:31.166111 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88456ab4-bf81-4b48-b300-191f273caafb None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:31.199664 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda1a27-0d11-4211-8779-21d82482cb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:31.200257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda1a27-0d11-4211-8779-21d82482cb9c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:31.200533 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda1a27-0d11-4211-8779-21d82482cb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:31.201403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda1a27-0d11-4211-8779-21d82482cb9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:31.254064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:31.262048 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f884f8ac-5746-48a4-a1d2-61788bfc6a20 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:31.267609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda1a27-0d11-4211-8779-21d82482cb9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:31.269168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda1a27-0d11-4211-8779-21d82482cb9c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:31.295525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aa1fe-f60e-4fe9-8b75-e5c66c33cca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:31.296141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aa1fe-f60e-4fe9-8b75-e5c66c33cca2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:31.296420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aa1fe-f60e-4fe9-8b75-e5c66c33cca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:31.296708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5aa1fe-f60e-4fe9-8b75-e5c66c33cca2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:31.307581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aa1fe-f60e-4fe9-8b75-e5c66c33cca2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:31.309043 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5aa1fe-f60e-4fe9-8b75-e5c66c33cca2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-fd5aa1fe-f60e-4fe9-8b75-e5c66c33cca2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:31.323551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:31.324623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:31.325747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:31.325747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:31.325747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:31.329582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 249/511] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:31.329914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aa1fe-f60e-4fe9-8b75-e5c66c33cca2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:31.366266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 263/512] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:31.367156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda1a27-0d11-4211-8779-21d82482cb9c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:31.375589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:31.429230 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5aa1fe-f60e-4fe9-8b75-e5c66c33cca2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:31.456759 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:31.463578 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda0c1c-a7e7-40a9-81ed-ad60542dd955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:31.464200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0c1c-a7e7-40a9-81ed-ad60542dd955 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:31.464477 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0c1c-a7e7-40a9-81ed-ad60542dd955 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:31.464773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda0c1c-a7e7-40a9-81ed-ad60542dd955 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:31.469401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda1a27-0d11-4211-8779-21d82482cb9c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:31.475110 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda0c1c-a7e7-40a9-81ed-ad60542dd955 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:31.476555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda0c1c-a7e7-40a9-81ed-ad60542dd955 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-9bda0c1c-a7e7-40a9-81ed-ad60542dd955 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:31.490785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:31.491824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:31.492769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:31.492769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:31.492769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:31.492769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 250/513] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:31.493559 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda0c1c-a7e7-40a9-81ed-ad60542dd955 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:31.505780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113055b-e247-4c08-b094-d93d62dddb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:31.506378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113055b-e247-4c08-b094-d93d62dddb3d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:31.506720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113055b-e247-4c08-b094-d93d62dddb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:31.506991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113055b-e247-4c08-b094-d93d62dddb3d None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:31.507624 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113055b-e247-4c08-b094-d93d62dddb3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:31.507923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113055b-e247-4c08-b094-d93d62dddb3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:31.509309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113055b-e247-4c08-b094-d93d62dddb3d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:31.520391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 264/514] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:31.521048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113055b-e247-4c08-b094-d93d62dddb3d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:31.592794 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:31.599531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda0c1c-a7e7-40a9-81ed-ad60542dd955 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:31.620042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113055b-e247-4c08-b094-d93d62dddb3d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:31.633757 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a567829-05a3-4ec4-964b-35ebe95feecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:31.634390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a567829-05a3-4ec4-964b-35ebe95feecf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:31.634670 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a567829-05a3-4ec4-964b-35ebe95feecf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:31.634941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a567829-05a3-4ec4-964b-35ebe95feecf None admin] PATH_INFO: `/v3/users/glance` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:31.642534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a567829-05a3-4ec4-964b-35ebe95feecf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:31.643985 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a567829-05a3-4ec4-964b-35ebe95feecf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2a567829-05a3-4ec4-964b-35ebe95feecf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:31.655602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:31.656721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:31.657637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:31.657637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:31.657637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:31.657637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:31.657637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:31.657637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:31.657637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:31.657637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:31.657637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 06:24:31.657637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:31.657637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 251/515] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:31 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:31.658183 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a567829-05a3-4ec4-964b-35ebe95feecf None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:31.658955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546f54d-7746-47d7-be5d-c07e38f11aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:31.659560 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546f54d-7746-47d7-be5d-c07e38f11aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:31.659845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546f54d-7746-47d7-be5d-c07e38f11aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:31.660115 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546f54d-7746-47d7-be5d-c07e38f11aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:31.661983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546f54d-7746-47d7-be5d-c07e38f11aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:31.661983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546f54d-7746-47d7-be5d-c07e38f11aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:31.663093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546f54d-7746-47d7-be5d-c07e38f11aa1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:31.675506 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 265/516] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:31.676305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546f54d-7746-47d7-be5d-c07e38f11aa1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:31.686958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:31.759006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a567829-05a3-4ec4-964b-35ebe95feecf None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:31.775451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546f54d-7746-47d7-be5d-c07e38f11aa1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:31.791765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e382eb5-6edd-4f84-a7c4-9b5baaf761ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:31.792383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e382eb5-6edd-4f84-a7c4-9b5baaf761ec None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:31.792677 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e382eb5-6edd-4f84-a7c4-9b5baaf761ec None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:31.792965 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e382eb5-6edd-4f84-a7c4-9b5baaf761ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:31.803182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e382eb5-6edd-4f84-a7c4-9b5baaf761ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:31.804619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e382eb5-6edd-4f84-a7c4-9b5baaf761ec None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:31.807604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61aea9-aa9d-47a8-932d-939f161ca61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:31.808192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61aea9-aa9d-47a8-932d-939f161ca61d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:31.808469 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61aea9-aa9d-47a8-932d-939f161ca61d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:31.808774 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61aea9-aa9d-47a8-932d-939f161ca61d None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:31.809406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61aea9-aa9d-47a8-932d-939f161ca61d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:31.809704 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61aea9-aa9d-47a8-932d-939f161ca61d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:31.811560 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe61aea9-aa9d-47a8-932d-939f161ca61d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-4e382eb5-6edd-4f84-a7c4-9b5baaf761ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:31.819854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:31.820779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:31.821612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:31.821612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:31.821612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:31.821612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 252/517] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:31.822489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e382eb5-6edd-4f84-a7c4-9b5baaf761ec None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:31.828953 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 266/518] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:31.828953 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61aea9-aa9d-47a8-932d-939f161ca61d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:31.835291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:31.893851 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:31.922604 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e382eb5-6edd-4f84-a7c4-9b5baaf761ec None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:31.927723 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61aea9-aa9d-47a8-932d-939f161ca61d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:31.956383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc35b2d-2f50-472f-9d2e-c3835b0d2d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:31.957034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc35b2d-2f50-472f-9d2e-c3835b0d2d70 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:31.957312 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc35b2d-2f50-472f-9d2e-c3835b0d2d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:31.957581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc35b2d-2f50-472f-9d2e-c3835b0d2d70 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:31.961605 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7d49b-c8d8-43c7-8565-7aa0b03d3287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:31.962204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7d49b-c8d8-43c7-8565-7aa0b03d3287 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:31.962482 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7d49b-c8d8-43c7-8565-7aa0b03d3287 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:31.962754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba7d49b-c8d8-43c7-8565-7aa0b03d3287 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:31.963474 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7d49b-c8d8-43c7-8565-7aa0b03d3287 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:31.963778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7d49b-c8d8-43c7-8565-7aa0b03d3287 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:31.964880 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc35b2d-2f50-472f-9d2e-c3835b0d2d70 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:31.965242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba7d49b-c8d8-43c7-8565-7aa0b03d3287 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:31.966308 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc35b2d-2f50-472f-9d2e-c3835b0d2d70 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1fc35b2d-2f50-472f-9d2e-c3835b0d2d70 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:31.977678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:31.978582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:31.979489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:31.979489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:31.979489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:31.979489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:31.979489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:31.979489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:31.979489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:31.979489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:31.979489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 06:24:31.979489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:31.979489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 253/519] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:31.980053 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc35b2d-2f50-472f-9d2e-c3835b0d2d70 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:31.984227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 267/520] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Sep 13 06:24:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:31.985080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7d49b-c8d8-43c7-8565-7aa0b03d3287 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:32.043920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:32.077740 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc35b2d-2f50-472f-9d2e-c3835b0d2d70 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:32.082051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba7d49b-c8d8-43c7-8565-7aa0b03d3287 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:32.107875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:32.111123 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9ff86-3145-45b1-b681-a00d3cd0c286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:32.111729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9ff86-3145-45b1-b681-a00d3cd0c286 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:32.112008 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9ff86-3145-45b1-b681-a00d3cd0c286 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:32.112281 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f9ff86-3145-45b1-b681-a00d3cd0c286 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:32.112956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9ff86-3145-45b1-b681-a00d3cd0c286 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:32.114376 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f9ff86-3145-45b1-b681-a00d3cd0c286 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:32.117108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7a0f6-af22-4426-a2a8-41ee1fc06675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:32.117702 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7a0f6-af22-4426-a2a8-41ee1fc06675 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:32.117981 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7a0f6-af22-4426-a2a8-41ee1fc06675 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:32.118253 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7a0f6-af22-4426-a2a8-41ee1fc06675 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:32.118889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7a0f6-af22-4426-a2a8-41ee1fc06675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:32.119191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7a0f6-af22-4426-a2a8-41ee1fc06675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:32.120832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7a0f6-af22-4426-a2a8-41ee1fc06675 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:32.132734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 268/521] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:32.133547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7a0f6-af22-4426-a2a8-41ee1fc06675 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:32.142477 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 254/522] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:24:31 2022] POST /identity/v3/users => generated 247 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:24:32.142477 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9ff86-3145-45b1-b681-a00d3cd0c286 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:32.245788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7a0f6-af22-4426-a2a8-41ee1fc06675 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:32.270857 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f9ff86-3145-45b1-b681-a00d3cd0c286 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:32.281488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4606cc-3b78-4ce9-9b2f-9a06eb5584aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:32.282137 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4606cc-3b78-4ce9-9b2f-9a06eb5584aa None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:32.282414 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4606cc-3b78-4ce9-9b2f-9a06eb5584aa None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:32.282683 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4606cc-3b78-4ce9-9b2f-9a06eb5584aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:32.290023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4606cc-3b78-4ce9-9b2f-9a06eb5584aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:32.291460 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4606cc-3b78-4ce9-9b2f-9a06eb5584aa None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:32.299349 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:32.305844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-5a4606cc-3b78-4ce9-9b2f-9a06eb5584aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:32.305844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:32.305844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:32.305844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:32.305844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:32.305844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:32.305844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:32.305844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:32.305844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:32.305844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:32.305844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:32.305844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:32.305844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:32.305844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:32.305844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:32.307004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:32.308060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:32.308060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:32.308060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:32.308060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:32.308060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:32.308060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:32.308060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:32.308060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:32.308060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 269/523] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:32.308830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4606cc-3b78-4ce9-9b2f-9a06eb5584aa None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:32.318767 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ca499-87aa-4a5a-af9d-d060d21eea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:32.319480 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ca499-87aa-4a5a-af9d-d060d21eea2b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:32.319832 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ca499-87aa-4a5a-af9d-d060d21eea2b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:32.320113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789ca499-87aa-4a5a-af9d-d060d21eea2b None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:32.320927 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ca499-87aa-4a5a-af9d-d060d21eea2b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:32.321241 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ca499-87aa-4a5a-af9d-d060d21eea2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:32.322714 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789ca499-87aa-4a5a-af9d-d060d21eea2b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:32.344777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 255/524] 10.222.0.42 () {56 vars in 1139 bytes} [Tue Sep 13 06:24:32 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:32.345701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ca499-87aa-4a5a-af9d-d060d21eea2b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:32.374130 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:32.430624 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4606cc-3b78-4ce9-9b2f-9a06eb5584aa None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:32.457914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789ca499-87aa-4a5a-af9d-d060d21eea2b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:32.465875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0de1f-b050-4386-9bc5-c3ecfa6a837b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:32.467076 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0de1f-b050-4386-9bc5-c3ecfa6a837b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:32.467358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0de1f-b050-4386-9bc5-c3ecfa6a837b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:32.467632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a0de1f-b050-4386-9bc5-c3ecfa6a837b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:32.500652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbe850-ba24-47c6-aee1-c035b371c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:32.501587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbe850-ba24-47c6-aee1-c035b371c348 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:32.502044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbe850-ba24-47c6-aee1-c035b371c348 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:32.502598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fbe850-ba24-47c6-aee1-c035b371c348 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:32.509826 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbe850-ba24-47c6-aee1-c035b371c348 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:32.511621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fbe850-ba24-47c6-aee1-c035b371c348 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:32.524346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-a5fbe850-ba24-47c6-aee1-c035b371c348 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:32.524346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:32.524346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:32.524346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:32.524346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:32.524346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:32.524346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:32.524346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:32.524346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:32.524346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:32.524346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:32.524346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:32.524346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:32.524346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:32.524346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:32.525264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:32.526112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:32.526112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:32.526112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:32.526112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:32.526112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:32.526112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:32.526112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:32.526112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:32.533130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 256/525] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:32.534218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbe850-ba24-47c6-aee1-c035b371c348 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:32.538054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0de1f-b050-4386-9bc5-c3ecfa6a837b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:32.539631 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a0de1f-b050-4386-9bc5-c3ecfa6a837b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:32.579629 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:32.588538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:32.649104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fbe850-ba24-47c6-aee1-c035b371c348 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:32.649634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 270/526] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:32.650989 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0de1f-b050-4386-9bc5-c3ecfa6a837b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:32.687829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50af45e-ceb3-425e-95b0-3ff8d06ea377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:32.688548 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50af45e-ceb3-425e-95b0-3ff8d06ea377 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:32.688865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50af45e-ceb3-425e-95b0-3ff8d06ea377 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:32.689138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50af45e-ceb3-425e-95b0-3ff8d06ea377 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:32.689829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50af45e-ceb3-425e-95b0-3ff8d06ea377 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:32.690135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50af45e-ceb3-425e-95b0-3ff8d06ea377 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:32.691550 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50af45e-ceb3-425e-95b0-3ff8d06ea377 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:32.710334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 257/527] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:32.711157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50af45e-ceb3-425e-95b0-3ff8d06ea377 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:32.767037 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a0de1f-b050-4386-9bc5-c3ecfa6a837b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:32.800302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095b80b-d4e7-4569-84f2-7732e84ae6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:32.800935 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095b80b-d4e7-4569-84f2-7732e84ae6f5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:32.801209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095b80b-d4e7-4569-84f2-7732e84ae6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:32.801476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095b80b-d4e7-4569-84f2-7732e84ae6f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:32.817508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:32.820301 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50af45e-ceb3-425e-95b0-3ff8d06ea377 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:32.821996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:32.858750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72314588-b577-4947-9bd7-fe9ab2efb9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:32.859363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72314588-b577-4947-9bd7-fe9ab2efb9cf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:32.859636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72314588-b577-4947-9bd7-fe9ab2efb9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:32.859905 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72314588-b577-4947-9bd7-fe9ab2efb9cf None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:32.860591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72314588-b577-4947-9bd7-fe9ab2efb9cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:32.860914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72314588-b577-4947-9bd7-fe9ab2efb9cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:32.862334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72314588-b577-4947-9bd7-fe9ab2efb9cf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:32.873347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095b80b-d4e7-4569-84f2-7732e84ae6f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:32.879502 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 258/528] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:32.879671 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095b80b-d4e7-4569-84f2-7732e84ae6f5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:32.879752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72314588-b577-4947-9bd7-fe9ab2efb9cf None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:32.980528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72314588-b577-4947-9bd7-fe9ab2efb9cf None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:32.983005 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 271/529] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:32.983988 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095b80b-d4e7-4569-84f2-7732e84ae6f5 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:33.016198 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7f798-c573-49dc-bba8-23b02e44527f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:33.016860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7f798-c573-49dc-bba8-23b02e44527f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:33.017359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7f798-c573-49dc-bba8-23b02e44527f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:33.017581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc7f798-c573-49dc-bba8-23b02e44527f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:33.029598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:33.031860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7f798-c573-49dc-bba8-23b02e44527f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:33.033461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc7f798-c573-49dc-bba8-23b02e44527f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-4cc7f798-c573-49dc-bba8-23b02e44527f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:33.048212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:33.054497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:33.055425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:33.055425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:33.055425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:33.055425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 259/530] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:33.055425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7f798-c573-49dc-bba8-23b02e44527f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:33.071553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:33.095800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095b80b-d4e7-4569-84f2-7732e84ae6f5 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:33.131810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1039bf8-9c32-4ff9-84f1-7e5f87fe8c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:33.132403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1039bf8-9c32-4ff9-84f1-7e5f87fe8c2f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:33.132702 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1039bf8-9c32-4ff9-84f1-7e5f87fe8c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:33.132971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1039bf8-9c32-4ff9-84f1-7e5f87fe8c2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:33.133781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1039bf8-9c32-4ff9-84f1-7e5f87fe8c2f None admin] RBAC: Adding query filter params (role.id=dc60d33cb0c649b3b903d99258a19c98, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=7fbb67072ba544e39073787eb25fcf1e) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:33.134087 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1039bf8-9c32-4ff9-84f1-7e5f87fe8c2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:33.135517 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1039bf8-9c32-4ff9-84f1-7e5f87fe8c2f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:33.152686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 272/531] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:24:32 2022] GET /identity/v3/role_assignments?user.id=7fbb67072ba544e39073787eb25fcf1e&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=dc60d33cb0c649b3b903d99258a19c98 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:33.152686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1039bf8-9c32-4ff9-84f1-7e5f87fe8c2f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:33.180163 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc7f798-c573-49dc-bba8-23b02e44527f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:33.223376 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de637b56-4ebc-4e83-bf32-dfdd81464213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:33.224162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de637b56-4ebc-4e83-bf32-dfdd81464213 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:33.224560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de637b56-4ebc-4e83-bf32-dfdd81464213 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:33.225005 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de637b56-4ebc-4e83-bf32-dfdd81464213 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:33.225838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de637b56-4ebc-4e83-bf32-dfdd81464213 None admin] RBAC: Adding query filter params (role.id=dc60d33cb0c649b3b903d99258a19c98, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=8789ed5fef2148e69e9e444d7cfe1e19) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:33.226260 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de637b56-4ebc-4e83-bf32-dfdd81464213 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:33.227953 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de637b56-4ebc-4e83-bf32-dfdd81464213 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:33.234754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 260/532] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:24:33 2022] GET /identity/v3/role_assignments?user.id=8789ed5fef2148e69e9e444d7cfe1e19&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=dc60d33cb0c649b3b903d99258a19c98 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:33.235912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de637b56-4ebc-4e83-bf32-dfdd81464213 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:33.287481 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1039bf8-9c32-4ff9-84f1-7e5f87fe8c2f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:33.306429 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:33.342879 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:33.370726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba584b-f5ed-4281-a685-b719c0051cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:33.371385 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba584b-f5ed-4281-a685-b719c0051cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:33.371659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba584b-f5ed-4281-a685-b719c0051cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:33.371925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba584b-f5ed-4281-a685-b719c0051cb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:33.372940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de637b56-4ebc-4e83-bf32-dfdd81464213 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:33.401929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba584b-f5ed-4281-a685-b719c0051cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:33.403460 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba584b-f5ed-4281-a685-b719c0051cb6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-ecba584b-f5ed-4281-a685-b719c0051cb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:33.425093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:33.426070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:33.426927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:33.426927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:33.426927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:33.427536 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398b252-e8ca-4602-a34e-605b212c5d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:33.427746 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b252-e8ca-4602-a34e-605b212c5d20 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:33.428012 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b252-e8ca-4602-a34e-605b212c5d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:33.428285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398b252-e8ca-4602-a34e-605b212c5d20 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:33.428957 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398b252-e8ca-4602-a34e-605b212c5d20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:33.429262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398b252-e8ca-4602-a34e-605b212c5d20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:33.430811 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 273/533] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:33.431315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8398b252-e8ca-4602-a34e-605b212c5d20 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:33.431790 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba584b-f5ed-4281-a685-b719c0051cb6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:33.447325 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 261/534] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:33.454732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398b252-e8ca-4602-a34e-605b212c5d20 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:33.572248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba584b-f5ed-4281-a685-b719c0051cb6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:33.583049 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398b252-e8ca-4602-a34e-605b212c5d20 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:33.639593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bd438-3b85-46c8-9e05-18b25345e314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:33.642990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bd438-3b85-46c8-9e05-18b25345e314 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:33.642990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bd438-3b85-46c8-9e05-18b25345e314 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:33.642990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98bd438-3b85-46c8-9e05-18b25345e314 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:33.651120 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bd438-3b85-46c8-9e05-18b25345e314 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:33.652869 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98bd438-3b85-46c8-9e05-18b25345e314 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:33.666002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b98bd438-3b85-46c8-9e05-18b25345e314 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:33.666002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:33.666002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:33.666002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:33.666002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:33.666002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:33.666002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:33.666002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:33.666002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:33.666002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:33.666002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:33.666002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:33.666002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:33.666002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:33.666002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:33.667059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:33.668114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:33.668114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:33.668114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:33.668114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:33.668114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:33.668114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:33.668114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:33.668114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:33.670464 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:33.670780 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 262/535] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:33.676526 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bd438-3b85-46c8-9e05-18b25345e314 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:33.677984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafa482-2fa6-4dc6-a8c1-31ca16b25378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:33.678618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafa482-2fa6-4dc6-a8c1-31ca16b25378 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:33.678903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafa482-2fa6-4dc6-a8c1-31ca16b25378 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:33.679176 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acafa482-2fa6-4dc6-a8c1-31ca16b25378 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:33.679832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acafa482-2fa6-4dc6-a8c1-31ca16b25378 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:33.680137 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acafa482-2fa6-4dc6-a8c1-31ca16b25378 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:33.683853 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acafa482-2fa6-4dc6-a8c1-31ca16b25378 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:33.718931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 274/536] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:33.729651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafa482-2fa6-4dc6-a8c1-31ca16b25378 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:33.784708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98bd438-3b85-46c8-9e05-18b25345e314 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:33.791528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:33.820752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3cf6c-0b95-4ad6-8c94-6c62cde26501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:33.821358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3cf6c-0b95-4ad6-8c94-6c62cde26501 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:33.821636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3cf6c-0b95-4ad6-8c94-6c62cde26501 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:33.821905 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca3cf6c-0b95-4ad6-8c94-6c62cde26501 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:33.822651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3cf6c-0b95-4ad6-8c94-6c62cde26501 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:33.822900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3cf6c-0b95-4ad6-8c94-6c62cde26501 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:33.824326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca3cf6c-0b95-4ad6-8c94-6c62cde26501 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:33.837416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 263/537] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:33.843099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3cf6c-0b95-4ad6-8c94-6c62cde26501 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:33.905430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:33.969107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca3cf6c-0b95-4ad6-8c94-6c62cde26501 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:33.980110 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acafa482-2fa6-4dc6-a8c1-31ca16b25378 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:34.028391 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b39a88-0263-4dba-b79c-20e19f83582b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:34.029982 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b39a88-0263-4dba-b79c-20e19f83582b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:34.030444 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b39a88-0263-4dba-b79c-20e19f83582b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:34.030916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b39a88-0263-4dba-b79c-20e19f83582b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:34.032183 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b39a88-0263-4dba-b79c-20e19f83582b None admin] RBAC: Adding query filter params (role.id=dc60d33cb0c649b3b903d99258a19c98, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=ddc0c92f881e40c9abe067d3a6d4251b) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:34.032690 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b39a88-0263-4dba-b79c-20e19f83582b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:34.035324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b39a88-0263-4dba-b79c-20e19f83582b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:34.046897 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 264/538] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:24:33 2022] GET /identity/v3/role_assignments?user.id=ddc0c92f881e40c9abe067d3a6d4251b&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=dc60d33cb0c649b3b903d99258a19c98 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:34.097878 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980677de-fdf4-4ac2-8de8-4fc32fb1ad68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:34.098734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980677de-fdf4-4ac2-8de8-4fc32fb1ad68 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:34.099151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980677de-fdf4-4ac2-8de8-4fc32fb1ad68 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:34.099569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980677de-fdf4-4ac2-8de8-4fc32fb1ad68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:34.118393 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980677de-fdf4-4ac2-8de8-4fc32fb1ad68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:34.121149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980677de-fdf4-4ac2-8de8-4fc32fb1ad68 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:34.150082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-980677de-fdf4-4ac2-8de8-4fc32fb1ad68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:34.150082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:34.150082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:34.150082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:34.150082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:34.150082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:34.150082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:34.150082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:34.150082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:34.150082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:34.150082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:34.150082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:34.150082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:34.150082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:34.150082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:34.151024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:34.151859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:34.151859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:34.151859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:34.151859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:34.151859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:34.151859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:34.151859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:34.151859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:34.151859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 275/539] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:34.160617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b39a88-0263-4dba-b79c-20e19f83582b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:34.325843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b39a88-0263-4dba-b79c-20e19f83582b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:34.350320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:34.362604 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ee64a-25ad-41dc-b9fb-2b0cd6435451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:34.363209 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ee64a-25ad-41dc-b9fb-2b0cd6435451 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:34.363486 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ee64a-25ad-41dc-b9fb-2b0cd6435451 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:34.363755 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ee64a-25ad-41dc-b9fb-2b0cd6435451 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:34.364453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ee64a-25ad-41dc-b9fb-2b0cd6435451 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:34.364792 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ee64a-25ad-41dc-b9fb-2b0cd6435451 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:34.366421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ee64a-25ad-41dc-b9fb-2b0cd6435451 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:34.380535 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 265/540] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:34.386325 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980677de-fdf4-4ac2-8de8-4fc32fb1ad68 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:34.495212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:34.516101 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980677de-fdf4-4ac2-8de8-4fc32fb1ad68 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:34.546117 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827dfac-5b1e-4336-b1cb-a57444448b18 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:34.546430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827dfac-5b1e-4336-b1cb-a57444448b18 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:34.546664 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0827dfac-5b1e-4336-b1cb-a57444448b18 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:34.548339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 266/541] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:34.553917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d23f-3754-4e80-9971-7e2e7de50f62 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:34.554202 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d23f-3754-4e80-9971-7e2e7de50f62 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:34.554477 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664d23f-3754-4e80-9971-7e2e7de50f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:34.567610 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2064745-3ef6-4e2a-be71-54d70df81d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:34.568277 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2064745-3ef6-4e2a-be71-54d70df81d7f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:34.568549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2064745-3ef6-4e2a-be71-54d70df81d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:34.568847 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2064745-3ef6-4e2a-be71-54d70df81d7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:34.569658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2064745-3ef6-4e2a-be71-54d70df81d7f None admin] RBAC: Adding query filter params (role.id=dc60d33cb0c649b3b903d99258a19c98, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=a5efc921a219444bb0b45e8b4d08dcc5) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:34.569963 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2064745-3ef6-4e2a-be71-54d70df81d7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:34.571469 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2064745-3ef6-4e2a-be71-54d70df81d7f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:34.573763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4664d23f-3754-4e80-9971-7e2e7de50f62 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:34.574955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4664d23f-3754-4e80-9971-7e2e7de50f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:34.585136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 276/542] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:24:34 2022] GET /identity/v3/role_assignments?user.id=a5efc921a219444bb0b45e8b4d08dcc5&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=dc60d33cb0c649b3b903d99258a19c98 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:34.663131 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 267/543] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:34.970450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2064745-3ef6-4e2a-be71-54d70df81d7f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:35.088886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2064745-3ef6-4e2a-be71-54d70df81d7f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:35.133525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e676d-1bd4-4c32-9b00-7c0d62c81c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:35.134508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e676d-1bd4-4c32-9b00-7c0d62c81c7c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:35.135006 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e676d-1bd4-4c32-9b00-7c0d62c81c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:35.135473 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780e676d-1bd4-4c32-9b00-7c0d62c81c7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:35.149192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780e676d-1bd4-4c32-9b00-7c0d62c81c7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-780e676d-1bd4-4c32-9b00-7c0d62c81c7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:35.155439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:35.156333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:35.157201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:35.157201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:35.157201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:35.157201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:35.157201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:35.157201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:35.157201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:35.157201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:35.157201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:35.157201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:35.157201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:35.157201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:35.159406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 277/544] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:35.165333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d23f-3754-4e80-9971-7e2e7de50f62 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:35.267017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664d23f-3754-4e80-9971-7e2e7de50f62 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:35.280618 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:35.302281 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019d69-8e4a-45f7-b679-80d5861754ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:35.302885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019d69-8e4a-45f7-b679-80d5861754ca None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:35.303161 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019d69-8e4a-45f7-b679-80d5861754ca None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:35.303427 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1019d69-8e4a-45f7-b679-80d5861754ca None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:35.304093 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1019d69-8e4a-45f7-b679-80d5861754ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:35.304388 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1019d69-8e4a-45f7-b679-80d5861754ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:35.305769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1019d69-8e4a-45f7-b679-80d5861754ca None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:35.314954 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 268/545] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:35.320540 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e676d-1bd4-4c32-9b00-7c0d62c81c7c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:35.329879 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:35.437185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780e676d-1bd4-4c32-9b00-7c0d62c81c7c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:35.473142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05e9b7-a8f1-4757-8152-cd490180919e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:35.473766 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05e9b7-a8f1-4757-8152-cd490180919e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:35.474043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05e9b7-a8f1-4757-8152-cd490180919e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:35.474310 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc05e9b7-a8f1-4757-8152-cd490180919e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:35.486177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05e9b7-a8f1-4757-8152-cd490180919e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:35.487684 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc05e9b7-a8f1-4757-8152-cd490180919e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-cc05e9b7-a8f1-4757-8152-cd490180919e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:35.502640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:35.503556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:35.504419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:35.504419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:35.504419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:35.504419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 278/546] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:35.509683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019d69-8e4a-45f7-b679-80d5861754ca None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:35.616274 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1019d69-8e4a-45f7-b679-80d5861754ca None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:35.686916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55787ebf-4733-4903-befe-3f5efc8d71fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:35.687536 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55787ebf-4733-4903-befe-3f5efc8d71fa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:35.687836 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55787ebf-4733-4903-befe-3f5efc8d71fa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:35.688110 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55787ebf-4733-4903-befe-3f5efc8d71fa None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:35.688843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55787ebf-4733-4903-befe-3f5efc8d71fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:35.689144 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55787ebf-4733-4903-befe-3f5efc8d71fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:35.690502 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55787ebf-4733-4903-befe-3f5efc8d71fa None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:35.708399 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 269/547] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:35.713987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05e9b7-a8f1-4757-8152-cd490180919e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:35.796346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784df0c9-da21-4ceb-a39e-2aee716b9e31 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:35.796970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:35.797322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784df0c9-da21-4ceb-a39e-2aee716b9e31 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:35.797747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784df0c9-da21-4ceb-a39e-2aee716b9e31 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:35.799510 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 270/548] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:24:35.805341 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378650f3-52fc-41d1-bf2b-43c26ac9e61d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:35.805486 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378650f3-52fc-41d1-bf2b-43c26ac9e61d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:35.805711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378650f3-52fc-41d1-bf2b-43c26ac9e61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:35.838556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-378650f3-52fc-41d1-bf2b-43c26ac9e61d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:35.839760 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-378650f3-52fc-41d1-bf2b-43c26ac9e61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:35.861769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc05e9b7-a8f1-4757-8152-cd490180919e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:35.905060 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:35.914142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae90f0-4957-41c6-8739-d16de61ae888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:35.914807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae90f0-4957-41c6-8739-d16de61ae888 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:35.915064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae90f0-4957-41c6-8739-d16de61ae888 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:35.915333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae90f0-4957-41c6-8739-d16de61ae888 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:35.927945 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae90f0-4957-41c6-8739-d16de61ae888 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:35.929427 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae90f0-4957-41c6-8739-d16de61ae888 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-1eae90f0-4957-41c6-8739-d16de61ae888 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:35.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:35.943264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:35.944273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:35.944273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:35.944273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:35.944273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:35.944273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:35.944273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:35.944273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:35.944273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:35.944273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:24:35.944273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:35.944273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 279/549] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:24:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:35.949665 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae90f0-4957-41c6-8739-d16de61ae888 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:35.972774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 271/550] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:24:36.105162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae90f0-4957-41c6-8739-d16de61ae888 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:36.133177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:36.161455 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4078a-c494-44f0-a71e-14c3b3c01569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:36.161991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4078a-c494-44f0-a71e-14c3b3c01569 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:36.162271 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4078a-c494-44f0-a71e-14c3b3c01569 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:36.162544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4078a-c494-44f0-a71e-14c3b3c01569 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:36.163276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4078a-c494-44f0-a71e-14c3b3c01569 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:36.163581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4078a-c494-44f0-a71e-14c3b3c01569 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:36.165037 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4078a-c494-44f0-a71e-14c3b3c01569 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:36.194774 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 280/551] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Sep 13 06:24:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:36.200539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378650f3-52fc-41d1-bf2b-43c26ac9e61d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:36.218141 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae1ebb-f653-4652-8612-09f06b68d8f7 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:36.218449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae1ebb-f653-4652-8612-09f06b68d8f7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:36.218702 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae1ebb-f653-4652-8612-09f06b68d8f7 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:36.220292 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 281/552] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:24:36.225190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa784ac-39aa-4d30-9c76-49d0059b6675 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:36.225475 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa784ac-39aa-4d30-9c76-49d0059b6675 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:36.225752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa784ac-39aa-4d30-9c76-49d0059b6675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:36.243940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0aa784ac-39aa-4d30-9c76-49d0059b6675 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:36.245427 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0aa784ac-39aa-4d30-9c76-49d0059b6675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:36.360768 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 282/553] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:24:36.361859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa784ac-39aa-4d30-9c76-49d0059b6675 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:36.367817 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378650f3-52fc-41d1-bf2b-43c26ac9e61d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:36.418945 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ec423-1d34-4518-916c-6545c55e6675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:36.419572 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ec423-1d34-4518-916c-6545c55e6675 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:36.419860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ec423-1d34-4518-916c-6545c55e6675 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:36.420135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ec423-1d34-4518-916c-6545c55e6675 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:36.489030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:36.492055 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa784ac-39aa-4d30-9c76-49d0059b6675 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:36.501177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:36.529995 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96806213-4b3f-4d7b-814f-0aca57549b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:36.530656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96806213-4b3f-4d7b-814f-0aca57549b02 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:36.531422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96806213-4b3f-4d7b-814f-0aca57549b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:36.531706 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96806213-4b3f-4d7b-814f-0aca57549b02 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:36.553449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96806213-4b3f-4d7b-814f-0aca57549b02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-96806213-4b3f-4d7b-814f-0aca57549b02 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:36.561745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:36.562674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:36.563503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:36.563503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:36.563503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:36.563503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:36.563503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:36.563503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:36.563503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:36.563503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:36.563503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:36.563503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:36.563503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:36.563503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:36.563503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 283/554] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:36.566661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ec423-1d34-4518-916c-6545c55e6675 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:36.568214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ec423-1d34-4518-916c-6545c55e6675 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:36.569596 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96806213-4b3f-4d7b-814f-0aca57549b02 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:36.687749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 272/555] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:36.688743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ec423-1d34-4518-916c-6545c55e6675 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:36.744364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96806213-4b3f-4d7b-814f-0aca57549b02 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:36.765873 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:36.795304 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdd87d-aab7-426f-aea8-0a232cc92af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:36.796316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdd87d-aab7-426f-aea8-0a232cc92af6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:36.796871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdd87d-aab7-426f-aea8-0a232cc92af6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:36.797363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdd87d-aab7-426f-aea8-0a232cc92af6 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:36.798201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdd87d-aab7-426f-aea8-0a232cc92af6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:36.798662 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdd87d-aab7-426f-aea8-0a232cc92af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:36.800354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fdd87d-aab7-426f-aea8-0a232cc92af6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:36.815369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ec423-1d34-4518-916c-6545c55e6675 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:36.815934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 284/556] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:36.816997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdd87d-aab7-426f-aea8-0a232cc92af6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:36.847180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:36.858490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a105a99-f7fc-4cb4-bb02-e28c4b732170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:36.859227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a105a99-f7fc-4cb4-bb02-e28c4b732170 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:36.859577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a105a99-f7fc-4cb4-bb02-e28c4b732170 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:36.859918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a105a99-f7fc-4cb4-bb02-e28c4b732170 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:36.873817 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a105a99-f7fc-4cb4-bb02-e28c4b732170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-6a105a99-f7fc-4cb4-bb02-e28c4b732170 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:36.879777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:36.880980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:36.882007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:36.882007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:36.882007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:36.882007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:36.882007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:36.882007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:36.882007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:36.882007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:36.882007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:36.882007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:36.882007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:36.882007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:36.887533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 273/557] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:36.887533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a105a99-f7fc-4cb4-bb02-e28c4b732170 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:36.932318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fdd87d-aab7-426f-aea8-0a232cc92af6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:36.967894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7da1b-7ae2-4b96-a3a6-e2725fe1a6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:36.969238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7da1b-7ae2-4b96-a3a6-e2725fe1a6ea None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:36.969520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7da1b-7ae2-4b96-a3a6-e2725fe1a6ea None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:36.969992 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7da1b-7ae2-4b96-a3a6-e2725fe1a6ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:36.980635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7da1b-7ae2-4b96-a3a6-e2725fe1a6ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:36.982780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7da1b-7ae2-4b96-a3a6-e2725fe1a6ea None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-cad7da1b-7ae2-4b96-a3a6-e2725fe1a6ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:36.997489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:36.998462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:37.000143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:37.000143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:37.000143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:37.000143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 285/558] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:37.000143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7da1b-7ae2-4b96-a3a6-e2725fe1a6ea None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:37.003614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a105a99-f7fc-4cb4-bb02-e28c4b732170 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:37.030214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:37.043406 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34aafad-ba10-49e0-93ad-e3af93a6896f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:37.044036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34aafad-ba10-49e0-93ad-e3af93a6896f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:37.044916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34aafad-ba10-49e0-93ad-e3af93a6896f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:37.045202 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34aafad-ba10-49e0-93ad-e3af93a6896f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:37.055609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34aafad-ba10-49e0-93ad-e3af93a6896f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:37.057111 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34aafad-ba10-49e0-93ad-e3af93a6896f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e34aafad-ba10-49e0-93ad-e3af93a6896f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:37.072269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:37.073449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:37.074527 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:37.074527 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:37.074527 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:37.074527 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 274/559] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:37.074847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecd034-e225-4173-93e9-dd7827dee255 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:37.075128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecd034-e225-4173-93e9-dd7827dee255 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:37.075394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ecd034-e225-4173-93e9-dd7827dee255 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:37.076962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 275/560] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:37.077485 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecd034-e225-4173-93e9-dd7827dee255 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:37.104721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:37.125714 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7da1b-7ae2-4b96-a3a6-e2725fe1a6ea None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:37.165567 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b328c-c138-479a-be2d-52b23e9357b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:37.166174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b328c-c138-479a-be2d-52b23e9357b3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:37.166454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b328c-c138-479a-be2d-52b23e9357b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:37.166724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7b328c-c138-479a-be2d-52b23e9357b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:37.167388 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b328c-c138-479a-be2d-52b23e9357b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:37.167691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b328c-c138-479a-be2d-52b23e9357b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:37.169102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7b328c-c138-479a-be2d-52b23e9357b3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:37.182396 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 286/561] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:37.182396 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b328c-c138-479a-be2d-52b23e9357b3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:37.198296 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ecd034-e225-4173-93e9-dd7827dee255 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:37.236372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5718fa8-49c6-4f35-b9cc-45199f856b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:37.236928 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5718fa8-49c6-4f35-b9cc-45199f856b6e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:37.237212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5718fa8-49c6-4f35-b9cc-45199f856b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:37.237491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5718fa8-49c6-4f35-b9cc-45199f856b6e None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:37.238115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5718fa8-49c6-4f35-b9cc-45199f856b6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:37.238422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5718fa8-49c6-4f35-b9cc-45199f856b6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:37.239802 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5718fa8-49c6-4f35-b9cc-45199f856b6e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:37.256718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 276/562] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:37.256718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4011-4a4b-4022-9566-1f7b5ddf4074 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:37.256718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4011-4a4b-4022-9566-1f7b5ddf4074 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:37.256718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9b4011-4a4b-4022-9566-1f7b5ddf4074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:37.278733 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cb9b4011-4a4b-4022-9566-1f7b5ddf4074 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:37.280002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cb9b4011-4a4b-4022-9566-1f7b5ddf4074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:37.300602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7b328c-c138-479a-be2d-52b23e9357b3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:37.312702 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:37.341265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf86e4-d6a0-410c-90b9-da489481a870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:37.341987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf86e4-d6a0-410c-90b9-da489481a870 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:37.342270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf86e4-d6a0-410c-90b9-da489481a870 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:37.342626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cf86e4-d6a0-410c-90b9-da489481a870 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:37.343392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf86e4-d6a0-410c-90b9-da489481a870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:37.343745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf86e4-d6a0-410c-90b9-da489481a870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:37.345266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cf86e4-d6a0-410c-90b9-da489481a870 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:37.353241 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 277/563] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:37.354168 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b4011-4a4b-4022-9566-1f7b5ddf4074 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:37.367085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 287/564] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:37.368207 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf86e4-d6a0-410c-90b9-da489481a870 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:37.373064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:37.468115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9b4011-4a4b-4022-9566-1f7b5ddf4074 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:37.476228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cf86e4-d6a0-410c-90b9-da489481a870 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:37.503820 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd83263-4489-4230-9124-2de295c6e11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:37.504430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd83263-4489-4230-9124-2de295c6e11f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:37.504731 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd83263-4489-4230-9124-2de295c6e11f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:37.505011 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd83263-4489-4230-9124-2de295c6e11f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:37.512525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b12f1d6-1b97-43af-80ad-873eeef9c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:37.513200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12f1d6-1b97-43af-80ad-873eeef9c903 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:37.513488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12f1d6-1b97-43af-80ad-873eeef9c903 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:37.513782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b12f1d6-1b97-43af-80ad-873eeef9c903 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:37.515321 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd83263-4489-4230-9124-2de295c6e11f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:37.516811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd83263-4489-4230-9124-2de295c6e11f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:37.520658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12f1d6-1b97-43af-80ad-873eeef9c903 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:37.522115 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b12f1d6-1b97-43af-80ad-873eeef9c903 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-5cd83263-4489-4230-9124-2de295c6e11f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:37.531347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:37.532291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:37.533239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:37.533239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:37.533239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:37.533239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 278/565] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:37.533942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd83263-4489-4230-9124-2de295c6e11f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:37.537867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-7b12f1d6-1b97-43af-80ad-873eeef9c903 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:37.537867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:37.537867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:37.537867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:37.537867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:37.537867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:37.537867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:37.537867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:37.537867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:37.537867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:37.537867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:37.537867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:37.537867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:37.537867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:37.537867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:37.538735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:37.539617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:37.539617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:37.539617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:37.539617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:37.539617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:37.539617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:37.539617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:37.539617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:37.543462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 288/566] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:37.545182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8216f5-2777-4cc4-851d-2249a18bebea None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:37.545462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8216f5-2777-4cc4-851d-2249a18bebea None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:37.545733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8216f5-2777-4cc4-851d-2249a18bebea None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:37.547352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 289/567] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:37.548015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8216f5-2777-4cc4-851d-2249a18bebea None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:37.555763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:37.618071 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:37.639283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd83263-4489-4230-9124-2de295c6e11f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:37.660717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8216f5-2777-4cc4-851d-2249a18bebea None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:37.673853 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddd60b-46b5-479f-85c1-421c90831f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:37.674608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddd60b-46b5-479f-85c1-421c90831f08 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:37.674890 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddd60b-46b5-479f-85c1-421c90831f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:37.675364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ddd60b-46b5-479f-85c1-421c90831f08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:37.682916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddd60b-46b5-479f-85c1-421c90831f08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:37.684343 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ddd60b-46b5-479f-85c1-421c90831f08 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-01ddd60b-46b5-479f-85c1-421c90831f08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:37.696335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:37.703450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:37.704463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:37.704463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:37.704463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:37.704463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:37.704463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:37.704463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:37.704463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:37.704463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:37.704463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:24:37.704463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:37.705053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a197d5c-bb13-4ec9-a03a-ef7babe32249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:37.705053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a197d5c-bb13-4ec9-a03a-ef7babe32249 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:37.705202 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 279/568] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 13 06:24:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:37.705280 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a197d5c-bb13-4ec9-a03a-ef7babe32249 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:37.705280 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a197d5c-bb13-4ec9-a03a-ef7babe32249 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:37.705406 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddd60b-46b5-479f-85c1-421c90831f08 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:37.705483 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a197d5c-bb13-4ec9-a03a-ef7babe32249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:37.705483 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a197d5c-bb13-4ec9-a03a-ef7babe32249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:37.705483 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a197d5c-bb13-4ec9-a03a-ef7babe32249 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:37.717230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 290/569] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:37.718462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9cb7b-539e-45fe-90b1-33e6161a4166 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:37.718747 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9cb7b-539e-45fe-90b1-33e6161a4166 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:37.719029 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9cb7b-539e-45fe-90b1-33e6161a4166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:37.736734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8cf9cb7b-539e-45fe-90b1-33e6161a4166 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:37.737930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8cf9cb7b-539e-45fe-90b1-33e6161a4166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:37.777796 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:37.798857 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ddd60b-46b5-479f-85c1-421c90831f08 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:37.805521 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 291/570] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:37.806343 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9cb7b-539e-45fe-90b1-33e6161a4166 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:37.834115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b23f95-c5ec-41b7-88ff-21f09b941ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:37.834731 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b23f95-c5ec-41b7-88ff-21f09b941ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:37.835025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b23f95-c5ec-41b7-88ff-21f09b941ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:37.835285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b23f95-c5ec-41b7-88ff-21f09b941ef6 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:37.835972 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b23f95-c5ec-41b7-88ff-21f09b941ef6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:37.836302 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b23f95-c5ec-41b7-88ff-21f09b941ef6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:37.837733 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b23f95-c5ec-41b7-88ff-21f09b941ef6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:37.849950 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 280/571] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:37.855598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b23f95-c5ec-41b7-88ff-21f09b941ef6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:37.858956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:37.907285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9cb7b-539e-45fe-90b1-33e6161a4166 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:37.940487 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a16a8-a7c6-4416-94a9-3818e7d81c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:37.941194 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a16a8-a7c6-4416-94a9-3818e7d81c24 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:37.941475 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a16a8-a7c6-4416-94a9-3818e7d81c24 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:37.941739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a16a8-a7c6-4416-94a9-3818e7d81c24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:37.952287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a16a8-a7c6-4416-94a9-3818e7d81c24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-4f3a16a8-a7c6-4416-94a9-3818e7d81c24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:37.957070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:37.958045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:37.958900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:37.958900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:37.958900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:37.958900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:37.958900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:37.958900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:37.958900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:37.958900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:37.958900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:37.958900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:37.958900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:37.958900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:37.958900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 292/572] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:37.959685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a16a8-a7c6-4416-94a9-3818e7d81c24 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:37.967887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b23f95-c5ec-41b7-88ff-21f09b941ef6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:38.004478 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c144268-7e41-4639-8479-24d073205ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:38.005102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144268-7e41-4639-8479-24d073205ca3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:38.005380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144268-7e41-4639-8479-24d073205ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:38.005650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c144268-7e41-4639-8479-24d073205ca3 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:38.006363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c144268-7e41-4639-8479-24d073205ca3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:38.006665 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c144268-7e41-4639-8479-24d073205ca3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:38.008108 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c144268-7e41-4639-8479-24d073205ca3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:38.016393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:38.032519 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 281/573] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 13 06:24:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:38.032519 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c144268-7e41-4639-8479-24d073205ca3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:38.067451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a16a8-a7c6-4416-94a9-3818e7d81c24 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:38.083477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:38.105275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9f2ee-631b-46c1-8bf5-3fe12ac40faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:38.105899 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9f2ee-631b-46c1-8bf5-3fe12ac40faf None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:38.106178 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9f2ee-631b-46c1-8bf5-3fe12ac40faf None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:38.106450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9f2ee-631b-46c1-8bf5-3fe12ac40faf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:38.113890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9f2ee-631b-46c1-8bf5-3fe12ac40faf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:38.115318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9f2ee-631b-46c1-8bf5-3fe12ac40faf None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-78e9f2ee-631b-46c1-8bf5-3fe12ac40faf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:38.128229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:38.129707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:38.130663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:38.130663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:38.130663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:38.130663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:38.130663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:38.130663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:38.130663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:38.130663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:38.130663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:24:38.130663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:38.130663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 293/574] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:38.130663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9f2ee-631b-46c1-8bf5-3fe12ac40faf None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:38.137511 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c144268-7e41-4639-8479-24d073205ca3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:38.172734 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e6615-24d2-4844-8b59-d70ab1a10698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:38.173336 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e6615-24d2-4844-8b59-d70ab1a10698 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:38.173617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e6615-24d2-4844-8b59-d70ab1a10698 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:38.173896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e6615-24d2-4844-8b59-d70ab1a10698 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:38.174619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e6615-24d2-4844-8b59-d70ab1a10698 None admin] RBAC: Adding query filter params (role.id=dc60d33cb0c649b3b903d99258a19c98, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=de05d038c2124f43a3acc70f4fb5b44e) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:38.174931 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e6615-24d2-4844-8b59-d70ab1a10698 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:38.176353 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e6615-24d2-4844-8b59-d70ab1a10698 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:38.182235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 282/575] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:24:38 2022] GET /identity/v3/role_assignments?user.id=de05d038c2124f43a3acc70f4fb5b44e&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=dc60d33cb0c649b3b903d99258a19c98 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:38.183013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e6615-24d2-4844-8b59-d70ab1a10698 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:38.249977 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9f2ee-631b-46c1-8bf5-3fe12ac40faf None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:38.251063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:38.287180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fadeae-01ca-4c13-8340-ffec8bf5ee1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:38.287880 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fadeae-01ca-4c13-8340-ffec8bf5ee1b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:38.288259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fadeae-01ca-4c13-8340-ffec8bf5ee1b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:38.288643 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fadeae-01ca-4c13-8340-ffec8bf5ee1b None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:38.289510 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fadeae-01ca-4c13-8340-ffec8bf5ee1b None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:38.289921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fadeae-01ca-4c13-8340-ffec8bf5ee1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:38.291380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fadeae-01ca-4c13-8340-ffec8bf5ee1b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:38.300031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e6615-24d2-4844-8b59-d70ab1a10698 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:38.301239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 294/576] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:38.306752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fadeae-01ca-4c13-8340-ffec8bf5ee1b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:38.340939 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5560e-8d6c-489a-be5b-7447575c2136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:38.342011 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5560e-8d6c-489a-be5b-7447575c2136 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:38.342355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5560e-8d6c-489a-be5b-7447575c2136 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:38.342693 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5560e-8d6c-489a-be5b-7447575c2136 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:38.343756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:38.357224 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5560e-8d6c-489a-be5b-7447575c2136 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:38.358677 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5560e-8d6c-489a-be5b-7447575c2136 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-6ab5560e-8d6c-489a-be5b-7447575c2136 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:38.374398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:38.375565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:38.376478 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:38.376478 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:38.376478 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:38.376478 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 283/577] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:38.376771 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5560e-8d6c-489a-be5b-7447575c2136 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:38.425807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fadeae-01ca-4c13-8340-ffec8bf5ee1b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:38.460198 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c8ba2-220d-4208-b510-891f4a906cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:38.460856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c8ba2-220d-4208-b510-891f4a906cb2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:38.461144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c8ba2-220d-4208-b510-891f4a906cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:38.461424 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545c8ba2-220d-4208-b510-891f4a906cb2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:38.472024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545c8ba2-220d-4208-b510-891f4a906cb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-545c8ba2-220d-4208-b510-891f4a906cb2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:38.476931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:38.477888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:38.478740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:38.478740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:38.478740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:38.478740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:38.478740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:38.478740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:38.478740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:38.478740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:38.478740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:38.478740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:38.478740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:38.478740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:38.478740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 295/578] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:38.479442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c8ba2-220d-4208-b510-891f4a906cb2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:38.491645 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5560e-8d6c-489a-be5b-7447575c2136 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:38.506368 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:38.530166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd91532-b70a-464a-aeee-2f3b1b7dea8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:38.530869 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd91532-b70a-464a-aeee-2f3b1b7dea8c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:38.531217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd91532-b70a-464a-aeee-2f3b1b7dea8c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:38.531556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd91532-b70a-464a-aeee-2f3b1b7dea8c None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:38.532480 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd91532-b70a-464a-aeee-2f3b1b7dea8c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:38.532975 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd91532-b70a-464a-aeee-2f3b1b7dea8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:38.534475 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd91532-b70a-464a-aeee-2f3b1b7dea8c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:38.554226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 284/579] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Sep 13 06:24:38 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:38.555058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd91532-b70a-464a-aeee-2f3b1b7dea8c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:38.581593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:38.588796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545c8ba2-220d-4208-b510-891f4a906cb2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:38.629286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e7c55-e835-4af9-b7c6-7aa05f19ccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:38.630025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e7c55-e835-4af9-b7c6-7aa05f19ccfa None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:38.630379 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e7c55-e835-4af9-b7c6-7aa05f19ccfa None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:38.630727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e7c55-e835-4af9-b7c6-7aa05f19ccfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:38.642343 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e7c55-e835-4af9-b7c6-7aa05f19ccfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:38.643804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e7c55-e835-4af9-b7c6-7aa05f19ccfa None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-0e0e7c55-e835-4af9-b7c6-7aa05f19ccfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:38.659365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:38.660468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:38.661574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:38.661574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:38.661574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:38.661574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 296/580] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:38.661574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e7c55-e835-4af9-b7c6-7aa05f19ccfa None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:38.673259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd91532-b70a-464a-aeee-2f3b1b7dea8c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:38.712520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe8d58-cc50-46c1-b183-afaf4d7c99e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:38.713185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe8d58-cc50-46c1-b183-afaf4d7c99e2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:38.713420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe8d58-cc50-46c1-b183-afaf4d7c99e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:38.713838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe8d58-cc50-46c1-b183-afaf4d7c99e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:38.714748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe8d58-cc50-46c1-b183-afaf4d7c99e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:38.715065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe8d58-cc50-46c1-b183-afaf4d7c99e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:38.716461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe8d58-cc50-46c1-b183-afaf4d7c99e2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:38.732822 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 285/581] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:38.733764 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe8d58-cc50-46c1-b183-afaf4d7c99e2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:38.766042 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:38.776085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e7c55-e835-4af9-b7c6-7aa05f19ccfa None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:38.812596 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c715d07-faf6-4309-9b36-aa77c33b3edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:38.813250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c715d07-faf6-4309-9b36-aa77c33b3edd None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:38.813529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c715d07-faf6-4309-9b36-aa77c33b3edd None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:38.813804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c715d07-faf6-4309-9b36-aa77c33b3edd None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:38.814473 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c715d07-faf6-4309-9b36-aa77c33b3edd None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:38.814782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c715d07-faf6-4309-9b36-aa77c33b3edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:38.816135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c715d07-faf6-4309-9b36-aa77c33b3edd None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:38.824358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 297/582] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:38.829611 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c715d07-faf6-4309-9b36-aa77c33b3edd None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:38.841513 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:38.841787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe8d58-cc50-46c1-b183-afaf4d7c99e2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:38.877973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27991e37-3128-45eb-ba92-fdd102fda4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:38.878709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27991e37-3128-45eb-ba92-fdd102fda4bf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:38.879054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27991e37-3128-45eb-ba92-fdd102fda4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:38.879390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27991e37-3128-45eb-ba92-fdd102fda4bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:38.890615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27991e37-3128-45eb-ba92-fdd102fda4bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:38.892258 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27991e37-3128-45eb-ba92-fdd102fda4bf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-27991e37-3128-45eb-ba92-fdd102fda4bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:38.906867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:38.908047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:38.909193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:38.909193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:38.909193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:38.909773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 286/583] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:38.914833 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27991e37-3128-45eb-ba92-fdd102fda4bf None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:38.939517 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c715d07-faf6-4309-9b36-aa77c33b3edd None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:38.975052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d9153-79fe-4701-aa0f-7eed32a0a39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:38.975663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d9153-79fe-4701-aa0f-7eed32a0a39f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:38.975949 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d9153-79fe-4701-aa0f-7eed32a0a39f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:38.976219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5d9153-79fe-4701-aa0f-7eed32a0a39f None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:38.976900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d9153-79fe-4701-aa0f-7eed32a0a39f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:38.977203 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d9153-79fe-4701-aa0f-7eed32a0a39f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:38.978553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5d9153-79fe-4701-aa0f-7eed32a0a39f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:38.991009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 298/584] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:38.991929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d9153-79fe-4701-aa0f-7eed32a0a39f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:39.004080 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:39.024952 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27991e37-3128-45eb-ba92-fdd102fda4bf None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:39.064081 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a6f8e-38cc-4c1c-ac10-e611a2ff4ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:39.064722 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a6f8e-38cc-4c1c-ac10-e611a2ff4ade None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:39.065118 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a6f8e-38cc-4c1c-ac10-e611a2ff4ade None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:39.065435 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a6f8e-38cc-4c1c-ac10-e611a2ff4ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:39.066193 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:39.074026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a6f8e-38cc-4c1c-ac10-e611a2ff4ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:39.075614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9a6f8e-38cc-4c1c-ac10-e611a2ff4ade None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:39.087646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-cc9a6f8e-38cc-4c1c-ac10-e611a2ff4ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:39.087646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:39.087646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:39.087646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:39.087646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:39.087646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:39.087646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:39.087646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:39.087646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:39.087646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:39.087646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:39.087646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:39.087646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:39.087646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:39.087646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:39.088707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:39.090121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:39.090121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:39.090121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:39.090121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:39.090121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:39.090121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:39.090121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:39.090121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:39.090121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 287/585] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:39.091890 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a6f8e-38cc-4c1c-ac10-e611a2ff4ade None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:39.105173 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5d9153-79fe-4701-aa0f-7eed32a0a39f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:39.140604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742586e-89a8-4ff1-8d46-5d08a8a18175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:39.141285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742586e-89a8-4ff1-8d46-5d08a8a18175 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:39.141551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742586e-89a8-4ff1-8d46-5d08a8a18175 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:39.141825 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3742586e-89a8-4ff1-8d46-5d08a8a18175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:39.151897 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742586e-89a8-4ff1-8d46-5d08a8a18175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:39.153385 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3742586e-89a8-4ff1-8d46-5d08a8a18175 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-3742586e-89a8-4ff1-8d46-5d08a8a18175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:39.168802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:39.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:39.171249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:39.171249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:39.171249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:39.175236 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 299/586] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:39.175912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742586e-89a8-4ff1-8d46-5d08a8a18175 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:39.196710 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9a6f8e-38cc-4c1c-ac10-e611a2ff4ade None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:39.229769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53768fdb-7d3e-4de4-b13f-9be2d2eb6e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:39.230576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53768fdb-7d3e-4de4-b13f-9be2d2eb6e6a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:39.230856 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53768fdb-7d3e-4de4-b13f-9be2d2eb6e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:39.231129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53768fdb-7d3e-4de4-b13f-9be2d2eb6e6a None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:39.231811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53768fdb-7d3e-4de4-b13f-9be2d2eb6e6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:39.232117 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53768fdb-7d3e-4de4-b13f-9be2d2eb6e6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:39.233499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53768fdb-7d3e-4de4-b13f-9be2d2eb6e6a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:39.246481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 288/587] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:39.247297 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53768fdb-7d3e-4de4-b13f-9be2d2eb6e6a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:39.250394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:39.290058 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3742586e-89a8-4ff1-8d46-5d08a8a18175 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:39.311496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:39.329096 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cf1f3-e55e-4976-aadf-7bc7a3ef5db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:39.329643 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf1f3-e55e-4976-aadf-7bc7a3ef5db9 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:39.329917 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf1f3-e55e-4976-aadf-7bc7a3ef5db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:39.330187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cf1f3-e55e-4976-aadf-7bc7a3ef5db9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:39.337686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cf1f3-e55e-4976-aadf-7bc7a3ef5db9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:39.339136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769cf1f3-e55e-4976-aadf-7bc7a3ef5db9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-769cf1f3-e55e-4976-aadf-7bc7a3ef5db9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:39.350180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:39.351127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:39.352086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:39.352086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:39.352086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:39.352086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:39.352086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:39.352086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:39.352086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:39.352086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:39.352086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 06:24:39.352086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:39.352086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 300/588] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:39.352086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cf1f3-e55e-4976-aadf-7bc7a3ef5db9 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:39.360996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53768fdb-7d3e-4de4-b13f-9be2d2eb6e6a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:39.399957 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc9cb2-455c-41de-a5a0-ace55c48a188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:39.400560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc9cb2-455c-41de-a5a0-ace55c48a188 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:39.400859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc9cb2-455c-41de-a5a0-ace55c48a188 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:39.401133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc9cb2-455c-41de-a5a0-ace55c48a188 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:39.401811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc9cb2-455c-41de-a5a0-ace55c48a188 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:39.402115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc9cb2-455c-41de-a5a0-ace55c48a188 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:39.403533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc9cb2-455c-41de-a5a0-ace55c48a188 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:39.421036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 289/589] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:39.421960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc9cb2-455c-41de-a5a0-ace55c48a188 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:39.459556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cf1f3-e55e-4976-aadf-7bc7a3ef5db9 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:39.488543 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:39.496932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f5baf-6005-4fdb-9711-d408488801ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:39.497716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f5baf-6005-4fdb-9711-d408488801ee None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:39.497993 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f5baf-6005-4fdb-9711-d408488801ee None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:39.499012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61f5baf-6005-4fdb-9711-d408488801ee None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:39.499665 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f5baf-6005-4fdb-9711-d408488801ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:39.499971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f5baf-6005-4fdb-9711-d408488801ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:39.501354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61f5baf-6005-4fdb-9711-d408488801ee None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:39.520312 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 301/590] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:39.520908 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f5baf-6005-4fdb-9711-d408488801ee None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:39.532153 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc9cb2-455c-41de-a5a0-ace55c48a188 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:39.566415 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d78cd-da54-4110-bdaf-18787ce90a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:39.567274 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d78cd-da54-4110-bdaf-18787ce90a26 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:39.567550 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d78cd-da54-4110-bdaf-18787ce90a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:39.567821 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49d78cd-da54-4110-bdaf-18787ce90a26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:39.568943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:39.574587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d78cd-da54-4110-bdaf-18787ce90a26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:39.576510 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49d78cd-da54-4110-bdaf-18787ce90a26 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:39.587588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f49d78cd-da54-4110-bdaf-18787ce90a26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:39.587588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:39.587588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:39.587588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:39.587588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:39.587588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:39.587588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:39.587588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:39.587588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:39.587588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:39.587588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:39.587588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:39.587588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:39.587588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:39.587588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:39.588688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:39.589589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:39.589589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:39.589589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:39.589589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:39.589589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:39.589589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:39.589589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:39.589589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:39.589589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 290/591] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:39.589589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d78cd-da54-4110-bdaf-18787ce90a26 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:39.642185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61f5baf-6005-4fdb-9711-d408488801ee None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:39.678518 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88201e-bdfe-463d-b5c7-eb2c198682e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:39.679120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88201e-bdfe-463d-b5c7-eb2c198682e8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:39.679398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88201e-bdfe-463d-b5c7-eb2c198682e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:39.679669 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd88201e-bdfe-463d-b5c7-eb2c198682e8 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:39.680389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88201e-bdfe-463d-b5c7-eb2c198682e8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:39.680721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88201e-bdfe-463d-b5c7-eb2c198682e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:39.682159 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd88201e-bdfe-463d-b5c7-eb2c198682e8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:39.708910 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 302/592] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Sep 13 06:24:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:39.708910 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88201e-bdfe-463d-b5c7-eb2c198682e8 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:39.718944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49d78cd-da54-4110-bdaf-18787ce90a26 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:39.742692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:39.757971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5eacb-0559-48cf-a48a-9bab5425a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:39.758930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5eacb-0559-48cf-a48a-9bab5425a828 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:39.759216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5eacb-0559-48cf-a48a-9bab5425a828 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:39.759490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5eacb-0559-48cf-a48a-9bab5425a828 None admin] PATH_INFO: `/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/7fbb67072ba544e39073787eb25fcf1e/roles/dc60d33cb0c649b3b903d99258a19c98` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:39.774984 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5eacb-0559-48cf-a48a-9bab5425a828 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c3f0aa3b746108e73737491b003e7, user_id=7fbb67072ba544e39073787eb25fcf1e, role_id=dc60d33cb0c649b3b903d99258a19c98)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:39.776418 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5eacb-0559-48cf-a48a-9bab5425a828 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:39.789864 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 291/593] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:24:39 2022] PUT /identity/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/7fbb67072ba544e39073787eb25fcf1e/roles/dc60d33cb0c649b3b903d99258a19c98 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:24:39.790905 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5eacb-0559-48cf-a48a-9bab5425a828 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:39.857647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:39.863659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd88201e-bdfe-463d-b5c7-eb2c198682e8 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:39.905628 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d442c-bb9d-47d4-9ecf-bea4bd57ac1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:39.906362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d442c-bb9d-47d4-9ecf-bea4bd57ac1b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:39.906650 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d442c-bb9d-47d4-9ecf-bea4bd57ac1b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:39.906971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d442c-bb9d-47d4-9ecf-bea4bd57ac1b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:39.915290 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d442c-bb9d-47d4-9ecf-bea4bd57ac1b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:39.916807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d442c-bb9d-47d4-9ecf-bea4bd57ac1b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c37d442c-bb9d-47d4-9ecf-bea4bd57ac1b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:39.930144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:39.931395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:39.932491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:39.932491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:39.932491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:39.932491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:39.932491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:39.932491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:39.932491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:39.932491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:39.932491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 06:24:39.932491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:39.932491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 303/594] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:39.932491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d442c-bb9d-47d4-9ecf-bea4bd57ac1b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:39.937970 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5eacb-0559-48cf-a48a-9bab5425a828 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:39.983123 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d69f1-c63c-4b7d-99a6-5fab2f7fd797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:39.983738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d69f1-c63c-4b7d-99a6-5fab2f7fd797 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:39.984017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d69f1-c63c-4b7d-99a6-5fab2f7fd797 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:39.984287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d69f1-c63c-4b7d-99a6-5fab2f7fd797 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:39.985025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d69f1-c63c-4b7d-99a6-5fab2f7fd797 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:39.985395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d69f1-c63c-4b7d-99a6-5fab2f7fd797 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:39.986907 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d69f1-c63c-4b7d-99a6-5fab2f7fd797 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:40.002128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 292/595] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:40.003638 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d69f1-c63c-4b7d-99a6-5fab2f7fd797 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:40.045952 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:40.069338 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d442c-bb9d-47d4-9ecf-bea4bd57ac1b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:40.110459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e828a-14e4-4112-abcb-cc5ae5438c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:40.111007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e828a-14e4-4112-abcb-cc5ae5438c54 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:40.111289 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e828a-14e4-4112-abcb-cc5ae5438c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:40.111567 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7e828a-14e4-4112-abcb-cc5ae5438c54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:40.123827 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e828a-14e4-4112-abcb-cc5ae5438c54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:40.125313 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7e828a-14e4-4112-abcb-cc5ae5438c54 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-4c7e828a-14e4-4112-abcb-cc5ae5438c54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:40.140717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:40.142105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:40.142991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:40.142991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:40.142991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:40.142991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 304/596] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:40.142991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e828a-14e4-4112-abcb-cc5ae5438c54 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:40.147777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d69f1-c63c-4b7d-99a6-5fab2f7fd797 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:40.160911 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:40.191010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a6618-7d2e-4e45-b7b4-2d0df3981923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:40.191624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a6618-7d2e-4e45-b7b4-2d0df3981923 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:40.191905 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a6618-7d2e-4e45-b7b4-2d0df3981923 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:40.192743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a6618-7d2e-4e45-b7b4-2d0df3981923 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:40.193503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a6618-7d2e-4e45-b7b4-2d0df3981923 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:40.193813 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a6618-7d2e-4e45-b7b4-2d0df3981923 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:40.195752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a6618-7d2e-4e45-b7b4-2d0df3981923 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:40.221401 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 293/597] 10.222.0.42 () {56 vars in 1139 bytes} [Tue Sep 13 06:24:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:40.222332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a6618-7d2e-4e45-b7b4-2d0df3981923 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:40.265490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7e828a-14e4-4112-abcb-cc5ae5438c54 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:40.313624 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be348e80-f5fd-4b98-9811-04131d7ec077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:40.314298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be348e80-f5fd-4b98-9811-04131d7ec077 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:40.314853 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be348e80-f5fd-4b98-9811-04131d7ec077 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:40.315130 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be348e80-f5fd-4b98-9811-04131d7ec077 None admin] PATH_INFO: `/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/8789ed5fef2148e69e9e444d7cfe1e19/roles/dc60d33cb0c649b3b903d99258a19c98` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:40.335272 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be348e80-f5fd-4b98-9811-04131d7ec077 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c3f0aa3b746108e73737491b003e7, user_id=8789ed5fef2148e69e9e444d7cfe1e19, role_id=dc60d33cb0c649b3b903d99258a19c98)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:40.337213 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be348e80-f5fd-4b98-9811-04131d7ec077 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:40.342850 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:40.355989 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 305/598] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:24:40 2022] PUT /identity/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/8789ed5fef2148e69e9e444d7cfe1e19/roles/dc60d33cb0c649b3b903d99258a19c98 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:24:40.356627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be348e80-f5fd-4b98-9811-04131d7ec077 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:40.362362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a6618-7d2e-4e45-b7b4-2d0df3981923 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:40.416486 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0b8250-eb99-4ca4-821b-e2a6bed4cb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:40.417827 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b8250-eb99-4ca4-821b-e2a6bed4cb25 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:40.418319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b8250-eb99-4ca4-821b-e2a6bed4cb25 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:40.419112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0b8250-eb99-4ca4-821b-e2a6bed4cb25 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:40.421028 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b8250-eb99-4ca4-821b-e2a6bed4cb25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:40.421355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b8250-eb99-4ca4-821b-e2a6bed4cb25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:40.422767 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0b8250-eb99-4ca4-821b-e2a6bed4cb25 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:40.444043 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 294/599] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:40.445556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f0ef8-e977-4ac4-a5a8-9506e05e9454 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:40.445853 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f0ef8-e977-4ac4-a5a8-9506e05e9454 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:40.446123 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f0ef8-e977-4ac4-a5a8-9506e05e9454 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:40.447466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 295/600] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:40.448207 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f0ef8-e977-4ac4-a5a8-9506e05e9454 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:40.448965 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:40.512980 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be348e80-f5fd-4b98-9811-04131d7ec077 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:40.561421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35907474-ced7-41fa-9d0a-81c3725d49f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:40.562065 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35907474-ced7-41fa-9d0a-81c3725d49f4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:40.562509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35907474-ced7-41fa-9d0a-81c3725d49f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:40.562681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35907474-ced7-41fa-9d0a-81c3725d49f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:40.572161 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f0ef8-e977-4ac4-a5a8-9506e05e9454 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:40.574212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35907474-ced7-41fa-9d0a-81c3725d49f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:40.575694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35907474-ced7-41fa-9d0a-81c3725d49f4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-35907474-ced7-41fa-9d0a-81c3725d49f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:40.596321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:40.597409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:40.598338 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:40.598338 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:40.598338 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:40.602018 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 306/601] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:40.603603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523aaf0-fab5-48a6-9ac9-9df83eb7a711 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:40.604098 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523aaf0-fab5-48a6-9ac9-9df83eb7a711 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:40.604575 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523aaf0-fab5-48a6-9ac9-9df83eb7a711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:40.618379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d020610-535a-4cb1-95b1-52fbc6b34bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:40.618940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d020610-535a-4cb1-95b1-52fbc6b34bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:40.619221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d020610-535a-4cb1-95b1-52fbc6b34bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:40.619548 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d020610-535a-4cb1-95b1-52fbc6b34bc5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:40.633453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-4523aaf0-fab5-48a6-9ac9-9df83eb7a711 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:40.634523 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d020610-535a-4cb1-95b1-52fbc6b34bc5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:40.634670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4523aaf0-fab5-48a6-9ac9-9df83eb7a711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:40.636332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d020610-535a-4cb1-95b1-52fbc6b34bc5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:40.650179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1d020610-535a-4cb1-95b1-52fbc6b34bc5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:40.650179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:40.650179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:40.650179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:40.650179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:40.650179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:40.650179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:40.650179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:40.650179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:40.650179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:40.650179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:40.650179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:40.650179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:40.650179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:40.650179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:40.651109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:40.651989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:40.651989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:40.651989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:40.651989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:40.651989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:40.651989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:40.651989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:40.651989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:40.655217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 296/602] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:40.657006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d020610-535a-4cb1-95b1-52fbc6b34bc5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:40.673536 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:40.718350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 307/603] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:40.720418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523aaf0-fab5-48a6-9ac9-9df83eb7a711 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:40.804345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:40.836922 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d020610-535a-4cb1-95b1-52fbc6b34bc5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:40.878074 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523aaf0-fab5-48a6-9ac9-9df83eb7a711 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:40.918735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078a272-d39f-41bb-a985-987b839ed710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:40.919826 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078a272-d39f-41bb-a985-987b839ed710 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:40.920443 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078a272-d39f-41bb-a985-987b839ed710 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:40.921128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078a272-d39f-41bb-a985-987b839ed710 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:40.922204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078a272-d39f-41bb-a985-987b839ed710 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:40.922720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078a272-d39f-41bb-a985-987b839ed710 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:40.924409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078a272-d39f-41bb-a985-987b839ed710 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:40.929358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009b290-03b0-4452-8321-1f098a3fd4bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:40.930073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009b290-03b0-4452-8321-1f098a3fd4bd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:40.930427 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009b290-03b0-4452-8321-1f098a3fd4bd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:40.930779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2009b290-03b0-4452-8321-1f098a3fd4bd None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:40.931556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009b290-03b0-4452-8321-1f098a3fd4bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:40.931935 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009b290-03b0-4452-8321-1f098a3fd4bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:40.933380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2009b290-03b0-4452-8321-1f098a3fd4bd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:40.946460 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 308/604] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:40.951839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078a272-d39f-41bb-a985-987b839ed710 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:40.961828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 297/605] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:40.967030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009b290-03b0-4452-8321-1f098a3fd4bd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:41.072562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078a272-d39f-41bb-a985-987b839ed710 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:41.074554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:41.076492 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:41.112805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896850d-4078-4e5c-8dc3-466faf798fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:41.113553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2009b290-03b0-4452-8321-1f098a3fd4bd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:41.114058 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896850d-4078-4e5c-8dc3-466faf798fbb None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:41.114553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896850d-4078-4e5c-8dc3-466faf798fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:41.115131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7896850d-4078-4e5c-8dc3-466faf798fbb None admin] PATH_INFO: `/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/ddc0c92f881e40c9abe067d3a6d4251b/roles/dc60d33cb0c649b3b903d99258a19c98` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:41.131827 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896850d-4078-4e5c-8dc3-466faf798fbb None admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c3f0aa3b746108e73737491b003e7, user_id=ddc0c92f881e40c9abe067d3a6d4251b, role_id=dc60d33cb0c649b3b903d99258a19c98)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:41.133772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7896850d-4078-4e5c-8dc3-466faf798fbb None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:41.151919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb5526-4cae-4d64-99b9-64aa7ef25a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:41.152283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 309/606] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:24:40 2022] PUT /identity/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/ddc0c92f881e40c9abe067d3a6d4251b/roles/dc60d33cb0c649b3b903d99258a19c98 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:24:41.152789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb5526-4cae-4d64-99b9-64aa7ef25a49 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:41.154009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896850d-4078-4e5c-8dc3-466faf798fbb None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:41.161074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb5526-4cae-4d64-99b9-64aa7ef25a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:41.161497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cb5526-4cae-4d64-99b9-64aa7ef25a49 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:41.174801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb5526-4cae-4d64-99b9-64aa7ef25a49 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:41.176581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cb5526-4cae-4d64-99b9-64aa7ef25a49 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:41.201509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-76cb5526-4cae-4d64-99b9-64aa7ef25a49 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:41.201509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:41.201509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:41.201509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:41.201509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:41.201509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:41.201509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:41.201509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:41.201509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:41.201509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:41.201509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:41.201509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:41.201509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:41.201509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:41.201509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:41.202573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:41.203549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:41.203549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:41.203549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:41.203549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:41.203549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:41.203549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:41.203549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:41.203549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:41.209302 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 298/607] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:24:41.214803 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb5526-4cae-4d64-99b9-64aa7ef25a49 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:41.287166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7896850d-4078-4e5c-8dc3-466faf798fbb None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:41.370332 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813015b8-b010-4a57-93ac-a9054df8b683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:41.371011 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813015b8-b010-4a57-93ac-a9054df8b683 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:41.371297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813015b8-b010-4a57-93ac-a9054df8b683 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:41.371572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813015b8-b010-4a57-93ac-a9054df8b683 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:41.405573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cb5526-4cae-4d64-99b9-64aa7ef25a49 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:41.409748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813015b8-b010-4a57-93ac-a9054df8b683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-813015b8-b010-4a57-93ac-a9054df8b683 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:41.414699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:41.415667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:41.416615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:41.416615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:41.416615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:41.416615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:41.416615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:41.416615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:41.416615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:41.416615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:41.416615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:41.416615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:41.416615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:41.416615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:41.416615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 310/608] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:41.423139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813015b8-b010-4a57-93ac-a9054df8b683 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:41.446239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:41.453353 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:41.463882 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e108ebf-8cf8-476c-92f2-9fdf4c4660dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:41.465123 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e108ebf-8cf8-476c-92f2-9fdf4c4660dd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:41.466581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e108ebf-8cf8-476c-92f2-9fdf4c4660dd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:41.467343 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e108ebf-8cf8-476c-92f2-9fdf4c4660dd None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:41.468532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e108ebf-8cf8-476c-92f2-9fdf4c4660dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:41.469550 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e108ebf-8cf8-476c-92f2-9fdf4c4660dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:41.471745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e108ebf-8cf8-476c-92f2-9fdf4c4660dd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:41.489295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 299/609] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:41.495722 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e108ebf-8cf8-476c-92f2-9fdf4c4660dd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:41.566774 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813015b8-b010-4a57-93ac-a9054df8b683 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:41.635639 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38c361-ec34-4628-845c-2bf26ed4800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:41.636249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38c361-ec34-4628-845c-2bf26ed4800d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:41.636528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38c361-ec34-4628-845c-2bf26ed4800d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:41.636821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e38c361-ec34-4628-845c-2bf26ed4800d None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:41.637487 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38c361-ec34-4628-845c-2bf26ed4800d None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:41.637784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38c361-ec34-4628-845c-2bf26ed4800d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:41.639199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e38c361-ec34-4628-845c-2bf26ed4800d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:41.648990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e108ebf-8cf8-476c-92f2-9fdf4c4660dd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:41.665398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 311/610] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:41.674871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38c361-ec34-4628-845c-2bf26ed4800d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:41.722714 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190efac6-01c7-46c3-985e-8dd028aa5191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:41.723379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190efac6-01c7-46c3-985e-8dd028aa5191 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:41.723656 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190efac6-01c7-46c3-985e-8dd028aa5191 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:41.723931 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190efac6-01c7-46c3-985e-8dd028aa5191 None admin] PATH_INFO: `/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/a5efc921a219444bb0b45e8b4d08dcc5/roles/dc60d33cb0c649b3b903d99258a19c98` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:41.744903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190efac6-01c7-46c3-985e-8dd028aa5191 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c3f0aa3b746108e73737491b003e7, user_id=a5efc921a219444bb0b45e8b4d08dcc5, role_id=dc60d33cb0c649b3b903d99258a19c98)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:41.746127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190efac6-01c7-46c3-985e-8dd028aa5191 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:41.769249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 300/611] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:24:41 2022] PUT /identity/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/a5efc921a219444bb0b45e8b4d08dcc5/roles/dc60d33cb0c649b3b903d99258a19c98 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:24:41.795042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:41.827612 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e38c361-ec34-4628-845c-2bf26ed4800d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:41.868239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f9368-540f-4fde-a678-67a8acc86916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:41.869328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f9368-540f-4fde-a678-67a8acc86916 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:41.870110 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f9368-540f-4fde-a678-67a8acc86916 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:41.870598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f9368-540f-4fde-a678-67a8acc86916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:41.883371 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f9368-540f-4fde-a678-67a8acc86916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:41.885230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369f9368-540f-4fde-a678-67a8acc86916 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-369f9368-540f-4fde-a678-67a8acc86916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:41.901547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:41.902588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:41.903508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:41.903508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:41.903508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:41.905680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 312/612] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:41.912791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190efac6-01c7-46c3-985e-8dd028aa5191 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:42.007756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:42.094113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190efac6-01c7-46c3-985e-8dd028aa5191 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:42.149556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13367faf-a37d-4d32-ac38-51c361c1eed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:42.150176 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13367faf-a37d-4d32-ac38-51c361c1eed6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:42.150458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13367faf-a37d-4d32-ac38-51c361c1eed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:42.150727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13367faf-a37d-4d32-ac38-51c361c1eed6 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:42.151387 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13367faf-a37d-4d32-ac38-51c361c1eed6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:42.151689 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13367faf-a37d-4d32-ac38-51c361c1eed6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:42.153176 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13367faf-a37d-4d32-ac38-51c361c1eed6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:42.166175 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 301/613] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:42.171431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f9368-540f-4fde-a678-67a8acc86916 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:42.181503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b3a70-0bd9-4a02-96be-3f75c076f77e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:42.181784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b3a70-0bd9-4a02-96be-3f75c076f77e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:42.182060 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b3a70-0bd9-4a02-96be-3f75c076f77e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:42.183658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 302/614] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:24:42.190185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca21a7d-49dc-425b-ada1-1e95135de6ea None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:42.190470 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca21a7d-49dc-425b-ada1-1e95135de6ea None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:42.190746 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca21a7d-49dc-425b-ada1-1e95135de6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:42.210801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cca21a7d-49dc-425b-ada1-1e95135de6ea None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:42.211995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cca21a7d-49dc-425b-ada1-1e95135de6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:42.294255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f9368-540f-4fde-a678-67a8acc86916 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:42.304750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 303/615] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:24:42.327526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:42.335720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c956a3-c74a-4e82-aad9-2d461e7892b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:42.336358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c956a3-c74a-4e82-aad9-2d461e7892b1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:42.336637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c956a3-c74a-4e82-aad9-2d461e7892b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:42.336941 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c956a3-c74a-4e82-aad9-2d461e7892b1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:42.345102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c956a3-c74a-4e82-aad9-2d461e7892b1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:42.346617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c956a3-c74a-4e82-aad9-2d461e7892b1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-b5c956a3-c74a-4e82-aad9-2d461e7892b1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:42.358276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:42.359232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:42.360573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:42.360573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:42.360573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:42.360573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:42.360573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:42.360573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:42.360573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:42.360573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:42.360573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:24:42.360573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:42.360573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 313/616] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:24:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:42.365927 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca21a7d-49dc-425b-ada1-1e95135de6ea None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:42.406217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:42.502956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca21a7d-49dc-425b-ada1-1e95135de6ea None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:42.542169 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb697e8c-363b-43d0-846b-beb8db2a3be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:42.542778 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb697e8c-363b-43d0-846b-beb8db2a3be8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:42.543060 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb697e8c-363b-43d0-846b-beb8db2a3be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:42.543335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb697e8c-363b-43d0-846b-beb8db2a3be8 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:42.544067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb697e8c-363b-43d0-846b-beb8db2a3be8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:42.545001 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb697e8c-363b-43d0-846b-beb8db2a3be8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:42.546366 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb697e8c-363b-43d0-846b-beb8db2a3be8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:42.565261 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 304/617] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Sep 13 06:24:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:42.573756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c956a3-c74a-4e82-aad9-2d461e7892b1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:42.652088 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb697e8c-363b-43d0-846b-beb8db2a3be8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:42.738375 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c956a3-c74a-4e82-aad9-2d461e7892b1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:42.786297 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:42.813770 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb697e8c-363b-43d0-846b-beb8db2a3be8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:42.814889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1ee6f-6d77-41eb-9883-161c6b73d0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:42.815790 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1ee6f-6d77-41eb-9883-161c6b73d0c7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:42.816291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1ee6f-6d77-41eb-9883-161c6b73d0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:42.816787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1ee6f-6d77-41eb-9883-161c6b73d0c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:42.834840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1ee6f-6d77-41eb-9883-161c6b73d0c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:42.836835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1ee6f-6d77-41eb-9883-161c6b73d0c7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-66b1ee6f-6d77-41eb-9883-161c6b73d0c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:42.856363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:42.857979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:42.858964 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:42.858964 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:42.858964 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:42.861132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 314/618] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:42.867677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1ee6f-6d77-41eb-9883-161c6b73d0c7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:42.884421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fe718-d23d-4669-9700-fef523eaa5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:42.885089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fe718-d23d-4669-9700-fef523eaa5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:42.885365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fe718-d23d-4669-9700-fef523eaa5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:42.885634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278fe718-d23d-4669-9700-fef523eaa5f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:42.902247 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278fe718-d23d-4669-9700-fef523eaa5f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-278fe718-d23d-4669-9700-fef523eaa5f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:42.908650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:42.909766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:42.910844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:42.910844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:42.910844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:42.910844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:42.910844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:42.910844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:42.910844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:42.910844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:42.910844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:42.910844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:42.910844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:42.910844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:42.910844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 305/619] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:24:42.917764 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fe718-d23d-4669-9700-fef523eaa5f0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:42.949984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:43.041476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1ee6f-6d77-41eb-9883-161c6b73d0c7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:43.048700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278fe718-d23d-4669-9700-fef523eaa5f0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:43.077884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0425210-ebc0-4bde-8c35-5ff4db2b5d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:43.078476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0425210-ebc0-4bde-8c35-5ff4db2b5d4d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:43.078753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0425210-ebc0-4bde-8c35-5ff4db2b5d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:43.079022 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0425210-ebc0-4bde-8c35-5ff4db2b5d4d None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:43.079721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0425210-ebc0-4bde-8c35-5ff4db2b5d4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:43.080026 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0425210-ebc0-4bde-8c35-5ff4db2b5d4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:43.081404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0425210-ebc0-4bde-8c35-5ff4db2b5d4d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:43.094256 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f57ed-82e6-42ba-9a43-89b5044058c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:43.094864 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f57ed-82e6-42ba-9a43-89b5044058c6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:43.095141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f57ed-82e6-42ba-9a43-89b5044058c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:43.095478 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f57ed-82e6-42ba-9a43-89b5044058c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:43.096146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f57ed-82e6-42ba-9a43-89b5044058c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:43.096445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f57ed-82e6-42ba-9a43-89b5044058c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:43.097821 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f57ed-82e6-42ba-9a43-89b5044058c6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:43.098417 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 315/620] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:43.099782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfbd32-f10f-49ac-800c-66e185aa2e3e None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:43.100128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfbd32-f10f-49ac-800c-66e185aa2e3e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:43.100404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edfbd32-f10f-49ac-800c-66e185aa2e3e None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:43.101995 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 316/621] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:43.102699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfbd32-f10f-49ac-800c-66e185aa2e3e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:43.112484 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 306/622] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:43.113832 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acf01d-1d2f-44b5-b0b3-ac17d11dd1a8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:43.114116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acf01d-1d2f-44b5-b0b3-ac17d11dd1a8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:43.114979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05acf01d-1d2f-44b5-b0b3-ac17d11dd1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:43.139515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-05acf01d-1d2f-44b5-b0b3-ac17d11dd1a8 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:43.140730 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-05acf01d-1d2f-44b5-b0b3-ac17d11dd1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:43.144684 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:43.216706 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 307/623] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:43.216706 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acf01d-1d2f-44b5-b0b3-ac17d11dd1a8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:43.259888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:43.269142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edfbd32-f10f-49ac-800c-66e185aa2e3e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:43.339286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038ca94-6931-4ccd-917e-56ec286fb8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:43.339838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038ca94-6931-4ccd-917e-56ec286fb8f7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:43.340374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038ca94-6931-4ccd-917e-56ec286fb8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:43.340642 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038ca94-6931-4ccd-917e-56ec286fb8f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:43.348494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038ca94-6931-4ccd-917e-56ec286fb8f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:43.350036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038ca94-6931-4ccd-917e-56ec286fb8f7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:43.361641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-6038ca94-6931-4ccd-917e-56ec286fb8f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:43.361641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:43.361641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:43.361641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:43.361641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:43.361641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:43.361641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:43.361641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:43.361641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:43.361641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:43.361641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:43.361641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:43.361641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:43.361641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:43.361641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:43.362549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:43.363446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:43.363446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:43.363446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:43.363446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:43.363446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:43.363446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:43.363446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:43.363446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:43.363446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 317/624] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:43.368513 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038ca94-6931-4ccd-917e-56ec286fb8f7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:43.397385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05acf01d-1d2f-44b5-b0b3-ac17d11dd1a8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:43.471628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed945d-e945-4c3f-9648-c2e2ba51ff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:43.472262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed945d-e945-4c3f-9648-c2e2ba51ff97 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:43.472540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed945d-e945-4c3f-9648-c2e2ba51ff97 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:43.472842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed945d-e945-4c3f-9648-c2e2ba51ff97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:43.482240 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:43.485538 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed945d-e945-4c3f-9648-c2e2ba51ff97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:43.487422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ed945d-e945-4c3f-9648-c2e2ba51ff97 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-01ed945d-e945-4c3f-9648-c2e2ba51ff97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:43.511506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:43.512533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:43.514000 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:43.514000 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:43.514000 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:43.514000 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 308/625] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:43.520721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed945d-e945-4c3f-9648-c2e2ba51ff97 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:43.532946 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038ca94-6931-4ccd-917e-56ec286fb8f7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:43.577595 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ae3eb-8f9b-477d-919d-7aa0e676aaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:43.578207 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ae3eb-8f9b-477d-919d-7aa0e676aaeb None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:43.578485 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ae3eb-8f9b-477d-919d-7aa0e676aaeb None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:43.578758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ae3eb-8f9b-477d-919d-7aa0e676aaeb None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:43.579450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ae3eb-8f9b-477d-919d-7aa0e676aaeb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:43.579758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ae3eb-8f9b-477d-919d-7aa0e676aaeb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:43.582896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ae3eb-8f9b-477d-919d-7aa0e676aaeb None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:43.595147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 318/626] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:43.596113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ae3eb-8f9b-477d-919d-7aa0e676aaeb None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:43.622641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:43.672217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed945d-e945-4c3f-9648-c2e2ba51ff97 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:43.708515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ae3eb-8f9b-477d-919d-7aa0e676aaeb None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:43.710961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a6f30-0308-4597-815b-a7ed782882c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:43.711589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a6f30-0308-4597-815b-a7ed782882c0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:43.711858 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a6f30-0308-4597-815b-a7ed782882c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:43.712130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a6f30-0308-4597-815b-a7ed782882c0 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:43.712793 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a6f30-0308-4597-815b-a7ed782882c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:43.713099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a6f30-0308-4597-815b-a7ed782882c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:43.714460 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a6f30-0308-4597-815b-a7ed782882c0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:43.731819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 309/627] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:43.731819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a6f30-0308-4597-815b-a7ed782882c0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:43.746547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d691acf-0b8d-4ded-8297-4ada031ececa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:43.747168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d691acf-0b8d-4ded-8297-4ada031ececa None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:43.747985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d691acf-0b8d-4ded-8297-4ada031ececa None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:43.748316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d691acf-0b8d-4ded-8297-4ada031ececa None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:43.759682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d691acf-0b8d-4ded-8297-4ada031ececa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-7d691acf-0b8d-4ded-8297-4ada031ececa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:43.765172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:43.766106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:43.767015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:43.767015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:43.767015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:43.767015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:43.767015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:43.767015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:43.767015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:43.767015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:43.767015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:43.767015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:43.767015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:43.767015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:43.767015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 319/628] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:43.767720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17c36b-5513-4680-a8c1-0171eaade2c3 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:43.767720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17c36b-5513-4680-a8c1-0171eaade2c3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:43.768336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa17c36b-5513-4680-a8c1-0171eaade2c3 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:43.770931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 320/629] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:43.770931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17c36b-5513-4680-a8c1-0171eaade2c3 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:43.790494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:43.842500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a6f30-0308-4597-815b-a7ed782882c0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:43.862353 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:43.879067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25ec9a-4e1c-444e-9469-f7e39c2ad307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:43.879725 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25ec9a-4e1c-444e-9469-f7e39c2ad307 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:43.880006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25ec9a-4e1c-444e-9469-f7e39c2ad307 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:43.880287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25ec9a-4e1c-444e-9469-f7e39c2ad307 None admin] PATH_INFO: `/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/de05d038c2124f43a3acc70f4fb5b44e/roles/dc60d33cb0c649b3b903d99258a19c98` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:43.887444 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa17c36b-5513-4680-a8c1-0171eaade2c3 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:43.896492 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25ec9a-4e1c-444e-9469-f7e39c2ad307 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c3f0aa3b746108e73737491b003e7, user_id=de05d038c2124f43a3acc70f4fb5b44e, role_id=dc60d33cb0c649b3b903d99258a19c98)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:43.898334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25ec9a-4e1c-444e-9469-f7e39c2ad307 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:43.920969 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 310/630] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:24:43 2022] PUT /identity/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/de05d038c2124f43a3acc70f4fb5b44e/roles/dc60d33cb0c649b3b903d99258a19c98 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:24:43.922472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436e2ad-ae60-4e3e-94af-4ece229ffdb7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:43.922774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436e2ad-ae60-4e3e-94af-4ece229ffdb7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:43.923049 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c436e2ad-ae60-4e3e-94af-4ece229ffdb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:43.932855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf5f8c-3c7c-4cce-b95f-f1c23521d5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:43.932855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf5f8c-3c7c-4cce-b95f-f1c23521d5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:43.932855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf5f8c-3c7c-4cce-b95f-f1c23521d5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:43.932855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf5f8c-3c7c-4cce-b95f-f1c23521d5c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:43.942376 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf5f8c-3c7c-4cce-b95f-f1c23521d5c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:43.944236 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bf5f8c-3c7c-4cce-b95f-f1c23521d5c3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:43.950221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c436e2ad-ae60-4e3e-94af-4ece229ffdb7 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:43.952112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c436e2ad-ae60-4e3e-94af-4ece229ffdb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-22bf5f8c-3c7c-4cce-b95f-f1c23521d5c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:43.958503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:43.959524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:43.961128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:43.961128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:43.961128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:43.961128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:43.961128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:43.961128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:43.961128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:43.961128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:43.961128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:24:43.961128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:43.961128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 321/631] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 13 06:24:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:43.961128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf5f8c-3c7c-4cce-b95f-f1c23521d5c3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:44.056170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 311/632] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:44.057708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436e2ad-ae60-4e3e-94af-4ece229ffdb7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:44.077314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf5f8c-3c7c-4cce-b95f-f1c23521d5c3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:44.099610 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:44.122378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f423a-91dc-4842-9a0f-ae820049547a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:44.123440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f423a-91dc-4842-9a0f-ae820049547a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:44.123722 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f423a-91dc-4842-9a0f-ae820049547a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:44.123998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f423a-91dc-4842-9a0f-ae820049547a None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:44.124695 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f423a-91dc-4842-9a0f-ae820049547a None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:44.125019 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f423a-91dc-4842-9a0f-ae820049547a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:44.126681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f423a-91dc-4842-9a0f-ae820049547a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:44.132999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:44.139211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 322/633] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:44.147086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f423a-91dc-4842-9a0f-ae820049547a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:44.213029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c436e2ad-ae60-4e3e-94af-4ece229ffdb7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:44.259566 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a8d64-c51b-41ff-8d85-a539ae487ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:44.261101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a8d64-c51b-41ff-8d85-a539ae487ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:44.261572 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a8d64-c51b-41ff-8d85-a539ae487ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:44.262054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a8d64-c51b-41ff-8d85-a539ae487ac0 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:44.263477 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a8d64-c51b-41ff-8d85-a539ae487ac0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:44.264129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a8d64-c51b-41ff-8d85-a539ae487ac0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:44.266014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a8d64-c51b-41ff-8d85-a539ae487ac0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:44.269158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f423a-91dc-4842-9a0f-ae820049547a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:44.290811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 312/634] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 13 06:24:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:44.296709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a8d64-c51b-41ff-8d85-a539ae487ac0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:44.316365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160767d-e20a-4a96-9df3-6d2b78448b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:44.317228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160767d-e20a-4a96-9df3-6d2b78448b3d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:44.317528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160767d-e20a-4a96-9df3-6d2b78448b3d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:44.317901 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0160767d-e20a-4a96-9df3-6d2b78448b3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:44.341733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160767d-e20a-4a96-9df3-6d2b78448b3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:44.343215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0160767d-e20a-4a96-9df3-6d2b78448b3d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-0160767d-e20a-4a96-9df3-6d2b78448b3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:44.374884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:44.375871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:44.376810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:44.376810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:44.376810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:44.385090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 323/635] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:44.386321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160767d-e20a-4a96-9df3-6d2b78448b3d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:44.407722 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:44.420780 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a8d64-c51b-41ff-8d85-a539ae487ac0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:44.460746 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6076d8-826d-4c7e-8da9-752504dc076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:44.461741 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6076d8-826d-4c7e-8da9-752504dc076c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:44.462428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6076d8-826d-4c7e-8da9-752504dc076c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:44.462810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6076d8-826d-4c7e-8da9-752504dc076c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:44.493325 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:44.541242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0160767d-e20a-4a96-9df3-6d2b78448b3d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:44.554414 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6076d8-826d-4c7e-8da9-752504dc076c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:44.556244 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6076d8-826d-4c7e-8da9-752504dc076c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:44.584020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded938b7-e8e9-461a-8abe-c73661fa3967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:44.585028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded938b7-e8e9-461a-8abe-c73661fa3967 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:44.585512 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded938b7-e8e9-461a-8abe-c73661fa3967 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:44.585986 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded938b7-e8e9-461a-8abe-c73661fa3967 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:44.586851 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded938b7-e8e9-461a-8abe-c73661fa3967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:44.587355 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded938b7-e8e9-461a-8abe-c73661fa3967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:44.588942 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded938b7-e8e9-461a-8abe-c73661fa3967 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:44.608083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 324/636] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:44.609337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded938b7-e8e9-461a-8abe-c73661fa3967 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:44.667643 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:44.680825 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 313/637] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:44.680825 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6076d8-826d-4c7e-8da9-752504dc076c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:44.729472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded938b7-e8e9-461a-8abe-c73661fa3967 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:44.744130 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:44.767555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcfd01-5d3c-47f4-9a31-d3ac16e1fab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:44.768178 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcfd01-5d3c-47f4-9a31-d3ac16e1fab7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:44.768454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcfd01-5d3c-47f4-9a31-d3ac16e1fab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:44.768754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcfd01-5d3c-47f4-9a31-d3ac16e1fab7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:44.779339 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcfd01-5d3c-47f4-9a31-d3ac16e1fab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c9fcfd01-5d3c-47f4-9a31-d3ac16e1fab7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:44.784057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:44.785073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:44.785914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:44.785914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:44.785914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:44.785914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:44.785914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:44.785914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:44.785914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:44.785914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:44.785914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:44.785914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:44.785914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:44.785914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:44.785914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 325/638] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:44.786684 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856e2f5-b945-4dac-a92d-9825fd6598dd None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:44.786684 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856e2f5-b945-4dac-a92d-9825fd6598dd None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:44.787610 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856e2f5-b945-4dac-a92d-9825fd6598dd None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:44.788796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 326/639] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:44.789388 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856e2f5-b945-4dac-a92d-9825fd6598dd None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:44.796943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6076d8-826d-4c7e-8da9-752504dc076c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:44.835665 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42df868-9d24-4718-9488-8ad1ae515121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:44.836601 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42df868-9d24-4718-9488-8ad1ae515121 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:44.836912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42df868-9d24-4718-9488-8ad1ae515121 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:44.837189 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42df868-9d24-4718-9488-8ad1ae515121 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:44.845047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42df868-9d24-4718-9488-8ad1ae515121 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:44.846472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42df868-9d24-4718-9488-8ad1ae515121 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b42df868-9d24-4718-9488-8ad1ae515121 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:44.858815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:44.859789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:44.861361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:44.861361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:44.861361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:44.861361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:44.861361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:44.861361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:44.861361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:44.861361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:44.861361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:24:44.861361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:44.861361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 314/640] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:44.861361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42df868-9d24-4718-9488-8ad1ae515121 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:44.913304 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856e2f5-b945-4dac-a92d-9825fd6598dd None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:44.916031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:44.950992 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1898ed2-232d-4972-b7de-2a8627853e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:44.951755 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1898ed2-232d-4972-b7de-2a8627853e11 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:44.952098 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1898ed2-232d-4972-b7de-2a8627853e11 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:44.952436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1898ed2-232d-4972-b7de-2a8627853e11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:44.963778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1898ed2-232d-4972-b7de-2a8627853e11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:44.965341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1898ed2-232d-4972-b7de-2a8627853e11 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:44.970581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42df868-9d24-4718-9488-8ad1ae515121 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-e1898ed2-232d-4972-b7de-2a8627853e11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:44.980854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:44.982144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:44.983144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:44.983144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:44.983144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:44.983144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 327/641] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:44.983940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647a993-6976-4d14-aed4-d7c2314dd509 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:44.984226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647a993-6976-4d14-aed4-d7c2314dd509 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:44.984502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647a993-6976-4d14-aed4-d7c2314dd509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:45.003463 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9647a993-6976-4d14-aed4-d7c2314dd509 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:45.004756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9647a993-6976-4d14-aed4-d7c2314dd509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:45.014944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04176dd3-93b9-4e51-afa4-6d71e90232ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:45.015555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04176dd3-93b9-4e51-afa4-6d71e90232ff None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:45.015831 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04176dd3-93b9-4e51-afa4-6d71e90232ff None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:45.016107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04176dd3-93b9-4e51-afa4-6d71e90232ff None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:45.016814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04176dd3-93b9-4e51-afa4-6d71e90232ff None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:45.017119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04176dd3-93b9-4e51-afa4-6d71e90232ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:45.018498 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04176dd3-93b9-4e51-afa4-6d71e90232ff None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:45.025700 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:45.032226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 315/642] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:45.032226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04176dd3-93b9-4e51-afa4-6d71e90232ff None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:45.082640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 328/643] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:45.083477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647a993-6976-4d14-aed4-d7c2314dd509 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:45.145656 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04176dd3-93b9-4e51-afa4-6d71e90232ff None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:45.159461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:45.182046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b46ee4-3bdb-40b0-b326-acf78ab03656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:45.182700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b46ee4-3bdb-40b0-b326-acf78ab03656 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:45.183082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b46ee4-3bdb-40b0-b326-acf78ab03656 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:45.183452 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b46ee4-3bdb-40b0-b326-acf78ab03656 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:45.184272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b46ee4-3bdb-40b0-b326-acf78ab03656 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:45.184644 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b46ee4-3bdb-40b0-b326-acf78ab03656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:45.186900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b46ee4-3bdb-40b0-b326-acf78ab03656 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:45.210404 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 316/644] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Sep 13 06:24:45 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:45.211379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b46ee4-3bdb-40b0-b326-acf78ab03656 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:45.224882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647a993-6976-4d14-aed4-d7c2314dd509 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:45.267991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc9599-315d-4e23-b203-c70470d0ea34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:45.268605 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc9599-315d-4e23-b203-c70470d0ea34 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:45.268918 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc9599-315d-4e23-b203-c70470d0ea34 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:45.269298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc9599-315d-4e23-b203-c70470d0ea34 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:45.269940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc9599-315d-4e23-b203-c70470d0ea34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:45.270243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc9599-315d-4e23-b203-c70470d0ea34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:45.271718 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc9599-315d-4e23-b203-c70470d0ea34 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:45.284110 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 329/645] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:45.285052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc9599-315d-4e23-b203-c70470d0ea34 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:45.309196 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:45.333609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b46ee4-3bdb-40b0-b326-acf78ab03656 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:45.374284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70964586-0e11-451b-a1bc-ab056e3cb8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:45.374957 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70964586-0e11-451b-a1bc-ab056e3cb8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:45.375399 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70964586-0e11-451b-a1bc-ab056e3cb8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:45.375673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70964586-0e11-451b-a1bc-ab056e3cb8e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:45.387864 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70964586-0e11-451b-a1bc-ab056e3cb8e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:45.390262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70964586-0e11-451b-a1bc-ab056e3cb8e5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:45.391903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc9599-315d-4e23-b203-c70470d0ea34 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-70964586-0e11-451b-a1bc-ab056e3cb8e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:45.409393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:45.410430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:45.416452 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:45.416452 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:45.416452 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:45.416452 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 317/646] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:45.416452 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70964586-0e11-451b-a1bc-ab056e3cb8e5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:45.428312 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ba020-9346-4f8f-b6b3-a1c813ff530e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:45.428961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ba020-9346-4f8f-b6b3-a1c813ff530e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:45.429236 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ba020-9346-4f8f-b6b3-a1c813ff530e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:45.429500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ba020-9346-4f8f-b6b3-a1c813ff530e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:45.447429 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:45.500496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ba020-9346-4f8f-b6b3-a1c813ff530e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:45.501961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ba020-9346-4f8f-b6b3-a1c813ff530e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:45.516888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:45.528949 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70964586-0e11-451b-a1bc-ab056e3cb8e5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:45.565278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f5ab2-e0bf-4dcd-8f48-11bb0bdd59b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:45.565905 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5ab2-e0bf-4dcd-8f48-11bb0bdd59b1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:45.566234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5ab2-e0bf-4dcd-8f48-11bb0bdd59b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:45.566450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f5ab2-e0bf-4dcd-8f48-11bb0bdd59b1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:45.573281 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f5ab2-e0bf-4dcd-8f48-11bb0bdd59b1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:45.574717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345f5ab2-e0bf-4dcd-8f48-11bb0bdd59b1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:45.585990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-345f5ab2-e0bf-4dcd-8f48-11bb0bdd59b1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:45.585990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:45.585990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:45.585990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:45.585990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:45.585990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:45.585990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:45.585990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:45.585990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:45.585990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:45.585990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:45.585990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:45.585990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:45.585990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:45.585990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:45.587063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:45.588154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:45.588154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:45.588154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:45.588154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:45.588154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:45.588154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:45.588154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:45.588154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:45.588154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 318/647] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:45.588154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f5ab2-e0bf-4dcd-8f48-11bb0bdd59b1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:45.620851 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 330/648] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:45.620851 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ba020-9346-4f8f-b6b3-a1c813ff530e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:45.686314 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:45.706617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f5ab2-e0bf-4dcd-8f48-11bb0bdd59b1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:45.725913 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ba020-9346-4f8f-b6b3-a1c813ff530e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:45.740893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:45.742870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd49f43-d041-487e-be1d-ffb830a5a78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:45.743531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd49f43-d041-487e-be1d-ffb830a5a78e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:45.743812 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd49f43-d041-487e-be1d-ffb830a5a78e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:45.744086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd49f43-d041-487e-be1d-ffb830a5a78e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:45.755582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd49f43-d041-487e-be1d-ffb830a5a78e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-edd49f43-d041-487e-be1d-ffb830a5a78e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:45.760732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:45.764765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:45.765694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:45.765694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:45.765694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:45.765694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:45.765694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:45.765694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:45.765694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:45.765694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:45.765694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:45.765694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:45.765694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:45.765694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:45.765694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 319/649] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:45.765694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd49f43-d041-487e-be1d-ffb830a5a78e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:45.770233 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0c0fa-dd79-43a2-84ac-79f2b0c5a767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:45.770946 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0c0fa-dd79-43a2-84ac-79f2b0c5a767 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:45.771350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0c0fa-dd79-43a2-84ac-79f2b0c5a767 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:45.771729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0c0fa-dd79-43a2-84ac-79f2b0c5a767 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:45.772468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0c0fa-dd79-43a2-84ac-79f2b0c5a767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:45.772974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0c0fa-dd79-43a2-84ac-79f2b0c5a767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:45.775382 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0c0fa-dd79-43a2-84ac-79f2b0c5a767 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:45.787552 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 331/650] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:45.788504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0c0fa-dd79-43a2-84ac-79f2b0c5a767 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:45.878430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd49f43-d041-487e-be1d-ffb830a5a78e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:45.894342 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0c0fa-dd79-43a2-84ac-79f2b0c5a767 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:45.915590 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11556dfc-b281-44b6-a832-488a750c904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:45.916197 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11556dfc-b281-44b6-a832-488a750c904f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:45.916476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11556dfc-b281-44b6-a832-488a750c904f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:45.916785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11556dfc-b281-44b6-a832-488a750c904f None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:45.917479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11556dfc-b281-44b6-a832-488a750c904f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:45.917779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11556dfc-b281-44b6-a832-488a750c904f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:45.919252 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11556dfc-b281-44b6-a832-488a750c904f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:45.928985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda5a04-5b3d-4db8-9961-bb31310ed51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:45.929608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda5a04-5b3d-4db8-9961-bb31310ed51e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:45.929897 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda5a04-5b3d-4db8-9961-bb31310ed51e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:45.930147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda5a04-5b3d-4db8-9961-bb31310ed51e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:45.932213 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 320/651] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:45.933258 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11556dfc-b281-44b6-a832-488a750c904f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:45.937525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:45.946275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda5a04-5b3d-4db8-9961-bb31310ed51e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:45.947730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda5a04-5b3d-4db8-9961-bb31310ed51e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-4eda5a04-5b3d-4db8-9961-bb31310ed51e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:45.961817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:45.968086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:45.969303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:45.969303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:45.969303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:45.969303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 332/652] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:45.969303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda5a04-5b3d-4db8-9961-bb31310ed51e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:45.995551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:46.054620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11556dfc-b281-44b6-a832-488a750c904f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:46.069512 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda5a04-5b3d-4db8-9961-bb31310ed51e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:46.093302 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f9f0f-e19d-4d89-a0d9-d4b11ec86e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:46.094030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f9f0f-e19d-4d89-a0d9-d4b11ec86e4e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:46.094376 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f9f0f-e19d-4d89-a0d9-d4b11ec86e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:46.094716 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91f9f0f-e19d-4d89-a0d9-d4b11ec86e4e None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:46.095464 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f9f0f-e19d-4d89-a0d9-d4b11ec86e4e None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:46.095827 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f9f0f-e19d-4d89-a0d9-d4b11ec86e4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:46.097309 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91f9f0f-e19d-4d89-a0d9-d4b11ec86e4e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:46.111819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 321/653] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:46.111819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f9f0f-e19d-4d89-a0d9-d4b11ec86e4e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:46.114233 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fabf2-397f-4bf5-bbb5-e6e17742e13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:46.114941 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fabf2-397f-4bf5-bbb5-e6e17742e13d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:46.115285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fabf2-397f-4bf5-bbb5-e6e17742e13d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:46.115627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fabf2-397f-4bf5-bbb5-e6e17742e13d None admin] PATH_INFO: `/v3/users/glance` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:46.123820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fabf2-397f-4bf5-bbb5-e6e17742e13d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:46.125408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fabf2-397f-4bf5-bbb5-e6e17742e13d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-528fabf2-397f-4bf5-bbb5-e6e17742e13d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:46.136449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:46.137651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:46.138882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:46.138882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:46.138882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:46.138882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:46.138882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:46.138882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:46.138882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:46.138882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:46.138882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 06:24:46.138882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:46.139895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 333/654] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:46.140683 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fabf2-397f-4bf5-bbb5-e6e17742e13d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:46.187445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:46.229954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:46.230132 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91f9f0f-e19d-4d89-a0d9-d4b11ec86e4e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:46.248204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fabf2-397f-4bf5-bbb5-e6e17742e13d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:46.265854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a833f-1e29-4237-8734-c18a4a72b487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:46.266462 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a833f-1e29-4237-8734-c18a4a72b487 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:46.266743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a833f-1e29-4237-8734-c18a4a72b487 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:46.267014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a833f-1e29-4237-8734-c18a4a72b487 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:46.267720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a833f-1e29-4237-8734-c18a4a72b487 None admin] RBAC: Adding query filter params (role.id=dc60d33cb0c649b3b903d99258a19c98, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=7fbb67072ba544e39073787eb25fcf1e) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:46.268034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a833f-1e29-4237-8734-c18a4a72b487 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:46.269473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a833f-1e29-4237-8734-c18a4a72b487 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:46.275440 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 322/655] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:24:46 2022] GET /identity/v3/role_assignments?user.id=7fbb67072ba544e39073787eb25fcf1e&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=dc60d33cb0c649b3b903d99258a19c98 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:46.276231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a833f-1e29-4237-8734-c18a4a72b487 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:46.298847 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a50fba-5f0f-462f-9ff2-ecb6090dde4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:46.299461 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50fba-5f0f-462f-9ff2-ecb6090dde4d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:46.299745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50fba-5f0f-462f-9ff2-ecb6090dde4d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:46.300066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a50fba-5f0f-462f-9ff2-ecb6090dde4d None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:46.300761 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a50fba-5f0f-462f-9ff2-ecb6090dde4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:46.301068 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a50fba-5f0f-462f-9ff2-ecb6090dde4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:46.302477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a50fba-5f0f-462f-9ff2-ecb6090dde4d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:46.323117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 334/656] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:46.323117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a50fba-5f0f-462f-9ff2-ecb6090dde4d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:46.397697 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a833f-1e29-4237-8734-c18a4a72b487 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:46.427361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:46.432021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a50fba-5f0f-462f-9ff2-ecb6090dde4d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:46.438163 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e2b74-7f5d-4883-8fb3-6bd38b6b72c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:46.439070 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e2b74-7f5d-4883-8fb3-6bd38b6b72c4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:46.439555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e2b74-7f5d-4883-8fb3-6bd38b6b72c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:46.439970 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e2b74-7f5d-4883-8fb3-6bd38b6b72c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:46.453791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e2b74-7f5d-4883-8fb3-6bd38b6b72c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:46.455601 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e2b74-7f5d-4883-8fb3-6bd38b6b72c4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d92e2b74-7f5d-4883-8fb3-6bd38b6b72c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:46.471883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:46.472911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:46.475018 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:46.475018 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:46.475018 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:46.476956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 323/657] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:46.477435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659a4cf-0273-4895-b4fd-1ef3f8fc5bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:46.478054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659a4cf-0273-4895-b4fd-1ef3f8fc5bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:46.478182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca267-a332-49db-a195-ac8439ca32d1 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:46.478356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659a4cf-0273-4895-b4fd-1ef3f8fc5bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:46.478455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca267-a332-49db-a195-ac8439ca32d1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:46.478617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659a4cf-0273-4895-b4fd-1ef3f8fc5bd5 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:46.478711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdca267-a332-49db-a195-ac8439ca32d1 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:46.479580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659a4cf-0273-4895-b4fd-1ef3f8fc5bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:46.479685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659a4cf-0273-4895-b4fd-1ef3f8fc5bd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:46.480125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 324/658] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:46.480720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdca267-a332-49db-a195-ac8439ca32d1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:46.482468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659a4cf-0273-4895-b4fd-1ef3f8fc5bd5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:46.503393 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 335/659] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Sep 13 06:24:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:46.504229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659a4cf-0273-4895-b4fd-1ef3f8fc5bd5 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:46.513012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:46.601678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdca267-a332-49db-a195-ac8439ca32d1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:46.615683 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659a4cf-0273-4895-b4fd-1ef3f8fc5bd5 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:46.645691 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9c9bf-b66c-4667-86b4-f846ba84716b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:46.646032 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9c9bf-b66c-4667-86b4-f846ba84716b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:46.646307 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9c9bf-b66c-4667-86b4-f846ba84716b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:46.646572 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a9c9bf-b66c-4667-86b4-f846ba84716b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:46.652633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ceba1-6829-4a1b-ae72-587282370b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:46.653466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ceba1-6829-4a1b-ae72-587282370b53 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:46.654459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ceba1-6829-4a1b-ae72-587282370b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:46.654947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ceba1-6829-4a1b-ae72-587282370b53 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:46.655805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ceba1-6829-4a1b-ae72-587282370b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:46.656019 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9c9bf-b66c-4667-86b4-f846ba84716b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:46.656297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ceba1-6829-4a1b-ae72-587282370b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:46.657499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a9c9bf-b66c-4667-86b4-f846ba84716b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:46.657679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ceba1-6829-4a1b-ae72-587282370b53 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:46.670054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 336/660] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:46.671471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-90a9c9bf-b66c-4667-86b4-f846ba84716b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:46.671471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:46.671471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:46.671471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:46.671471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:46.671471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:46.671471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:46.671471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:46.671471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:46.671471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:46.671471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:46.671471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:46.671471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:46.671471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:46.671471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:46.672305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:46.673227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:46.673227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:46.673227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:46.673227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:46.673227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:46.673227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:46.673227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:46.673227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:46.673227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 325/661] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:46.673742 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9c9bf-b66c-4667-86b4-f846ba84716b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:46.679309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8665e-a9fc-4dad-b715-ac235899ad3e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:46.679597 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8665e-a9fc-4dad-b715-ac235899ad3e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:46.679870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8665e-a9fc-4dad-b715-ac235899ad3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:46.698778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-94d8665e-a9fc-4dad-b715-ac235899ad3e None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:46.699958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-94d8665e-a9fc-4dad-b715-ac235899ad3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:46.717641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:46.761560 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:46.780690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 337/662] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:46.780690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8665e-a9fc-4dad-b715-ac235899ad3e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:46.791977 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a9c9bf-b66c-4667-86b4-f846ba84716b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:46.833194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58829916-9dd3-4ce9-a0e6-7dbe1c93d3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:46.834322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58829916-9dd3-4ce9-a0e6-7dbe1c93d3cf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:46.834606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58829916-9dd3-4ce9-a0e6-7dbe1c93d3cf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:46.834879 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58829916-9dd3-4ce9-a0e6-7dbe1c93d3cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:46.899241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8665e-a9fc-4dad-b715-ac235899ad3e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:46.918281 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58829916-9dd3-4ce9-a0e6-7dbe1c93d3cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:46.920313 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58829916-9dd3-4ce9-a0e6-7dbe1c93d3cf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:46.946429 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c51cc3-9b38-4383-b3cd-da1ed7045b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:46.947887 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c51cc3-9b38-4383-b3cd-da1ed7045b1d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:46.948636 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c51cc3-9b38-4383-b3cd-da1ed7045b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:46.949181 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c51cc3-9b38-4383-b3cd-da1ed7045b1d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:46.959674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c51cc3-9b38-4383-b3cd-da1ed7045b1d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:46.962187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c51cc3-9b38-4383-b3cd-da1ed7045b1d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:46.970414 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-90c51cc3-9b38-4383-b3cd-da1ed7045b1d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:46.982748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:46.983745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:46.984703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:46.984703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:46.984703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:46.984703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:46.984703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:46.984703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:46.984703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:46.984703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:46.984703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 06:24:46.984703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:46.988843 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 338/663] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:46.989859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c51cc3-9b38-4383-b3cd-da1ed7045b1d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:47.044548 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 326/664] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:47.045477 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58829916-9dd3-4ce9-a0e6-7dbe1c93d3cf None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:47.066609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:47.121086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c51cc3-9b38-4383-b3cd-da1ed7045b1d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:47.155626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58829916-9dd3-4ce9-a0e6-7dbe1c93d3cf None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:47.157420 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae76c2a-fbae-4d62-8e01-b7d9b0130e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:47.158097 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae76c2a-fbae-4d62-8e01-b7d9b0130e26 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:47.158441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae76c2a-fbae-4d62-8e01-b7d9b0130e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:47.158778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae76c2a-fbae-4d62-8e01-b7d9b0130e26 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:47.159540 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae76c2a-fbae-4d62-8e01-b7d9b0130e26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:47.159915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae76c2a-fbae-4d62-8e01-b7d9b0130e26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:47.161444 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae76c2a-fbae-4d62-8e01-b7d9b0130e26 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:47.174504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 339/665] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:47.179845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae76c2a-fbae-4d62-8e01-b7d9b0130e26 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:47.189861 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8275a-7865-4900-8173-4568c9eba58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:47.192155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8275a-7865-4900-8173-4568c9eba58a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:47.192439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8275a-7865-4900-8173-4568c9eba58a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:47.192745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8275a-7865-4900-8173-4568c9eba58a None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:47.193475 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8275a-7865-4900-8173-4568c9eba58a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:47.193779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8275a-7865-4900-8173-4568c9eba58a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:47.195210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8275a-7865-4900-8173-4568c9eba58a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:47.205767 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:47.221431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 327/666] 10.222.0.42 () {56 vars in 1139 bytes} [Tue Sep 13 06:24:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:47.221431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8275a-7865-4900-8173-4568c9eba58a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:47.287749 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae76c2a-fbae-4d62-8e01-b7d9b0130e26 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:47.301824 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:47.328454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8275a-7865-4900-8173-4568c9eba58a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:47.328829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d969f1-80b5-4548-91c0-66f1e029622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:47.329638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d969f1-80b5-4548-91c0-66f1e029622d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:47.330193 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d969f1-80b5-4548-91c0-66f1e029622d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:47.331385 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d969f1-80b5-4548-91c0-66f1e029622d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:47.344587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d969f1-80b5-4548-91c0-66f1e029622d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:47.346699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d969f1-80b5-4548-91c0-66f1e029622d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:47.361671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848a891-a129-452b-87d9-d4b7126c4ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:47.362290 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848a891-a129-452b-87d9-d4b7126c4ec3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:47.362565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848a891-a129-452b-87d9-d4b7126c4ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:47.362833 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848a891-a129-452b-87d9-d4b7126c4ec3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-10d969f1-80b5-4548-91c0-66f1e029622d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:47.365734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:47.366829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:47.367944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:47.367944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:47.367944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:47.369550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 340/667] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:47.370873 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d969f1-80b5-4548-91c0-66f1e029622d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:47.374017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848a891-a129-452b-87d9-d4b7126c4ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-9848a891-a129-452b-87d9-d4b7126c4ec3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:47.378874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:47.379961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:47.380893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:47.380893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:47.380893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:47.380893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:47.380893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:47.380893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:47.380893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:47.380893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:47.380893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:47.380893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:47.380893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:47.380893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:47.380893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 328/668] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:47.380893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848a891-a129-452b-87d9-d4b7126c4ec3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:47.445168 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:47.485313 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d969f1-80b5-4548-91c0-66f1e029622d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:47.491660 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848a891-a129-452b-87d9-d4b7126c4ec3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:47.520643 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fd8d0-7082-4ab3-b55d-dfb3798dadf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:47.521263 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fd8d0-7082-4ab3-b55d-dfb3798dadf6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:47.521543 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fd8d0-7082-4ab3-b55d-dfb3798dadf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:47.521811 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fd8d0-7082-4ab3-b55d-dfb3798dadf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:47.522532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fd8d0-7082-4ab3-b55d-dfb3798dadf6 None admin] RBAC: Adding query filter params (role.id=dc60d33cb0c649b3b903d99258a19c98, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=8789ed5fef2148e69e9e444d7cfe1e19) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:47.522836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fd8d0-7082-4ab3-b55d-dfb3798dadf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:47.524242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fd8d0-7082-4ab3-b55d-dfb3798dadf6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:47.529940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2882d8-6233-4502-a1c3-db44c7f6b5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:47.530103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 341/669] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:24:47 2022] GET /identity/v3/role_assignments?user.id=8789ed5fef2148e69e9e444d7cfe1e19&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=dc60d33cb0c649b3b903d99258a19c98 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:47.530877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2882d8-6233-4502-a1c3-db44c7f6b5e3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:47.530997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fd8d0-7082-4ab3-b55d-dfb3798dadf6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:47.531437 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2882d8-6233-4502-a1c3-db44c7f6b5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:47.531723 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2882d8-6233-4502-a1c3-db44c7f6b5e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:47.582531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:47.640097 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2882d8-6233-4502-a1c3-db44c7f6b5e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:47.645799 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2882d8-6233-4502-a1c3-db44c7f6b5e3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:47.678549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fd8d0-7082-4ab3-b55d-dfb3798dadf6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:47.717711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fce06-05c5-4f97-bb93-59483637b092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:47.718645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fce06-05c5-4f97-bb93-59483637b092 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:47.719097 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fce06-05c5-4f97-bb93-59483637b092 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:47.719537 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078fce06-05c5-4f97-bb93-59483637b092 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:47.720350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fce06-05c5-4f97-bb93-59483637b092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:47.720858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fce06-05c5-4f97-bb93-59483637b092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:47.722413 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078fce06-05c5-4f97-bb93-59483637b092 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:47.722782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:47.738362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 342/670] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:47.739432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fce06-05c5-4f97-bb93-59483637b092 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:47.774005 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 329/671] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:47.775184 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2882d8-6233-4502-a1c3-db44c7f6b5e3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:47.858134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:47.869636 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078fce06-05c5-4f97-bb93-59483637b092 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:47.905595 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385ab61-94bb-4caf-853c-cdfdaea72fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:47.906201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385ab61-94bb-4caf-853c-cdfdaea72fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:47.906479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385ab61-94bb-4caf-853c-cdfdaea72fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:47.906752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1385ab61-94bb-4caf-853c-cdfdaea72fe3 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:47.907178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2882d8-6233-4502-a1c3-db44c7f6b5e3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:47.907483 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385ab61-94bb-4caf-853c-cdfdaea72fe3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:47.907786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385ab61-94bb-4caf-853c-cdfdaea72fe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:47.909351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1385ab61-94bb-4caf-853c-cdfdaea72fe3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:47.918253 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 343/672] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:47.919678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385ab61-94bb-4caf-853c-cdfdaea72fe3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:47.945205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8ac49-f1fd-4a01-8b5e-99c6f005ba4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:47.946283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8ac49-f1fd-4a01-8b5e-99c6f005ba4b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:47.946787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8ac49-f1fd-4a01-8b5e-99c6f005ba4b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:47.947713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc8ac49-f1fd-4a01-8b5e-99c6f005ba4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:47.955437 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8ac49-f1fd-4a01-8b5e-99c6f005ba4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:47.957247 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc8ac49-f1fd-4a01-8b5e-99c6f005ba4b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:47.969279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-bcc8ac49-f1fd-4a01-8b5e-99c6f005ba4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:47.969279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:47.969279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:47.969279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:47.969279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:47.969279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:47.969279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:47.969279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:47.969279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:47.969279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:47.969279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:47.969279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:47.969279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:47.969279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:47.969279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:47.970287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:47.971178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:47.971178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:47.971178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:47.971178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:47.971178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:47.971178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:47.971178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:47.971178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:47.973355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 330/673] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:47.974371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8ac49-f1fd-4a01-8b5e-99c6f005ba4b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:47.995112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:48.029983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1385ab61-94bb-4caf-853c-cdfdaea72fe3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:48.067160 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c1b03-e290-4355-8b3e-8b9033ab163b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:48.067794 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c1b03-e290-4355-8b3e-8b9033ab163b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:48.068071 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c1b03-e290-4355-8b3e-8b9033ab163b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:48.068343 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064c1b03-e290-4355-8b3e-8b9033ab163b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:48.080175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c1b03-e290-4355-8b3e-8b9033ab163b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:48.081785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064c1b03-e290-4355-8b3e-8b9033ab163b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:48.083774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc8ac49-f1fd-4a01-8b5e-99c6f005ba4b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-064c1b03-e290-4355-8b3e-8b9033ab163b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:48.097219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:48.098226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:48.099121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:48.099121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:48.099121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:48.099121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 344/674] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:48.099782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c1b03-e290-4355-8b3e-8b9033ab163b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:48.103504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:48.126443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe3c4f-bee7-40ea-95db-4eb605e4178e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:48.127413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe3c4f-bee7-40ea-95db-4eb605e4178e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:48.127935 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe3c4f-bee7-40ea-95db-4eb605e4178e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:48.128496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe3c4f-bee7-40ea-95db-4eb605e4178e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:48.139762 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe3c4f-bee7-40ea-95db-4eb605e4178e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:48.141784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe3c4f-bee7-40ea-95db-4eb605e4178e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e2fe3c4f-bee7-40ea-95db-4eb605e4178e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:48.158086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:48.159517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:48.160402 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:48.160402 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:48.160402 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:48.162570 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 331/675] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:48.163561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe3c4f-bee7-40ea-95db-4eb605e4178e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:48.217331 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064c1b03-e290-4355-8b3e-8b9033ab163b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:48.237201 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:48.255829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0dd90-c76b-4191-b7f9-c0f215e2e94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:48.256599 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0dd90-c76b-4191-b7f9-c0f215e2e94c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:48.256901 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0dd90-c76b-4191-b7f9-c0f215e2e94c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:48.257171 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0dd90-c76b-4191-b7f9-c0f215e2e94c None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:48.257860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0dd90-c76b-4191-b7f9-c0f215e2e94c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:48.258166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0dd90-c76b-4191-b7f9-c0f215e2e94c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:48.259596 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0dd90-c76b-4191-b7f9-c0f215e2e94c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:48.273361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe3c4f-bee7-40ea-95db-4eb605e4178e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:48.273537 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 345/676] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:48.274393 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0dd90-c76b-4191-b7f9-c0f215e2e94c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:48.310565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca2701-0c7c-4922-8c35-31a0c8f6cf9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:48.311757 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca2701-0c7c-4922-8c35-31a0c8f6cf9e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:48.312233 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca2701-0c7c-4922-8c35-31a0c8f6cf9e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:48.312763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ca2701-0c7c-4922-8c35-31a0c8f6cf9e None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:48.313599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca2701-0c7c-4922-8c35-31a0c8f6cf9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:48.314096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca2701-0c7c-4922-8c35-31a0c8f6cf9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:48.315645 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ca2701-0c7c-4922-8c35-31a0c8f6cf9e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:48.329912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 332/677] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:48.331083 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca2701-0c7c-4922-8c35-31a0c8f6cf9e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:48.343018 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:48.385125 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0dd90-c76b-4191-b7f9-c0f215e2e94c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:48.427602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff0c55-45eb-414f-98e2-790fc54b6737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:48.428170 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff0c55-45eb-414f-98e2-790fc54b6737 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:48.428449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff0c55-45eb-414f-98e2-790fc54b6737 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:48.428765 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff0c55-45eb-414f-98e2-790fc54b6737 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:48.429644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff0c55-45eb-414f-98e2-790fc54b6737 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:48.429836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff0c55-45eb-414f-98e2-790fc54b6737 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:48.431243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff0c55-45eb-414f-98e2-790fc54b6737 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:48.445083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 346/678] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:48.446088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff0c55-45eb-414f-98e2-790fc54b6737 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:48.446855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ca2701-0c7c-4922-8c35-31a0c8f6cf9e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:48.477965 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:48.488643 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ea2d4-e938-4da4-8b81-dc5eb6024ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:48.489681 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ea2d4-e938-4da4-8b81-dc5eb6024ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:48.490505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ea2d4-e938-4da4-8b81-dc5eb6024ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:48.491427 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379ea2d4-e938-4da4-8b81-dc5eb6024ea9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:48.492370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ea2d4-e938-4da4-8b81-dc5eb6024ea9 None admin] RBAC: Adding query filter params (role.id=dc60d33cb0c649b3b903d99258a19c98, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=ddc0c92f881e40c9abe067d3a6d4251b) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:48.493072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ea2d4-e938-4da4-8b81-dc5eb6024ea9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:48.495132 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379ea2d4-e938-4da4-8b81-dc5eb6024ea9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:48.504394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 333/679] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:24:48 2022] GET /identity/v3/role_assignments?user.id=ddc0c92f881e40c9abe067d3a6d4251b&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=dc60d33cb0c649b3b903d99258a19c98 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:48.505512 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ea2d4-e938-4da4-8b81-dc5eb6024ea9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:48.562750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff0c55-45eb-414f-98e2-790fc54b6737 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:48.602670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:48.619323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d28d4b2-9a78-4465-86d7-2b82f8c744b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:48.620253 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28d4b2-9a78-4465-86d7-2b82f8c744b7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:48.620537 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28d4b2-9a78-4465-86d7-2b82f8c744b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:48.620844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28d4b2-9a78-4465-86d7-2b82f8c744b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:48.630259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28d4b2-9a78-4465-86d7-2b82f8c744b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:48.632028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d28d4b2-9a78-4465-86d7-2b82f8c744b7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:48.633407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379ea2d4-e938-4da4-8b81-dc5eb6024ea9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:48.650251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-7d28d4b2-9a78-4465-86d7-2b82f8c744b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:48.650251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:48.650251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:48.650251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:48.650251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:48.650251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:48.650251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:48.650251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:48.650251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:48.650251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:48.650251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:48.650251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:48.650251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:48.650251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:48.650251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:48.651241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:48.652134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:48.652134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:48.652134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:48.652134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:48.652134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:48.652134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:48.652134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:48.652134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:48.652134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 347/680] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:48.653155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388ffd3-cdb6-4677-883b-030305ec9143 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:48.653324 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388ffd3-cdb6-4677-883b-030305ec9143 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:48.653596 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d388ffd3-cdb6-4677-883b-030305ec9143 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:48.658850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 348/681] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:48.658850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388ffd3-cdb6-4677-883b-030305ec9143 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:48.690351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610b5e89-676f-4c3b-bd33-c84f581a6641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:48.691255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b5e89-676f-4c3b-bd33-c84f581a6641 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:48.691684 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b5e89-676f-4c3b-bd33-c84f581a6641 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:48.692266 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610b5e89-676f-4c3b-bd33-c84f581a6641 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:48.702532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b5e89-676f-4c3b-bd33-c84f581a6641 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:48.704743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610b5e89-676f-4c3b-bd33-c84f581a6641 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-610b5e89-676f-4c3b-bd33-c84f581a6641 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:48.717073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:48.718044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:48.718990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:48.718990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:48.718990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:48.718990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:48.718990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:48.718990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:48.718990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:48.718990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:48.718990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:24:48.718990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:48.718990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 334/682] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:24:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:48.719589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9191446-3a7c-45f0-b0a1-73990bc7fada None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:48.719589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9191446-3a7c-45f0-b0a1-73990bc7fada None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:48.720541 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9191446-3a7c-45f0-b0a1-73990bc7fada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:48.742296 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d9191446-3a7c-45f0-b0a1-73990bc7fada None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:48.743498 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d9191446-3a7c-45f0-b0a1-73990bc7fada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:48.793518 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d388ffd3-cdb6-4677-883b-030305ec9143 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:48.813491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:48.837458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 335/683] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:48.838425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9191446-3a7c-45f0-b0a1-73990bc7fada None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:48.849078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea58ac9-84dc-4e38-ac4b-5e4f815bc7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:48.850060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea58ac9-84dc-4e38-ac4b-5e4f815bc7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:48.850344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea58ac9-84dc-4e38-ac4b-5e4f815bc7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:48.850627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea58ac9-84dc-4e38-ac4b-5e4f815bc7c2 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:48.851812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea58ac9-84dc-4e38-ac4b-5e4f815bc7c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:48.852247 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea58ac9-84dc-4e38-ac4b-5e4f815bc7c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:48.853933 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea58ac9-84dc-4e38-ac4b-5e4f815bc7c2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:48.878139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 349/684] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:48.883234 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea58ac9-84dc-4e38-ac4b-5e4f815bc7c2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:48.951770 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:49.003150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9191446-3a7c-45f0-b0a1-73990bc7fada None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:49.031059 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea58ac9-84dc-4e38-ac4b-5e4f815bc7c2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:49.039548 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172eaf7-1934-43df-a881-afb0f988fc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:49.040378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172eaf7-1934-43df-a881-afb0f988fc05 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:49.040840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172eaf7-1934-43df-a881-afb0f988fc05 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:49.041262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172eaf7-1934-43df-a881-afb0f988fc05 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:49.042140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172eaf7-1934-43df-a881-afb0f988fc05 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:49.042627 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172eaf7-1934-43df-a881-afb0f988fc05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:49.044213 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172eaf7-1934-43df-a881-afb0f988fc05 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:49.062590 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 336/685] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Sep 13 06:24:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:49.069621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172eaf7-1934-43df-a881-afb0f988fc05 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:49.090726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593204ee-d73f-4f77-8fb8-9537e4ea2b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:49.091690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593204ee-d73f-4f77-8fb8-9537e4ea2b2b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:49.092151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593204ee-d73f-4f77-8fb8-9537e4ea2b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:49.092593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593204ee-d73f-4f77-8fb8-9537e4ea2b2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:49.093512 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593204ee-d73f-4f77-8fb8-9537e4ea2b2b None admin] RBAC: Adding query filter params (role.id=dc60d33cb0c649b3b903d99258a19c98, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=a5efc921a219444bb0b45e8b4d08dcc5) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:49.093993 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593204ee-d73f-4f77-8fb8-9537e4ea2b2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:49.095768 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593204ee-d73f-4f77-8fb8-9537e4ea2b2b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:49.107440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 350/686] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:24:48 2022] GET /identity/v3/role_assignments?user.id=a5efc921a219444bb0b45e8b4d08dcc5&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=dc60d33cb0c649b3b903d99258a19c98 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:49.131925 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:49.197561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172eaf7-1934-43df-a881-afb0f988fc05 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:49.235708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545e840-6926-461b-a235-5374728f1330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:49.236723 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545e840-6926-461b-a235-5374728f1330 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:49.237181 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545e840-6926-461b-a235-5374728f1330 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:49.237645 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545e840-6926-461b-a235-5374728f1330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:49.248688 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593204ee-d73f-4f77-8fb8-9537e4ea2b2b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:49.368122 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545e840-6926-461b-a235-5374728f1330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:49.369695 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545e840-6926-461b-a235-5374728f1330 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:49.397073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593204ee-d73f-4f77-8fb8-9537e4ea2b2b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:49.417140 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:49.425046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:49.447569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b069d-6b3d-425e-99f7-dae84a600306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:49.448598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b069d-6b3d-425e-99f7-dae84a600306 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:49.448924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b069d-6b3d-425e-99f7-dae84a600306 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:49.449446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150b069d-6b3d-425e-99f7-dae84a600306 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:49.470433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150b069d-6b3d-425e-99f7-dae84a600306 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-150b069d-6b3d-425e-99f7-dae84a600306 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:49.480793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:49.482369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:49.483208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:49.483208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:49.483208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:49.483208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:49.483208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:49.483208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:49.483208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:49.483208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:49.483208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:49.483208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:49.483208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:24:49.483208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:49.483880 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 351/687] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:24:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:24:49.489499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b069d-6b3d-425e-99f7-dae84a600306 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:49.513119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 337/688] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:49.521950 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545e840-6926-461b-a235-5374728f1330 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:49.651829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150b069d-6b3d-425e-99f7-dae84a600306 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:49.698416 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d30c1-3db1-4183-8fe5-dc9acc99bf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:49.699036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d30c1-3db1-4183-8fe5-dc9acc99bf0e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:49.699314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d30c1-3db1-4183-8fe5-dc9acc99bf0e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:49.699585 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d30c1-3db1-4183-8fe5-dc9acc99bf0e None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:49.700272 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d30c1-3db1-4183-8fe5-dc9acc99bf0e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:49.701850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d30c1-3db1-4183-8fe5-dc9acc99bf0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:49.703335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d30c1-3db1-4183-8fe5-dc9acc99bf0e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:49.713419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 352/689] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:49.719599 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d30c1-3db1-4183-8fe5-dc9acc99bf0e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:49.735431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545e840-6926-461b-a235-5374728f1330 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:49.789188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:49.792510 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270ece5-01ba-4edf-842d-d115f3c6d06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:49.793427 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270ece5-01ba-4edf-842d-d115f3c6d06c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:49.793427 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270ece5-01ba-4edf-842d-d115f3c6d06c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:49.793711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1270ece5-01ba-4edf-842d-d115f3c6d06c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:49.808709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270ece5-01ba-4edf-842d-d115f3c6d06c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:49.810446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1270ece5-01ba-4edf-842d-d115f3c6d06c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:49.812957 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1270ece5-01ba-4edf-842d-d115f3c6d06c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:49.831396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:49.832439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:49.833361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:49.833361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:49.833361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:49.833361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 338/690] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:49.838785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270ece5-01ba-4edf-842d-d115f3c6d06c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:49.934880 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d30c1-3db1-4183-8fe5-dc9acc99bf0e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:49.972489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4526d-a585-4d18-8e9d-43fa9a6a1192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:49.973154 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4526d-a585-4d18-8e9d-43fa9a6a1192 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:49.973850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4526d-a585-4d18-8e9d-43fa9a6a1192 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:49.974128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4526d-a585-4d18-8e9d-43fa9a6a1192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:49.985351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4526d-a585-4d18-8e9d-43fa9a6a1192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:49.986865 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4526d-a585-4d18-8e9d-43fa9a6a1192 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-acc4526d-a585-4d18-8e9d-43fa9a6a1192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:50.002162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:50.003147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:50.004138 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:50.004138 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:50.004138 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:50.004138 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 353/691] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:50.010934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4526d-a585-4d18-8e9d-43fa9a6a1192 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:50.036634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1270ece5-01ba-4edf-842d-d115f3c6d06c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:50.071483 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c1e786-af48-46f0-a1f5-20d4e2d5afd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:50.072017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1e786-af48-46f0-a1f5-20d4e2d5afd9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:50.072299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1e786-af48-46f0-a1f5-20d4e2d5afd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:50.072570 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c1e786-af48-46f0-a1f5-20d4e2d5afd9 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:50.073242 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1e786-af48-46f0-a1f5-20d4e2d5afd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:50.073543 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1e786-af48-46f0-a1f5-20d4e2d5afd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:50.074897 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c1e786-af48-46f0-a1f5-20d4e2d5afd9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:50.087933 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 339/692] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:50.089343 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a230464-bfbb-4d58-a22a-f02243fe765c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:50.089626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a230464-bfbb-4d58-a22a-f02243fe765c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:50.089900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a230464-bfbb-4d58-a22a-f02243fe765c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:50.091437 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 340/693] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:50.093309 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a230464-bfbb-4d58-a22a-f02243fe765c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:50.114603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:50.137048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4526d-a585-4d18-8e9d-43fa9a6a1192 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:50.155755 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:50.179498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc50060-2a45-4f21-8eb3-3f0b5e3a006f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:50.180004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc50060-2a45-4f21-8eb3-3f0b5e3a006f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:50.180290 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc50060-2a45-4f21-8eb3-3f0b5e3a006f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:50.180565 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc50060-2a45-4f21-8eb3-3f0b5e3a006f None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:50.181256 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc50060-2a45-4f21-8eb3-3f0b5e3a006f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:50.181562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc50060-2a45-4f21-8eb3-3f0b5e3a006f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:50.183071 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc50060-2a45-4f21-8eb3-3f0b5e3a006f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:50.201428 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 354/694] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:50.202924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b270a4-81de-46c3-a49d-6cbee30dd733 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:50.203253 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b270a4-81de-46c3-a49d-6cbee30dd733 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:50.203488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b270a4-81de-46c3-a49d-6cbee30dd733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:50.205972 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a230464-bfbb-4d58-a22a-f02243fe765c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:50.223101 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-37b270a4-81de-46c3-a49d-6cbee30dd733 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:50.224648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-37b270a4-81de-46c3-a49d-6cbee30dd733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:50.241528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ee415-d172-49e2-8da0-3164eed2eef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:50.242385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ee415-d172-49e2-8da0-3164eed2eef0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:50.242814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ee415-d172-49e2-8da0-3164eed2eef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:50.243231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ee415-d172-49e2-8da0-3164eed2eef0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:50.251146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ee415-d172-49e2-8da0-3164eed2eef0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:50.252781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ee415-d172-49e2-8da0-3164eed2eef0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:50.264732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1f1ee415-d172-49e2-8da0-3164eed2eef0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:50.264732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:50.264732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:50.264732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:50.264732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:50.264732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:50.264732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:50.264732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:50.264732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:50.264732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:50.264732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:50.264732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:50.264732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:50.264732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:50.264732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:50.265814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:50.266852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:50.266852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:50.266852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:50.266852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:50.266852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:50.266852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:50.266852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:50.266852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:50.268779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 341/695] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:24:50.269827 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ee415-d172-49e2-8da0-3164eed2eef0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:50.308586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 355/696] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:50.310254 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b270a4-81de-46c3-a49d-6cbee30dd733 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:50.377443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ee415-d172-49e2-8da0-3164eed2eef0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:50.392364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:50.417855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead20545-f766-4a41-ae06-b95918beb79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:50.419691 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead20545-f766-4a41-ae06-b95918beb79b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:50.420157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead20545-f766-4a41-ae06-b95918beb79b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:50.421672 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead20545-f766-4a41-ae06-b95918beb79b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:50.437743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead20545-f766-4a41-ae06-b95918beb79b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:50.438278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:50.439536 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead20545-f766-4a41-ae06-b95918beb79b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ead20545-f766-4a41-ae06-b95918beb79b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:50.463773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:50.464838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:50.465842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:50.465842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:50.465842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:50.465842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:50.465842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:50.465842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:50.465842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:50.465842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:50.465842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:24:50.465842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:50.466565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 342/697] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 13 06:24:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:50.471422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead20545-f766-4a41-ae06-b95918beb79b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:50.486536 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b270a4-81de-46c3-a49d-6cbee30dd733 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:50.561380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76939228-b262-4964-b411-fb0adee3cfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:50.561998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76939228-b262-4964-b411-fb0adee3cfaa None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:50.562275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76939228-b262-4964-b411-fb0adee3cfaa None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:50.562547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76939228-b262-4964-b411-fb0adee3cfaa None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:50.563249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76939228-b262-4964-b411-fb0adee3cfaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:50.563551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76939228-b262-4964-b411-fb0adee3cfaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:50.564999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76939228-b262-4964-b411-fb0adee3cfaa None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:50.585576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 356/698] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:50.591056 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76939228-b262-4964-b411-fb0adee3cfaa None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:50.612147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead20545-f766-4a41-ae06-b95918beb79b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:50.649080 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f2cd2-d5c5-4ec4-8b20-d91a5a9eb164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:50.649699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f2cd2-d5c5-4ec4-8b20-d91a5a9eb164 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:50.650038 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f2cd2-d5c5-4ec4-8b20-d91a5a9eb164 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:50.650310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3f2cd2-d5c5-4ec4-8b20-d91a5a9eb164 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:50.651103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f2cd2-d5c5-4ec4-8b20-d91a5a9eb164 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:50.651412 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f2cd2-d5c5-4ec4-8b20-d91a5a9eb164 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:50.652910 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3f2cd2-d5c5-4ec4-8b20-d91a5a9eb164 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:50.673598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 343/699] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 13 06:24:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:50.681675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f2cd2-d5c5-4ec4-8b20-d91a5a9eb164 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:50.738537 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76939228-b262-4964-b411-fb0adee3cfaa None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:50.740128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:50.780294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:50.785675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857359d-7528-4cd7-8d04-131eef034e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:50.786294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857359d-7528-4cd7-8d04-131eef034e69 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:50.786575 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857359d-7528-4cd7-8d04-131eef034e69 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:50.786852 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857359d-7528-4cd7-8d04-131eef034e69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:50.788011 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857359d-7528-4cd7-8d04-131eef034e69 None admin] RBAC: Adding query filter params (role.id=dc60d33cb0c649b3b903d99258a19c98, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=de05d038c2124f43a3acc70f4fb5b44e) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:50.788328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857359d-7528-4cd7-8d04-131eef034e69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:50.790160 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857359d-7528-4cd7-8d04-131eef034e69 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:50.798630 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 357/700] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:24:50 2022] GET /identity/v3/role_assignments?user.id=de05d038c2124f43a3acc70f4fb5b44e&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=dc60d33cb0c649b3b903d99258a19c98 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:50.799446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857359d-7528-4cd7-8d04-131eef034e69 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:50.841929 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3f2cd2-d5c5-4ec4-8b20-d91a5a9eb164 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:50.925750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857359d-7528-4cd7-8d04-131eef034e69 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:50.953429 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf4b88d-3606-4ba1-9ccc-15d6cd1e7d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:50.954054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4b88d-3606-4ba1-9ccc-15d6cd1e7d63 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:50.954330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4b88d-3606-4ba1-9ccc-15d6cd1e7d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:50.954600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf4b88d-3606-4ba1-9ccc-15d6cd1e7d63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:50.970181 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d69bb-604e-4167-9f06-6011c4487fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:50.970843 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d69bb-604e-4167-9f06-6011c4487fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:50.971122 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d69bb-604e-4167-9f06-6011c4487fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:50.971396 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4d69bb-604e-4167-9f06-6011c4487fd6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:50.971993 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d69bb-604e-4167-9f06-6011c4487fd6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:50.974192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4d69bb-604e-4167-9f06-6011c4487fd6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-6c4d69bb-604e-4167-9f06-6011c4487fd6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:50.988660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:50.991070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:50.993177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:50.993177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:50.993177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:50.993177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:50.993177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:50.993177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:50.993177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:50.993177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:50.993177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:50.993177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:50.993177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:24:50.993177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:24:50.993177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:24:50.993177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:50.993177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 358/701] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Sep 13 06:24:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:51.002573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d69bb-604e-4167-9f06-6011c4487fd6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:51.078115 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:51.108066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4b88d-3606-4ba1-9ccc-15d6cd1e7d63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:51.113361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf4b88d-3606-4ba1-9ccc-15d6cd1e7d63 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:51.135168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4d69bb-604e-4167-9f06-6011c4487fd6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:51.152106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:51.184589 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc49de8-d7fd-4726-b891-9f6e9c52948e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:51.185717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc49de8-d7fd-4726-b891-9f6e9c52948e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:51.186001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc49de8-d7fd-4726-b891-9f6e9c52948e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:51.186269 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc49de8-d7fd-4726-b891-9f6e9c52948e None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:51.187252 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc49de8-d7fd-4726-b891-9f6e9c52948e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:51.187252 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc49de8-d7fd-4726-b891-9f6e9c52948e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:51.189908 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc49de8-d7fd-4726-b891-9f6e9c52948e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:51.194828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 359/702] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Sep 13 06:24:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:51.195786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769bfb2-8f04-47a3-93a0-cadd51b7699b None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:51.196072 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769bfb2-8f04-47a3-93a0-cadd51b7699b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:51.196349 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e769bfb2-8f04-47a3-93a0-cadd51b7699b None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:51.197946 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 360/703] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:51.202933 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769bfb2-8f04-47a3-93a0-cadd51b7699b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:51.251135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 344/704] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:51.252463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ec22b-1638-4d28-9bad-a856040b7d1e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:51.252896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ec22b-1638-4d28-9bad-a856040b7d1e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:51.253188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ec22b-1638-4d28-9bad-a856040b7d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:51.272234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d82ec22b-1638-4d28-9bad-a856040b7d1e None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:51.273611 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d82ec22b-1638-4d28-9bad-a856040b7d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:51.344061 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e769bfb2-8f04-47a3-93a0-cadd51b7699b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:51.346995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 345/705] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:51.348137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ec22b-1638-4d28-9bad-a856040b7d1e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:51.376726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:51.391408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205185f6-e12e-4b3b-91ea-a935daecf6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:51.392840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205185f6-e12e-4b3b-91ea-a935daecf6e7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:51.393362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205185f6-e12e-4b3b-91ea-a935daecf6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:51.393865 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205185f6-e12e-4b3b-91ea-a935daecf6e7 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:51.395113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205185f6-e12e-4b3b-91ea-a935daecf6e7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:51.395978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205185f6-e12e-4b3b-91ea-a935daecf6e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:51.397929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205185f6-e12e-4b3b-91ea-a935daecf6e7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:51.405825 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 361/706] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Sep 13 06:24:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:51.432997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:51.496103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ec22b-1638-4d28-9bad-a856040b7d1e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:51.547449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565507b7-f038-4088-bbd7-323370de617d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:51.548111 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565507b7-f038-4088-bbd7-323370de617d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:51.548387 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565507b7-f038-4088-bbd7-323370de617d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:51.548655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565507b7-f038-4088-bbd7-323370de617d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:51.564779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565507b7-f038-4088-bbd7-323370de617d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:51.566274 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565507b7-f038-4088-bbd7-323370de617d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-565507b7-f038-4088-bbd7-323370de617d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:51.587334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:51.588365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:51.589888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:51.589888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:51.589888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:51.589888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 346/707] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:51.595379 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205185f6-e12e-4b3b-91ea-a935daecf6e7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:51.677660 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad5327-df14-4838-962d-021eff33458a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:51.678117 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad5327-df14-4838-962d-021eff33458a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:51.678293 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ad5327-df14-4838-962d-021eff33458a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:51.680002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 347/708] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:51.686137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4c66b-65d5-475f-8569-250a81ec8a2f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:51.686475 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4c66b-65d5-475f-8569-250a81ec8a2f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:51.686674 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4c66b-65d5-475f-8569-250a81ec8a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:51.717628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-28e4c66b-65d5-475f-8569-250a81ec8a2f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:51.718975 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-28e4c66b-65d5-475f-8569-250a81ec8a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:51.734269 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205185f6-e12e-4b3b-91ea-a935daecf6e7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:51.777180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5d158-a868-43ed-b722-11bf5424f565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:51.778025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5d158-a868-43ed-b722-11bf5424f565 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:51.779376 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5d158-a868-43ed-b722-11bf5424f565 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:51.779376 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e5d158-a868-43ed-b722-11bf5424f565 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:51.779739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5d158-a868-43ed-b722-11bf5424f565 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:51.781333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5d158-a868-43ed-b722-11bf5424f565 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:51.781541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e5d158-a868-43ed-b722-11bf5424f565 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:51.794501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 362/709] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:51.795746 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5d158-a868-43ed-b722-11bf5424f565 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:51.809041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 348/710] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:24:51.813418 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4c66b-65d5-475f-8569-250a81ec8a2f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:51.851505 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:51.906658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e5d158-a868-43ed-b722-11bf5424f565 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:51.910606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:51.944548 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694f88e-50a5-46b3-adb0-7bb66ee9f8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:51.945576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694f88e-50a5-46b3-adb0-7bb66ee9f8f6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:51.946063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694f88e-50a5-46b3-adb0-7bb66ee9f8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:51.946538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8694f88e-50a5-46b3-adb0-7bb66ee9f8f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:51.958829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694f88e-50a5-46b3-adb0-7bb66ee9f8f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:51.960706 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8694f88e-50a5-46b3-adb0-7bb66ee9f8f6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-8694f88e-50a5-46b3-adb0-7bb66ee9f8f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:51.987844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:51.988909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:51.989832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:51.989832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:51.989832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:52.000397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 363/711] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:52.002512 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694f88e-50a5-46b3-adb0-7bb66ee9f8f6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:52.078701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4c66b-65d5-475f-8569-250a81ec8a2f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:52.113412 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8694f88e-50a5-46b3-adb0-7bb66ee9f8f6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:52.117030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:52.151003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c43522-1247-4139-a179-737b4e2a0a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:52.151614 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c43522-1247-4139-a179-737b4e2a0a7c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:52.151893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c43522-1247-4139-a179-737b4e2a0a7c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:52.152166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c43522-1247-4139-a179-737b4e2a0a7c None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:52.152858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c43522-1247-4139-a179-737b4e2a0a7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:52.153164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c43522-1247-4139-a179-737b4e2a0a7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:52.154659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c43522-1247-4139-a179-737b4e2a0a7c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:52.172571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 364/712] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:52.173540 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c43522-1247-4139-a179-737b4e2a0a7c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:52.174674 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8829a-6eaf-4f13-b3f3-bc54608215d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:52.175532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8829a-6eaf-4f13-b3f3-bc54608215d1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:52.176038 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8829a-6eaf-4f13-b3f3-bc54608215d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:52.176520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8829a-6eaf-4f13-b3f3-bc54608215d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:52.183728 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8829a-6eaf-4f13-b3f3-bc54608215d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:52.186159 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8829a-6eaf-4f13-b3f3-bc54608215d1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:52.199700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-fcd8829a-6eaf-4f13-b3f3-bc54608215d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:52.199700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:52.199700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:52.199700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:52.199700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:52.199700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:52.199700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:52.199700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:52.199700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:52.199700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:52.199700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:52.199700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:52.199700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:52.199700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:52.199700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:52.200633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:52.201669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:52.201669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:52.201669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:52.201669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:52.201669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:52.201669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:52.201669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:52.201669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:52.202813 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 349/713] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:52.204478 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8829a-6eaf-4f13-b3f3-bc54608215d1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:52.291414 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c43522-1247-4139-a179-737b4e2a0a7c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:52.324350 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8829a-6eaf-4f13-b3f3-bc54608215d1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:52.328983 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:52.331266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fecc028-798e-48d4-b6fd-d821cdc78400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:52.331953 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecc028-798e-48d4-b6fd-d821cdc78400 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:52.332270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecc028-798e-48d4-b6fd-d821cdc78400 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:52.332559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fecc028-798e-48d4-b6fd-d821cdc78400 None admin] PATH_INFO: `/v3/services/network` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:52.333200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fecc028-798e-48d4-b6fd-d821cdc78400 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:52.334569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fecc028-798e-48d4-b6fd-d821cdc78400 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2fecc028-798e-48d4-b6fd-d821cdc78400 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:52.345635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:52.346666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:52.347520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:52.347520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:52.347520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:52.347520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:52.347520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:52.347520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:52.347520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:52.347520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:52.347520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:52.347520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:52.347520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:24:52.347520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:24:52.347520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:24:52.347520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:52.347520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 365/714] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:52 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:52.348322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fecc028-798e-48d4-b6fd-d821cdc78400 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:52.375959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e915918-0658-4445-a5d8-e7a5263ba8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:52.376569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e915918-0658-4445-a5d8-e7a5263ba8ac None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:52.376960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e915918-0658-4445-a5d8-e7a5263ba8ac None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:52.377235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e915918-0658-4445-a5d8-e7a5263ba8ac None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:52.378084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e915918-0658-4445-a5d8-e7a5263ba8ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:52.379839 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e915918-0658-4445-a5d8-e7a5263ba8ac None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:52.385974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:52.412754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 350/715] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:24:52 2022] POST /identity/v3/users => generated 254 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:24:52.414216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e915918-0658-4445-a5d8-e7a5263ba8ac None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:52.563435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fecc028-798e-48d4-b6fd-d821cdc78400 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:52.585196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e915918-0658-4445-a5d8-e7a5263ba8ac None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:52.631567 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae299d-3e83-4c3c-af54-46feef507a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:52.633428 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae299d-3e83-4c3c-af54-46feef507a62 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:52.633893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae299d-3e83-4c3c-af54-46feef507a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:52.634371 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae299d-3e83-4c3c-af54-46feef507a62 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:52.635730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae299d-3e83-4c3c-af54-46feef507a62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:52.636488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae299d-3e83-4c3c-af54-46feef507a62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:52.638559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae299d-3e83-4c3c-af54-46feef507a62 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:52.640462 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fc9f9-d7a0-4e7d-a952-185f3c5dc0a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:52.643816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc9f9-d7a0-4e7d-a952-185f3c5dc0a7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:52.643816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc9f9-d7a0-4e7d-a952-185f3c5dc0a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:52.643816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5fc9f9-d7a0-4e7d-a952-185f3c5dc0a7 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:52.643816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fc9f9-d7a0-4e7d-a952-185f3c5dc0a7 None admin] RBAC: Adding query filter params (name=network) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:52.643816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fc9f9-d7a0-4e7d-a952-185f3c5dc0a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:52.644220 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5fc9f9-d7a0-4e7d-a952-185f3c5dc0a7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:52.650880 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 351/716] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 13 06:24:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:52.659103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fc9f9-d7a0-4e7d-a952-185f3c5dc0a7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:52.663840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 366/717] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:52.669741 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae299d-3e83-4c3c-af54-46feef507a62 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:52.696772 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:52.762697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:52.781963 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae299d-3e83-4c3c-af54-46feef507a62 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:52.782619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5fc9f9-d7a0-4e7d-a952-185f3c5dc0a7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:52.818332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a51ef0-1ceb-44ea-8987-49e08f9d7729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:52.819325 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a51ef0-1ceb-44ea-8987-49e08f9d7729 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:52.819451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c380d7f-7bed-496f-9cb3-35d65617ed86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:52.819953 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a51ef0-1ceb-44ea-8987-49e08f9d7729 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:52.820091 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c380d7f-7bed-496f-9cb3-35d65617ed86 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:52.820341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c380d7f-7bed-496f-9cb3-35d65617ed86 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:52.820698 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c380d7f-7bed-496f-9cb3-35d65617ed86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:52.820928 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a51ef0-1ceb-44ea-8987-49e08f9d7729 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:52.821590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c380d7f-7bed-496f-9cb3-35d65617ed86 None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=7fbb67072ba544e39073787eb25fcf1e) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:52.821977 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c380d7f-7bed-496f-9cb3-35d65617ed86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:52.822079 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a51ef0-1ceb-44ea-8987-49e08f9d7729 None admin] RBAC: Adding query filter params (type=network) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:52.822592 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a51ef0-1ceb-44ea-8987-49e08f9d7729 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:52.823559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c380d7f-7bed-496f-9cb3-35d65617ed86 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:52.824312 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a51ef0-1ceb-44ea-8987-49e08f9d7729 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:52.830647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 367/718] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:24:52 2022] GET /identity/v3/role_assignments?user.id=7fbb67072ba544e39073787eb25fcf1e&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=6382a06103714d068409d25cbeb48744 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:52.831318 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 352/719] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 13 06:24:52 2022] GET /identity/v3/services?type=network => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:53.474695 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccc12b-23d9-471f-b3bb-0214746f62ed None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:53.475450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccc12b-23d9-471f-b3bb-0214746f62ed None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:53.475957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccc12b-23d9-471f-b3bb-0214746f62ed None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:53.477798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 368/720] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:53.483039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e9eb4-37af-4dc8-bca7-fb41ccdbb5fa None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:53.483921 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e9eb4-37af-4dc8-bca7-fb41ccdbb5fa None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:53.484400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e9eb4-37af-4dc8-bca7-fb41ccdbb5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:53.507709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0f5e9eb4-37af-4dc8-bca7-fb41ccdbb5fa None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:53.509346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0f5e9eb4-37af-4dc8-bca7-fb41ccdbb5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:53.592289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 353/721] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:24:53.909409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccc12b-23d9-471f-b3bb-0214746f62ed None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:54.045838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccc12b-23d9-471f-b3bb-0214746f62ed None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:54.078605 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9c369-bc53-4849-90b9-593e75e8f66f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:54.078929 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9c369-bc53-4849-90b9-593e75e8f66f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:54.079145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f9c369-bc53-4849-90b9-593e75e8f66f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:54.080701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 354/722] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:54.085661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80862c0d-1958-40bc-ad04-90443cf54e15 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:54.085941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80862c0d-1958-40bc-ad04-90443cf54e15 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:54.086220 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80862c0d-1958-40bc-ad04-90443cf54e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:54.099588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d80a5e-14c1-4b71-8497-c1a364882e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:54.100218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d80a5e-14c1-4b71-8497-c1a364882e22 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:54.100497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d80a5e-14c1-4b71-8497-c1a364882e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:54.100799 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d80a5e-14c1-4b71-8497-c1a364882e22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:54.111681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d80a5e-14c1-4b71-8497-c1a364882e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-a1d80a5e-14c1-4b71-8497-c1a364882e22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:54.116397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:54.117470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:54.118360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:54.118360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:54.118360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:54.118360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:54.118360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:54.118360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:54.118360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:54.118360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:54.118360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:54.118360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:54.118360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:24:54.118360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:54.118360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 369/723] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:24:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:54.123990 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d80a5e-14c1-4b71-8497-c1a364882e22 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:54.126613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-80862c0d-1958-40bc-ad04-90443cf54e15 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:54.128024 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-80862c0d-1958-40bc-ad04-90443cf54e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:54.146849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:54.161112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:54.207053 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 355/724] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:24:54.344751 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d80a5e-14c1-4b71-8497-c1a364882e22 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:54.397524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496855ca-df5f-40da-a0a2-4178ae002d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:54.398147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496855ca-df5f-40da-a0a2-4178ae002d92 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:54.398425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496855ca-df5f-40da-a0a2-4178ae002d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:54.398695 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496855ca-df5f-40da-a0a2-4178ae002d92 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:54.399432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496855ca-df5f-40da-a0a2-4178ae002d92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:54.399743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496855ca-df5f-40da-a0a2-4178ae002d92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:54.401264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496855ca-df5f-40da-a0a2-4178ae002d92 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:54.415073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 370/725] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:54.421274 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80862c0d-1958-40bc-ad04-90443cf54e15 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:54.553353 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496855ca-df5f-40da-a0a2-4178ae002d92 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:54.571304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80862c0d-1958-40bc-ad04-90443cf54e15 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:54.638206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08488bc4-4e8d-4e8e-9191-0da8be1c6538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:54.638835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08488bc4-4e8d-4e8e-9191-0da8be1c6538 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:54.639115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08488bc4-4e8d-4e8e-9191-0da8be1c6538 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:54.639386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08488bc4-4e8d-4e8e-9191-0da8be1c6538 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:54.659900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08488bc4-4e8d-4e8e-9191-0da8be1c6538 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:54.661375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08488bc4-4e8d-4e8e-9191-0da8be1c6538 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:54.662082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:54.681064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-08488bc4-4e8d-4e8e-9191-0da8be1c6538 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:54.688315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:54.689286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:54.690172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:54.690172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:54.690172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:54.690846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 356/726] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:54.697481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08488bc4-4e8d-4e8e-9191-0da8be1c6538 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:54.713993 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496855ca-df5f-40da-a0a2-4178ae002d92 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:54.781438 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cb92c-f6ab-43d4-929f-4b8a4c651698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:54.782359 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cb92c-f6ab-43d4-929f-4b8a4c651698 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:54.782789 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cb92c-f6ab-43d4-929f-4b8a4c651698 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:54.783208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cb92c-f6ab-43d4-929f-4b8a4c651698 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:54.784025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11cb92c-f6ab-43d4-929f-4b8a4c651698 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:54.785610 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11cb92c-f6ab-43d4-929f-4b8a4c651698 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:54.820279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 371/727] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 13 06:24:54 2022] POST /identity/v3/services => generated 251 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:24:54.858753 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08488bc4-4e8d-4e8e-9191-0da8be1c6538 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:54.913265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85621fe3-dcc4-4dad-9fae-01c26d0e9bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:54.914275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85621fe3-dcc4-4dad-9fae-01c26d0e9bfe None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:54.914758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85621fe3-dcc4-4dad-9fae-01c26d0e9bfe None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:54.915131 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85621fe3-dcc4-4dad-9fae-01c26d0e9bfe None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:54.915784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85621fe3-dcc4-4dad-9fae-01c26d0e9bfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:54.916091 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85621fe3-dcc4-4dad-9fae-01c26d0e9bfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:54.917523 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85621fe3-dcc4-4dad-9fae-01c26d0e9bfe None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:54.935802 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 357/728] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:54.941166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cb92c-f6ab-43d4-929f-4b8a4c651698 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:55.092550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11cb92c-f6ab-43d4-929f-4b8a4c651698 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:55.123135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:55.128968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c27768-83f6-4c79-ab9b-9367259be848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:55.130075 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c27768-83f6-4c79-ab9b-9367259be848 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:55.130724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c27768-83f6-4c79-ab9b-9367259be848 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:55.131263 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c27768-83f6-4c79-ab9b-9367259be848 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:55.140531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c27768-83f6-4c79-ab9b-9367259be848 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:55.142395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c27768-83f6-4c79-ab9b-9367259be848 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-11c27768-83f6-4c79-ab9b-9367259be848 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:55.154675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:55.155660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:55.156633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:55.156633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:55.156633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:55.156633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:55.156633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:55.156633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:55.156633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:55.156633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:55.156633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:24:55.156633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:55.156633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 372/729] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:24:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:55.161457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85621fe3-dcc4-4dad-9fae-01c26d0e9bfe None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:55.238799 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:55.288054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85621fe3-dcc4-4dad-9fae-01c26d0e9bfe None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:55.326040 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8000f5e-e37c-4b22-babd-dfe099c8c733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:55.327045 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8000f5e-e37c-4b22-babd-dfe099c8c733 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:55.327528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8000f5e-e37c-4b22-babd-dfe099c8c733 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:55.328016 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8000f5e-e37c-4b22-babd-dfe099c8c733 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:55.328975 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8000f5e-e37c-4b22-babd-dfe099c8c733 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:55.329496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8000f5e-e37c-4b22-babd-dfe099c8c733 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:55.331143 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8000f5e-e37c-4b22-babd-dfe099c8c733 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:55.359062 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 358/730] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Sep 13 06:24:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:55.364254 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c27768-83f6-4c79-ab9b-9367259be848 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:55.515769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c27768-83f6-4c79-ab9b-9367259be848 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:55.537044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b5b0c-9e00-4abe-bc93-fc53709fc004 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:55.537375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b5b0c-9e00-4abe-bc93-fc53709fc004 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:55.537589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2b5b0c-9e00-4abe-bc93-fc53709fc004 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:55.542994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 359/731] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:55.545364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b10306-19aa-4981-b23c-8ced014f8042 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:55.545799 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b10306-19aa-4981-b23c-8ced014f8042 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:55.546272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b10306-19aa-4981-b23c-8ced014f8042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:55.556962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a38ce-5583-499c-993a-f7dec7d4408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:55.557577 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a38ce-5583-499c-993a-f7dec7d4408d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:55.557866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a38ce-5583-499c-993a-f7dec7d4408d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:55.558141 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a38ce-5583-499c-993a-f7dec7d4408d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:55.567212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f4b10306-19aa-4981-b23c-8ced014f8042 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:55.568413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f4b10306-19aa-4981-b23c-8ced014f8042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:55.634275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:55.656242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a38ce-5583-499c-993a-f7dec7d4408d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:55.658081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a38ce-5583-499c-993a-f7dec7d4408d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:55.664839 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 360/732] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 06:24:55.666428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5c926-1315-48a8-b7d9-1d76b0caab6e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:55.666717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5c926-1315-48a8-b7d9-1d76b0caab6e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:55.666993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f5c926-1315-48a8-b7d9-1d76b0caab6e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:55.668807 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 361/733] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:55.674499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e4000-c445-4768-92bc-36a05035662e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:55.674911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e4000-c445-4768-92bc-36a05035662e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:55.675208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e4000-c445-4768-92bc-36a05035662e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:55.702686 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-303e4000-c445-4768-92bc-36a05035662e None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:55.703890 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-303e4000-c445-4768-92bc-36a05035662e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:55.776271 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 373/734] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:55 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 06:24:55.780939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929ad6f-74fa-4112-926a-0d2d12403ac0 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:55.780939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929ad6f-74fa-4112-926a-0d2d12403ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:55.780939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3929ad6f-74fa-4112-926a-0d2d12403ac0 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:55.780939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 374/735] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:55.785242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929ad6f-74fa-4112-926a-0d2d12403ac0 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:55.787111 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:55.822011 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 362/736] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:55.824327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463fc29-f58e-477a-a7c8-6bf9eab52980 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:55.825060 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463fc29-f58e-477a-a7c8-6bf9eab52980 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:55.826021 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f463fc29-f58e-477a-a7c8-6bf9eab52980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:55.846158 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f463fc29-f58e-477a-a7c8-6bf9eab52980 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:55.847743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f463fc29-f58e-477a-a7c8-6bf9eab52980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:55.913006 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:55.929882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3929ad6f-74fa-4112-926a-0d2d12403ac0 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:55.978989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 363/737] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 06:24:55.995962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fb951-b8f7-4091-94f3-0a4edde75778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:55.996692 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb951-b8f7-4091-94f3-0a4edde75778 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:55.998436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb951-b8f7-4091-94f3-0a4edde75778 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:55.998722 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb951-b8f7-4091-94f3-0a4edde75778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:56.001538 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463fc29-f58e-477a-a7c8-6bf9eab52980 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:56.025753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fb951-b8f7-4091-94f3-0a4edde75778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:56.027267 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fb951-b8f7-4091-94f3-0a4edde75778 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-850fb951-b8f7-4091-94f3-0a4edde75778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:56.065936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:56.066954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:56.067867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:56.067867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:56.067867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:56.067867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 375/738] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:56.073929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fb951-b8f7-4091-94f3-0a4edde75778 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:56.114248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f463fc29-f58e-477a-a7c8-6bf9eab52980 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:56.116580 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:56.152134 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931a301-97b9-4003-bcfc-9fefb7797d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:56.152772 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931a301-97b9-4003-bcfc-9fefb7797d7c None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:56.153050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931a301-97b9-4003-bcfc-9fefb7797d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:56.153327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931a301-97b9-4003-bcfc-9fefb7797d7c None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:56.154521 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931a301-97b9-4003-bcfc-9fefb7797d7c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:56.155888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931a301-97b9-4003-bcfc-9fefb7797d7c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:56.178690 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 364/739] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 13 06:24:56 2022] POST /identity/v3/services => generated 240 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:24:56.180010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931a301-97b9-4003-bcfc-9fefb7797d7c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:56.249012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fb951-b8f7-4091-94f3-0a4edde75778 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:56.331172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931a301-97b9-4003-bcfc-9fefb7797d7c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:56.332244 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7a8e1-f864-41bd-ae0e-2e8557f27794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:56.332918 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7a8e1-f864-41bd-ae0e-2e8557f27794 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:56.333199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7a8e1-f864-41bd-ae0e-2e8557f27794 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:56.333477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf7a8e1-f864-41bd-ae0e-2e8557f27794 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:56.334256 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7a8e1-f864-41bd-ae0e-2e8557f27794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:56.334565 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7a8e1-f864-41bd-ae0e-2e8557f27794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:56.336064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf7a8e1-f864-41bd-ae0e-2e8557f27794 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:56.351019 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 376/740] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:56.356186 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7a8e1-f864-41bd-ae0e-2e8557f27794 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:56.356186 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:56.383070 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86969fd-d24e-4035-92a0-cfe595613665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:56.384249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86969fd-d24e-4035-92a0-cfe595613665 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:56.384829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86969fd-d24e-4035-92a0-cfe595613665 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:56.385113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86969fd-d24e-4035-92a0-cfe595613665 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:56.398157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86969fd-d24e-4035-92a0-cfe595613665 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b86969fd-d24e-4035-92a0-cfe595613665 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:56.405103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:56.406139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:56.407006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:56.407006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:56.407006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:56.407006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:56.407006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:56.407006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:56.407006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:56.407006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:56.407006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:56.407006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:56.407006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:24:56.407006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:56.407006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 365/741] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:24:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:56.407739 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86969fd-d24e-4035-92a0-cfe595613665 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:56.432713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:56.526861 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86969fd-d24e-4035-92a0-cfe595613665 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:56.568122 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a813bf-e980-47f2-8b11-99d6f3445674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:56.568793 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a813bf-e980-47f2-8b11-99d6f3445674 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:56.569077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a813bf-e980-47f2-8b11-99d6f3445674 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:56.569353 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a813bf-e980-47f2-8b11-99d6f3445674 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:56.577835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a813bf-e980-47f2-8b11-99d6f3445674 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:56.579285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a813bf-e980-47f2-8b11-99d6f3445674 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:56.585829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf7a8e1-f864-41bd-ae0e-2e8557f27794 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:56.591596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-27a813bf-e980-47f2-8b11-99d6f3445674 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:56.591596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:56.591596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:56.591596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:56.591596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:56.591596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:56.591596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:56.591596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:56.591596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:56.591596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:56.591596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:56.591596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:56.591596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:56.591596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:56.591596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:56.592496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:56.593451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:56.593451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:56.593451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:56.593451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:56.593451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:56.593451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:56.593451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:56.593451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:56.593451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 366/742] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:56.593943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a813bf-e980-47f2-8b11-99d6f3445674 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:56.636694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdcb13-15a4-40a4-953c-2213fcdf52f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:56.636694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdcb13-15a4-40a4-953c-2213fcdf52f9 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:56.636694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdcb13-15a4-40a4-953c-2213fcdf52f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:56.636694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdcb13-15a4-40a4-953c-2213fcdf52f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:56.647842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fdcb13-15a4-40a4-953c-2213fcdf52f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-e4fdcb13-15a4-40a4-953c-2213fcdf52f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:24:56.652900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:56.653984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:56.654855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:56.654855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:56.654855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:56.654855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:56.654855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:24:56.654855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:24:56.654855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:24:56.654855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:24:56.654855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:24:56.654855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:24:56.654855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:24:56.654855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:56.654855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 377/743] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:24:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:56.655574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdcb13-15a4-40a4-953c-2213fcdf52f9 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:56.691812 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:56.719851 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a813bf-e980-47f2-8b11-99d6f3445674 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:56.735667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:56.762643 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce6311-a353-43ae-ae48-293357af5924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:56.763785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce6311-a353-43ae-ae48-293357af5924 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:56.764066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce6311-a353-43ae-ae48-293357af5924 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:56.764339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce6311-a353-43ae-ae48-293357af5924 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:56.765141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce6311-a353-43ae-ae48-293357af5924 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:56.765451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce6311-a353-43ae-ae48-293357af5924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:56.766865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ce6311-a353-43ae-ae48-293357af5924 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:56.777394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdcb13-15a4-40a4-953c-2213fcdf52f9 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:56.777694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 367/744] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:24:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:56.778588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce6311-a353-43ae-ae48-293357af5924 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:56.813945 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be0330-b701-4708-acf0-84c7fc38f067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:56.814555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0330-b701-4708-acf0-84c7fc38f067 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:56.814832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0330-b701-4708-acf0-84c7fc38f067 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:56.815109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67be0330-b701-4708-acf0-84c7fc38f067 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:56.815795 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be0330-b701-4708-acf0-84c7fc38f067 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:56.816097 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be0330-b701-4708-acf0-84c7fc38f067 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:56.817567 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67be0330-b701-4708-acf0-84c7fc38f067 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:56.830262 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 378/745] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:56.831174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be0330-b701-4708-acf0-84c7fc38f067 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:56.901238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce6311-a353-43ae-ae48-293357af5924 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:56.946705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de9c1a-7bf1-450a-aa7a-6242c4047b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:56.947319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de9c1a-7bf1-450a-aa7a-6242c4047b3a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:56.947751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de9c1a-7bf1-450a-aa7a-6242c4047b3a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:56.948029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de9c1a-7bf1-450a-aa7a-6242c4047b3a None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:56.949075 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de9c1a-7bf1-450a-aa7a-6242c4047b3a None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:56.949641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de9c1a-7bf1-450a-aa7a-6242c4047b3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:56.951161 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de9c1a-7bf1-450a-aa7a-6242c4047b3a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:56.955645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67be0330-b701-4708-acf0-84c7fc38f067 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:56.964790 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 368/746] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:24:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:56.966671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de9c1a-7bf1-450a-aa7a-6242c4047b3a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:56.972741 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:56.988118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:57.008370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35afa4-8620-4cae-81ee-274677932d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:57.009717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35afa4-8620-4cae-81ee-274677932d0c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:57.010180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35afa4-8620-4cae-81ee-274677932d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:57.010625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35afa4-8620-4cae-81ee-274677932d0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:57.023920 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35afa4-8620-4cae-81ee-274677932d0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:57.025706 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35afa4-8620-4cae-81ee-274677932d0c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-7d35afa4-8620-4cae-81ee-274677932d0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:57.042320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:57.043336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:57.045182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:57.045182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:57.045182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:57.046876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 379/747] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:57.047890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35afa4-8620-4cae-81ee-274677932d0c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:57.089814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de9c1a-7bf1-450a-aa7a-6242c4047b3a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:57.130229 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727d155-77c7-41ef-968c-77038e32386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:57.130767 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727d155-77c7-41ef-968c-77038e32386e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:57.131050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727d155-77c7-41ef-968c-77038e32386e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:57.131323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727d155-77c7-41ef-968c-77038e32386e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:57.132050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727d155-77c7-41ef-968c-77038e32386e None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=de05d038c2124f43a3acc70f4fb5b44e) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:57.132357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727d155-77c7-41ef-968c-77038e32386e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:57.133875 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727d155-77c7-41ef-968c-77038e32386e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:57.140602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 369/748] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:24:56 2022] GET /identity/v3/role_assignments?user.id=de05d038c2124f43a3acc70f4fb5b44e&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=6382a06103714d068409d25cbeb48744 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:57.141506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727d155-77c7-41ef-968c-77038e32386e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:57.158140 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35afa4-8620-4cae-81ee-274677932d0c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:57.197166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17b598-274c-4f71-9066-7735e8dec224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:57.198168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17b598-274c-4f71-9066-7735e8dec224 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:57.198677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17b598-274c-4f71-9066-7735e8dec224 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:57.199215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb17b598-274c-4f71-9066-7735e8dec224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:57.211998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17b598-274c-4f71-9066-7735e8dec224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:57.213914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb17b598-274c-4f71-9066-7735e8dec224 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:57.220417 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-fb17b598-274c-4f71-9066-7735e8dec224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:57.232321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:57.233422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:57.234366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:57.234366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:57.234366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:57.236647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 380/749] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:57.252948 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17b598-274c-4f71-9066-7735e8dec224 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:57.265962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727d155-77c7-41ef-968c-77038e32386e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:57.304326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9218f-403f-45bf-a67c-2347bba2b3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:57.305403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9218f-403f-45bf-a67c-2347bba2b3df None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:57.305784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9218f-403f-45bf-a67c-2347bba2b3df None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:57.306155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9218f-403f-45bf-a67c-2347bba2b3df None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:57.306912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:57.307321 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9218f-403f-45bf-a67c-2347bba2b3df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:57.307851 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9218f-403f-45bf-a67c-2347bba2b3df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:57.309673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b9218f-403f-45bf-a67c-2347bba2b3df None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:57.324870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 370/750] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:57.336694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9218f-403f-45bf-a67c-2347bba2b3df None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:57.454677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb17b598-274c-4f71-9066-7735e8dec224 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:57.500406 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b9218f-403f-45bf-a67c-2347bba2b3df None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:57.517160 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b61676c-7162-4bfa-8e2e-066ccdd4a19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:57.518246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61676c-7162-4bfa-8e2e-066ccdd4a19a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:57.518525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61676c-7162-4bfa-8e2e-066ccdd4a19a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:57.519058 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b61676c-7162-4bfa-8e2e-066ccdd4a19a None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:57.519756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61676c-7162-4bfa-8e2e-066ccdd4a19a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:57.520062 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61676c-7162-4bfa-8e2e-066ccdd4a19a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:57.521887 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b61676c-7162-4bfa-8e2e-066ccdd4a19a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:57.531551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:57.537769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 381/751] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:57.539197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4226fa3-fc44-4421-8ef2-e2f65d060359 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:57.539482 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4226fa3-fc44-4421-8ef2-e2f65d060359 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:57.539761 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4226fa3-fc44-4421-8ef2-e2f65d060359 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:57.544696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 382/752] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:57.544696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4226fa3-fc44-4421-8ef2-e2f65d060359 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:57.551248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c33993-a49f-4e83-ac1e-a90ccf064397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:57.552166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c33993-a49f-4e83-ac1e-a90ccf064397 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:57.552793 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c33993-a49f-4e83-ac1e-a90ccf064397 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:57.553270 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c33993-a49f-4e83-ac1e-a90ccf064397 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:57.562226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c33993-a49f-4e83-ac1e-a90ccf064397 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:57.563947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c33993-a49f-4e83-ac1e-a90ccf064397 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-08c33993-a49f-4e83-ac1e-a90ccf064397 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:57.577421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:57.578365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:57.579332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:57.579332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:57.579332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:57.579332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:57.579332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:57.579332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:57.579332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:57.579332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:57.579332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:24:57.579332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:57.581961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 371/753] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 13 06:24:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:57.583474 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588511a-13d8-4613-b9a3-0db48e62ade1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:57.584027 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588511a-13d8-4613-b9a3-0db48e62ade1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:57.584513 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7588511a-13d8-4613-b9a3-0db48e62ade1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:57.608808 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7588511a-13d8-4613-b9a3-0db48e62ade1 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:57.610283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7588511a-13d8-4613-b9a3-0db48e62ade1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:57.642681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:57.661486 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4226fa3-fc44-4421-8ef2-e2f65d060359 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:57.695970 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 372/754] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:24:57.697583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588511a-13d8-4613-b9a3-0db48e62ade1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:57.699330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dba14-44dc-4ac3-a5ba-154931f410d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:57.700195 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dba14-44dc-4ac3-a5ba-154931f410d8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:57.701155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dba14-44dc-4ac3-a5ba-154931f410d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:57.701524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9dba14-44dc-4ac3-a5ba-154931f410d8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:57.710079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dba14-44dc-4ac3-a5ba-154931f410d8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:57.711667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9dba14-44dc-4ac3-a5ba-154931f410d8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-ba9dba14-44dc-4ac3-a5ba-154931f410d8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:24:57.724593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:57.725779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:57.726912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:57.726912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:57.726912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:24:57.726912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:24:57.726912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:24:57.726912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:24:57.726912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:24:57.726912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:24:57.726912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:24:57.726912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:57.727992 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 383/755] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 13 06:24:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:57.733773 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dba14-44dc-4ac3-a5ba-154931f410d8 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:57.822517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7588511a-13d8-4613-b9a3-0db48e62ade1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:57.841294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9dba14-44dc-4ac3-a5ba-154931f410d8 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:57.844501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:57.870370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277f3a1-fcca-4d11-bb11-0e57bca677a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:57.871361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277f3a1-fcca-4d11-bb11-0e57bca677a2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:57.873567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277f3a1-fcca-4d11-bb11-0e57bca677a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:57.874344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d277f3a1-fcca-4d11-bb11-0e57bca677a2 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:57.875529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277f3a1-fcca-4d11-bb11-0e57bca677a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:57.877141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277f3a1-fcca-4d11-bb11-0e57bca677a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:57.879823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d277f3a1-fcca-4d11-bb11-0e57bca677a2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:57.898359 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4298a71-241f-40a5-b6c7-97c3ee5df4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:57.899171 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4298a71-241f-40a5-b6c7-97c3ee5df4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:57.899616 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4298a71-241f-40a5-b6c7-97c3ee5df4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:57.900029 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4298a71-241f-40a5-b6c7-97c3ee5df4e5 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:57.900919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4298a71-241f-40a5-b6c7-97c3ee5df4e5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:57.906317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4298a71-241f-40a5-b6c7-97c3ee5df4e5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:57.907913 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4298a71-241f-40a5-b6c7-97c3ee5df4e5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:57.913783 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 373/756] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 13 06:24:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:57.920502 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277f3a1-fcca-4d11-bb11-0e57bca677a2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:57.941018 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 384/757] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Sep 13 06:24:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:57.947474 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4298a71-241f-40a5-b6c7-97c3ee5df4e5 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:57.954903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:58.055236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d277f3a1-fcca-4d11-bb11-0e57bca677a2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:58.094974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e3b5e-4843-4293-b78a-6d4fe345657b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:58.095733 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e3b5e-4843-4293-b78a-6d4fe345657b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:58.096016 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e3b5e-4843-4293-b78a-6d4fe345657b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:58.096287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9e3b5e-4843-4293-b78a-6d4fe345657b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:58.109435 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e3b5e-4843-4293-b78a-6d4fe345657b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:58.111615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9e3b5e-4843-4293-b78a-6d4fe345657b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-dd9e3b5e-4843-4293-b78a-6d4fe345657b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:58.132386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:58.133403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:58.134280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:58.134280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:58.134280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:58.134280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 374/758] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:58.138649 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4298a71-241f-40a5-b6c7-97c3ee5df4e5 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:58.140010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e3b5e-4843-4293-b78a-6d4fe345657b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:58.178754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:58.186675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b4775-b95d-4ea8-8ff0-cca37b5044df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:58.188248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b4775-b95d-4ea8-8ff0-cca37b5044df None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:58.188590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b4775-b95d-4ea8-8ff0-cca37b5044df None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:58.188952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b4775-b95d-4ea8-8ff0-cca37b5044df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:58.268491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9e3b5e-4843-4293-b78a-6d4fe345657b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:58.282075 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b4775-b95d-4ea8-8ff0-cca37b5044df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:58.284497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265b4775-b95d-4ea8-8ff0-cca37b5044df None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:58.289027 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:58.317567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a3302-45ab-4816-819c-9bd5c0ee7e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:58.318236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a3302-45ab-4816-819c-9bd5c0ee7e2b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:58.318421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a3302-45ab-4816-819c-9bd5c0ee7e2b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:58.318669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a3302-45ab-4816-819c-9bd5c0ee7e2b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:58.319259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a3302-45ab-4816-819c-9bd5c0ee7e2b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:58.320623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a3302-45ab-4816-819c-9bd5c0ee7e2b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-452a3302-45ab-4816-819c-9bd5c0ee7e2b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:58.334154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:58.335177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:58.336055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:58.336055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:58.336055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:58.336055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:58.336055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:58.336055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:58.336055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:58.336055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:58.336055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:58.336055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:58.336055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:24:58.336055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:24:58.336055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:24:58.336055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:58.340574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 375/759] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Sep 13 06:24:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:58.342030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a3302-45ab-4816-819c-9bd5c0ee7e2b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:58.406289 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 385/760] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:24:57 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:24:58.407635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b4775-b95d-4ea8-8ff0-cca37b5044df None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:58.444726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:58.454599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a3302-45ab-4816-819c-9bd5c0ee7e2b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:58.498176 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b66f8-9da2-43e3-8b80-0841fd576628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:58.498807 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b66f8-9da2-43e3-8b80-0841fd576628 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:58.499087 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b66f8-9da2-43e3-8b80-0841fd576628 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:58.499362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b66f8-9da2-43e3-8b80-0841fd576628 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:58.500019 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b66f8-9da2-43e3-8b80-0841fd576628 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:58.500324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b66f8-9da2-43e3-8b80-0841fd576628 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:58.501761 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b66f8-9da2-43e3-8b80-0841fd576628 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:58.519840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 376/761] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:58.519840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b66f8-9da2-43e3-8b80-0841fd576628 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:58.527298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b4775-b95d-4ea8-8ff0-cca37b5044df None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:58.530748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:58.568354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b6138-e13e-419d-824b-191dd81301a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:58.569324 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b6138-e13e-419d-824b-191dd81301a1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:58.569813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b6138-e13e-419d-824b-191dd81301a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:58.570345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b6138-e13e-419d-824b-191dd81301a1 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:58.571337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b6138-e13e-419d-824b-191dd81301a1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:58.571893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b6138-e13e-419d-824b-191dd81301a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:58.573561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b6138-e13e-419d-824b-191dd81301a1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:58.579217 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 386/762] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Sep 13 06:24:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:58.580225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b6138-e13e-419d-824b-191dd81301a1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:58.637031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b66f8-9da2-43e3-8b80-0841fd576628 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:58.672746 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde8f6f-889c-4566-ae70-23b771aa41a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:58.673381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde8f6f-889c-4566-ae70-23b771aa41a1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:58.673667 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde8f6f-889c-4566-ae70-23b771aa41a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:58.673945 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde8f6f-889c-4566-ae70-23b771aa41a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:58.685237 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde8f6f-889c-4566-ae70-23b771aa41a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:58.686676 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde8f6f-889c-4566-ae70-23b771aa41a1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:58.695339 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b6138-e13e-419d-824b-191dd81301a1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-9dde8f6f-889c-4566-ae70-23b771aa41a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:24:58.701546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:58.702840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:24:58.703732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:24:58.703732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:24:58.703732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:58.703732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 377/763] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:58.703732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde8f6f-889c-4566-ae70-23b771aa41a1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:58.709920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:58.736424 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bce75b-a532-4c1c-8b3d-a60ece6fc37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:58.737080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bce75b-a532-4c1c-8b3d-a60ece6fc37e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:58.737361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bce75b-a532-4c1c-8b3d-a60ece6fc37e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:58.737634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bce75b-a532-4c1c-8b3d-a60ece6fc37e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:58.744575 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bce75b-a532-4c1c-8b3d-a60ece6fc37e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:58.745895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bce75b-a532-4c1c-8b3d-a60ece6fc37e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:58.757273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-58bce75b-a532-4c1c-8b3d-a60ece6fc37e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:58.757273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:58.757273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:58.757273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:58.757273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:58.757273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:58.757273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:58.757273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:58.757273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:58.757273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:58.757273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:58.757273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:58.757273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:58.757273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:58.757273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:58.758149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:58.759043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:58.759043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:58.759043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:58.759043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:58.759043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:58.759043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:58.759043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:58.759043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:58.759043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 387/764] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:58.759538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87ee45-04ea-401c-b104-ff3cdf29aac7 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:58.760164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87ee45-04ea-401c-b104-ff3cdf29aac7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:58.760164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c87ee45-04ea-401c-b104-ff3cdf29aac7 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:58.765116 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 388/765] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:58.765116 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87ee45-04ea-401c-b104-ff3cdf29aac7 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:58.794637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:58.819840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde8f6f-889c-4566-ae70-23b771aa41a1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:58.856396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34e45b-f4c4-4b95-86a1-e8a94caae6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:58.857055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34e45b-f4c4-4b95-86a1-e8a94caae6eb None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:58.857323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34e45b-f4c4-4b95-86a1-e8a94caae6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:58.857590 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb34e45b-f4c4-4b95-86a1-e8a94caae6eb None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:58.858208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34e45b-f4c4-4b95-86a1-e8a94caae6eb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:58.858533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34e45b-f4c4-4b95-86a1-e8a94caae6eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:58.859844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb34e45b-f4c4-4b95-86a1-e8a94caae6eb None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:58.865004 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 378/766] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Sep 13 06:24:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:58.865756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34e45b-f4c4-4b95-86a1-e8a94caae6eb None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:58.873565 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c87ee45-04ea-401c-b104-ff3cdf29aac7 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:58.909408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7df89-710e-41d1-a1e5-68e5594a697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:58.910012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7df89-710e-41d1-a1e5-68e5594a697d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:58.910295 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7df89-710e-41d1-a1e5-68e5594a697d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:58.910560 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7df89-710e-41d1-a1e5-68e5594a697d None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:58.911197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7df89-710e-41d1-a1e5-68e5594a697d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:58.911501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7df89-710e-41d1-a1e5-68e5594a697d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:58.912890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7df89-710e-41d1-a1e5-68e5594a697d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:58.925050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 389/767] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:58.926436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490a5e0-8cd6-4635-a9bb-b8947f3fceb3 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:58.926935 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490a5e0-8cd6-4635-a9bb-b8947f3fceb3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:58.927401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3490a5e0-8cd6-4635-a9bb-b8947f3fceb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:58.942152 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:58.945953 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-3490a5e0-8cd6-4635-a9bb-b8947f3fceb3 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:58.947239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3490a5e0-8cd6-4635-a9bb-b8947f3fceb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:58.984119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb34e45b-f4c4-4b95-86a1-e8a94caae6eb None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:59.028703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 390/768] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:24:59.028703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490a5e0-8cd6-4635-a9bb-b8947f3fceb3 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:59.029941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ede3d-fa1d-49ec-b1e6-af7add4566ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:59.030911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ede3d-fa1d-49ec-b1e6-af7add4566ca None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:59.035199 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ede3d-fa1d-49ec-b1e6-af7add4566ca None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:59.035199 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ede3d-fa1d-49ec-b1e6-af7add4566ca None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:59.035199 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ede3d-fa1d-49ec-b1e6-af7add4566ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:59.035199 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ede3d-fa1d-49ec-b1e6-af7add4566ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:59.036087 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ede3d-fa1d-49ec-b1e6-af7add4566ca None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:59.047405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:59.058269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 379/769] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:59.059275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ede3d-fa1d-49ec-b1e6-af7add4566ca None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:59.146432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3490a5e0-8cd6-4635-a9bb-b8947f3fceb3 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:59.167263 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ede3d-fa1d-49ec-b1e6-af7add4566ca None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:59.192327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afad336-9204-4963-a881-7434ac8acd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:59.193489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afad336-9204-4963-a881-7434ac8acd64 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:59.193840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afad336-9204-4963-a881-7434ac8acd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:59.194316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afad336-9204-4963-a881-7434ac8acd64 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:59.195137 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afad336-9204-4963-a881-7434ac8acd64 None admin] RBAC: Adding query filter params (interface=public, service_id=375fecf2475945f9aff628f059aa683b, region_id=RegionOne) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:59.195477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afad336-9204-4963-a881-7434ac8acd64 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:59.196871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:59.197677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afad336-9204-4963-a881-7434ac8acd64 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:59.208074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296a972-9020-44c6-9adf-409daed07362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:59.208959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296a972-9020-44c6-9adf-409daed07362 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:59.209303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296a972-9020-44c6-9adf-409daed07362 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:59.209458 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 391/770] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 13 06:24:59 2022] GET /identity/v3/endpoints?service_id=375fecf2475945f9aff628f059aa683b&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:59.209671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8296a972-9020-44c6-9adf-409daed07362 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:59.210800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afad336-9204-4963-a881-7434ac8acd64 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:59.218111 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296a972-9020-44c6-9adf-409daed07362 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:59.219644 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8296a972-9020-44c6-9adf-409daed07362 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:59.233185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-8296a972-9020-44c6-9adf-409daed07362 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:59.233185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:59.233185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:59.233185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:59.233185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:59.233185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:59.233185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:59.233185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:59.233185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:59.233185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:59.233185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:59.233185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:59.233185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:24:59.233185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:24:59.233185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:59.234326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:59.235283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:24:59.235283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:24:59.235283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:24:59.235283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:24:59.235283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:24:59.235283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:24:59.235283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:24:59.235283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:24:59.235786 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 380/771] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:59.237042 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296a972-9020-44c6-9adf-409daed07362 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:59.320705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:59.346321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afad336-9204-4963-a881-7434ac8acd64 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:59.350161 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8296a972-9020-44c6-9adf-409daed07362 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:59.382004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d3c09-520f-4b1a-840f-dec6b74ddd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:59.382652 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d3c09-520f-4b1a-840f-dec6b74ddd6f None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:59.382930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d3c09-520f-4b1a-840f-dec6b74ddd6f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:59.383221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d3c09-520f-4b1a-840f-dec6b74ddd6f None admin] PATH_INFO: `/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/7fbb67072ba544e39073787eb25fcf1e/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:59.384306 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b0381-9655-4181-ab76-a62fa65f2d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:59.384927 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b0381-9655-4181-ab76-a62fa65f2d2e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:59.385204 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b0381-9655-4181-ab76-a62fa65f2d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:59.385300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d3c09-520f-4b1a-840f-dec6b74ddd6f None admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c3f0aa3b746108e73737491b003e7, user_id=7fbb67072ba544e39073787eb25fcf1e, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:59.385466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b0381-9655-4181-ab76-a62fa65f2d2e None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:59.386055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b0381-9655-4181-ab76-a62fa65f2d2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:59.386657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d3c09-520f-4b1a-840f-dec6b74ddd6f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:59.387379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b0381-9655-4181-ab76-a62fa65f2d2e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:59.392933 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 381/772] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 13 06:24:59 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:59.393615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b0381-9655-4181-ab76-a62fa65f2d2e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:59.416772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 392/773] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:24:59 2022] PUT /identity/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/7fbb67072ba544e39073787eb25fcf1e/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:24:59.418275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d3c09-520f-4b1a-840f-dec6b74ddd6f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:59.512233 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:59.608960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d3c09-520f-4b1a-840f-dec6b74ddd6f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:59.631280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b0381-9655-4181-ab76-a62fa65f2d2e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:59.666562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586bc91a-1cca-4511-aa1e-c5a1724b1243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:59.667693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bc91a-1cca-4511-aa1e-c5a1724b1243 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:59.667921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bc91a-1cca-4511-aa1e-c5a1724b1243 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:59.668192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586bc91a-1cca-4511-aa1e-c5a1724b1243 None admin] PATH_INFO: `/v3/services/network` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:59.669119 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bc91a-1cca-4511-aa1e-c5a1724b1243 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:59.670991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586bc91a-1cca-4511-aa1e-c5a1724b1243 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:59.679197 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2b6a66-a106-48f8-ab9d-2994c6c24a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:59.679807 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b6a66-a106-48f8-ab9d-2994c6c24a86 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:59.680089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b6a66-a106-48f8-ab9d-2994c6c24a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:59.680367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2b6a66-a106-48f8-ab9d-2994c6c24a86 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-586bc91a-1cca-4511-aa1e-c5a1724b1243 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:24:59.680922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:24:59.681875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:24:59.683288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:24:59.683288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:24:59.683288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:24:59.683288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:24:59.683288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:24:59.683288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:24:59.683288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:24:59.683288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:24:59.683288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:24:59.683288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:24:59.683288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:24:59.683288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:24:59.683288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:24:59.683288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:24:59.684059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b6a66-a106-48f8-ab9d-2994c6c24a86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:59.684059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b6a66-a106-48f8-ab9d-2994c6c24a86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:59.684185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 393/774] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:24:59 2022] GET /identity/v3/services/network => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:24:59.684253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2b6a66-a106-48f8-ab9d-2994c6c24a86 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:59.684320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f55b-718e-4cf3-9351-cf5a8d9422a5 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:59.684320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f55b-718e-4cf3-9351-cf5a8d9422a5 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:59.684320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f55b-718e-4cf3-9351-cf5a8d9422a5 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:59.685725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 394/775] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:24:59.687651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51f55b-718e-4cf3-9351-cf5a8d9422a5 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:59.697532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 382/776] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:24:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:24:59.698119 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:59.699668 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915a477-faa7-4982-a05b-7b39fda72227 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:59.700110 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915a477-faa7-4982-a05b-7b39fda72227 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:59.702353 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915a477-faa7-4982-a05b-7b39fda72227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:59.724785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5915a477-faa7-4982-a05b-7b39fda72227 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:24:59.726718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5915a477-faa7-4982-a05b-7b39fda72227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:24:59.801478 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51f55b-718e-4cf3-9351-cf5a8d9422a5 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:59.820696 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 383/777] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:24:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:24:59.820696 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915a477-faa7-4982-a05b-7b39fda72227 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:59.866352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:24:59.889994 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063c4d4-dbbf-4541-94cd-c97cdabad8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:59.890886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063c4d4-dbbf-4541-94cd-c97cdabad8a5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:59.891317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063c4d4-dbbf-4541-94cd-c97cdabad8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:59.891735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9063c4d4-dbbf-4541-94cd-c97cdabad8a5 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:59.892519 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063c4d4-dbbf-4541-94cd-c97cdabad8a5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:59.893048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063c4d4-dbbf-4541-94cd-c97cdabad8a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:59.894571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9063c4d4-dbbf-4541-94cd-c97cdabad8a5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:59.911976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 395/778] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 13 06:24:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:24:59.917082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063c4d4-dbbf-4541-94cd-c97cdabad8a5 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:24:59.933179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915a477-faa7-4982-a05b-7b39fda72227 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:24:59.974593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa867550-8e79-4314-b467-82ffb7410f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:24:59.975196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa867550-8e79-4314-b467-82ffb7410f89 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:24:59.975581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa867550-8e79-4314-b467-82ffb7410f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:24:59.975890 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa867550-8e79-4314-b467-82ffb7410f89 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:24:59.976616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa867550-8e79-4314-b467-82ffb7410f89 None admin] RBAC: Adding query filter params (role.id=dc60d33cb0c649b3b903d99258a19c98, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=3739971aa30548d6932d7af156e1fdaf) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:24:59.976951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa867550-8e79-4314-b467-82ffb7410f89 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:24:59.978534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa867550-8e79-4314-b467-82ffb7410f89 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:24:59.985344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 384/779] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:24:59 2022] GET /identity/v3/role_assignments?user.id=3739971aa30548d6932d7af156e1fdaf&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=dc60d33cb0c649b3b903d99258a19c98 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:00.070404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:00.109310 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9063c4d4-dbbf-4541-94cd-c97cdabad8a5 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:00.147984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddd310-61a7-4792-9746-5e6d8fa60bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:00.148709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddd310-61a7-4792-9746-5e6d8fa60bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:00.148973 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddd310-61a7-4792-9746-5e6d8fa60bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:00.149159 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eddd310-61a7-4792-9746-5e6d8fa60bc3 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:00.149809 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddd310-61a7-4792-9746-5e6d8fa60bc3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:00.150113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddd310-61a7-4792-9746-5e6d8fa60bc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:00.151515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eddd310-61a7-4792-9746-5e6d8fa60bc3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:00.157743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 396/780] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 13 06:24:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:00.163131 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa867550-8e79-4314-b467-82ffb7410f89 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:00.187525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddd310-61a7-4792-9746-5e6d8fa60bc3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:00.328678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eddd310-61a7-4792-9746-5e6d8fa60bc3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:00.359147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa867550-8e79-4314-b467-82ffb7410f89 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:00.368995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:00.371298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c575b-0942-46ff-9bc1-bd0f9e8126e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:00.372202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c575b-0942-46ff-9bc1-bd0f9e8126e4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:00.373239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c575b-0942-46ff-9bc1-bd0f9e8126e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:00.373571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c575b-0942-46ff-9bc1-bd0f9e8126e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:00.378915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:00.400092 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395c575b-0942-46ff-9bc1-bd0f9e8126e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-395c575b-0942-46ff-9bc1-bd0f9e8126e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:25:00.413641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:00.414657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:00.415504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:00.415504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:00.415504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:00.415504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:00.415504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:25:00.415504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:25:00.415504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:25:00.415504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:25:00.415504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:25:00.415504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:25:00.415504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:25:00.415504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:00.420689 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 397/781] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:25:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:00.423104 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c575b-0942-46ff-9bc1-bd0f9e8126e4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:00.434846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47695101-3c17-42d4-9775-4c050afb8d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:00.436333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47695101-3c17-42d4-9775-4c050afb8d44 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:00.436845 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47695101-3c17-42d4-9775-4c050afb8d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:00.437347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47695101-3c17-42d4-9775-4c050afb8d44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:00.438331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47695101-3c17-42d4-9775-4c050afb8d44 None admin] RBAC: Adding query filter params (interface=public, service_id=c728de0fd1a94e1389c1f8592a2a0591, region_id=RegionOne) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:00.438889 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47695101-3c17-42d4-9775-4c050afb8d44 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:00.440461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47695101-3c17-42d4-9775-4c050afb8d44 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:00.459328 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 385/782] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 13 06:25:00 2022] GET /identity/v3/endpoints?service_id=c728de0fd1a94e1389c1f8592a2a0591&interface=public®ion_id=RegionOne => generated 194 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:00.468148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47695101-3c17-42d4-9775-4c050afb8d44 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:00.579064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c575b-0942-46ff-9bc1-bd0f9e8126e4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:00.652708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47695101-3c17-42d4-9775-4c050afb8d44 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:00.653876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e82793-6fc2-406c-96fe-859a5b901f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:00.654493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e82793-6fc2-406c-96fe-859a5b901f64 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:00.654780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e82793-6fc2-406c-96fe-859a5b901f64 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:00.655184 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e82793-6fc2-406c-96fe-859a5b901f64 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:00.655862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e82793-6fc2-406c-96fe-859a5b901f64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:00.656160 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e82793-6fc2-406c-96fe-859a5b901f64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:00.657558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e82793-6fc2-406c-96fe-859a5b901f64 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:00.672654 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 398/783] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:25:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:00.678185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e82793-6fc2-406c-96fe-859a5b901f64 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:00.719911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aa2bd-dc4f-4c4b-8437-f1c2e56c30fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:00.720420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aa2bd-dc4f-4c4b-8437-f1c2e56c30fc None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:00.720723 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aa2bd-dc4f-4c4b-8437-f1c2e56c30fc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:00.721000 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189aa2bd-dc4f-4c4b-8437-f1c2e56c30fc None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:00.721860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189aa2bd-dc4f-4c4b-8437-f1c2e56c30fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:00.723197 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189aa2bd-dc4f-4c4b-8437-f1c2e56c30fc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:00.734618 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 386/784] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 13 06:25:00 2022] GET /identity/v3/services => generated 772 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:00.782024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:00.830578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e82793-6fc2-406c-96fe-859a5b901f64 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:00.880965 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07392507-dd17-4262-b95d-e94951539993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:00.881608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07392507-dd17-4262-b95d-e94951539993 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:00.881881 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07392507-dd17-4262-b95d-e94951539993 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:00.882148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07392507-dd17-4262-b95d-e94951539993 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:00.896811 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07392507-dd17-4262-b95d-e94951539993 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:00.898272 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07392507-dd17-4262-b95d-e94951539993 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-07392507-dd17-4262-b95d-e94951539993 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:00.914838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:00.915857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:00.916788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:00.916788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:00.916788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:00.916788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 399/785] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:00.923751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aa2bd-dc4f-4c4b-8437-f1c2e56c30fc None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:00.975624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:01.059228 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189aa2bd-dc4f-4c4b-8437-f1c2e56c30fc None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:01.094997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790f367-a87a-4326-954c-d51a9078a852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:01.095658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790f367-a87a-4326-954c-d51a9078a852 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:01.095936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790f367-a87a-4326-954c-d51a9078a852 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:01.096204 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790f367-a87a-4326-954c-d51a9078a852 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:01.096876 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790f367-a87a-4326-954c-d51a9078a852 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:01.097175 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790f367-a87a-4326-954c-d51a9078a852 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:01.098528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790f367-a87a-4326-954c-d51a9078a852 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:01.111014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 387/786] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:01.116482 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07392507-dd17-4262-b95d-e94951539993 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:01.225269 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07392507-dd17-4262-b95d-e94951539993 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:01.235327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:01.262952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61613a-0c9f-4371-85dd-632a80cc039d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:01.263577 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61613a-0c9f-4371-85dd-632a80cc039d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:01.263850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61613a-0c9f-4371-85dd-632a80cc039d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:01.264114 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa61613a-0c9f-4371-85dd-632a80cc039d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:01.271455 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61613a-0c9f-4371-85dd-632a80cc039d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:01.272909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa61613a-0c9f-4371-85dd-632a80cc039d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-fa61613a-0c9f-4371-85dd-632a80cc039d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:25:01.284544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:01.285559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:01.286835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:01.286835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:01.286835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:25:01.286835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:25:01.286835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:25:01.286835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:25:01.286835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:25:01.286835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:25:01.286835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:25:01.286835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:01.286835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 400/787] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:25:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:01.294745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790f367-a87a-4326-954c-d51a9078a852 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:01.422727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:01.432254 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790f367-a87a-4326-954c-d51a9078a852 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:01.479302 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63a886-f223-4b70-821a-e496f87df644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:01.479925 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63a886-f223-4b70-821a-e496f87df644 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:01.480200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63a886-f223-4b70-821a-e496f87df644 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:01.480464 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63a886-f223-4b70-821a-e496f87df644 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:01.481224 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63a886-f223-4b70-821a-e496f87df644 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:01.481589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63a886-f223-4b70-821a-e496f87df644 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:01.483017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f63a886-f223-4b70-821a-e496f87df644 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:01.509267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 388/788] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Sep 13 06:25:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:01.515066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61613a-0c9f-4371-85dd-632a80cc039d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:01.631240 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa61613a-0c9f-4371-85dd-632a80cc039d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:01.666311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5335bce-ca75-40a5-9141-9fd9a7a6b035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:01.666940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5335bce-ca75-40a5-9141-9fd9a7a6b035 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:01.667214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5335bce-ca75-40a5-9141-9fd9a7a6b035 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:01.667485 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5335bce-ca75-40a5-9141-9fd9a7a6b035 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:01.679180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5335bce-ca75-40a5-9141-9fd9a7a6b035 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:01.680614 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5335bce-ca75-40a5-9141-9fd9a7a6b035 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c5335bce-ca75-40a5-9141-9fd9a7a6b035 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:01.695445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:01.696431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:01.697357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:01.697357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:01.697357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:01.697357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 401/789] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:01.705826 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63a886-f223-4b70-821a-e496f87df644 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:01.894109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63a886-f223-4b70-821a-e496f87df644 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:01.922845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd9558-b409-4a5b-8f82-0f7a106513aa None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:01.923208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd9558-b409-4a5b-8f82-0f7a106513aa None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:01.923406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfd9558-b409-4a5b-8f82-0f7a106513aa None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:01.925006 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 402/790] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:01.930038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e660d9b-9bd2-4b35-8df2-d5b0e5e4c60d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:01.930318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e660d9b-9bd2-4b35-8df2-d5b0e5e4c60d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:01.930591 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e660d9b-9bd2-4b35-8df2-d5b0e5e4c60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:01.963862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0e660d9b-9bd2-4b35-8df2-d5b0e5e4c60d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:01.965612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8705d-e914-496e-a156-ff7eeb1419da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:01.966259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8705d-e914-496e-a156-ff7eeb1419da None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:01.966531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8705d-e914-496e-a156-ff7eeb1419da None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:01.966801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc8705d-e914-496e-a156-ff7eeb1419da None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:01.967435 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8705d-e914-496e-a156-ff7eeb1419da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:01.967737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8705d-e914-496e-a156-ff7eeb1419da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:01.972739 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc8705d-e914-496e-a156-ff7eeb1419da None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:01.972868 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0e660d9b-9bd2-4b35-8df2-d5b0e5e4c60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:01.991301 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 389/791] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:01.999361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8705d-e914-496e-a156-ff7eeb1419da None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:02.005430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:02.049066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:02.166658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 403/792] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:02.166658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b8ca1-751a-4ce6-a15f-180ee61db622 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:02.166658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b8ca1-751a-4ce6-a15f-180ee61db622 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:02.166658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b8ca1-751a-4ce6-a15f-180ee61db622 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:02.172294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 404/793] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:02 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:02.177292 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e55be-63b8-4b82-a191-4b0721b1c8ee None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:02.177292 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e55be-63b8-4b82-a191-4b0721b1c8ee None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:02.177292 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e55be-63b8-4b82-a191-4b0721b1c8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:02.233973 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b58e55be-63b8-4b82-a191-4b0721b1c8ee None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:02.240646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b58e55be-63b8-4b82-a191-4b0721b1c8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:02.319962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc8705d-e914-496e-a156-ff7eeb1419da None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:02.368540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbda0d-8852-4617-a2ec-a833b60ebd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:02.369547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbda0d-8852-4617-a2ec-a833b60ebd48 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:02.370511 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbda0d-8852-4617-a2ec-a833b60ebd48 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:02.370982 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbda0d-8852-4617-a2ec-a833b60ebd48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:02.383649 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbda0d-8852-4617-a2ec-a833b60ebd48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:02.385932 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbda0d-8852-4617-a2ec-a833b60ebd48 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:02.400203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-dfcbda0d-8852-4617-a2ec-a833b60ebd48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:02.400203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:02.400203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:02.400203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:02.400203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:02.400203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:02.400203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:02.400203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:02.400203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:02.400203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:02.400203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:02.400203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:02.400203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:25:02.400203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:25:02.400203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:02.401193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:02.402101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:25:02.402101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:25:02.402101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:25:02.402101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:25:02.402101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:25:02.402101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:25:02.402101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:02.402101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:02.404597 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 390/794] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:02.416750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbda0d-8852-4617-a2ec-a833b60ebd48 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:02.467368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 405/795] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:02.531719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e55be-63b8-4b82-a191-4b0721b1c8ee None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:02.532476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:02.607264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbda0d-8852-4617-a2ec-a833b60ebd48 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:02.674218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de191a3f-df55-4128-88c0-4206ab4748db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:02.674756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de191a3f-df55-4128-88c0-4206ab4748db None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:02.675033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de191a3f-df55-4128-88c0-4206ab4748db None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:02.675300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de191a3f-df55-4128-88c0-4206ab4748db None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:02.681395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de191a3f-df55-4128-88c0-4206ab4748db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:02.681705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de191a3f-df55-4128-88c0-4206ab4748db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:02.683189 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de191a3f-df55-4128-88c0-4206ab4748db None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:02.698999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:02.714560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 391/796] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:25:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:02.719947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deea55-2a52-46ae-b3fa-71dd13ee77e1 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:02.719947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deea55-2a52-46ae-b3fa-71dd13ee77e1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:02.719947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26deea55-2a52-46ae-b3fa-71dd13ee77e1 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:02.721926 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 392/797] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:02.722737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deea55-2a52-46ae-b3fa-71dd13ee77e1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:02.733491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e55be-63b8-4b82-a191-4b0721b1c8ee None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:02.779050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131c06d-370a-4101-8cb9-7adc3491835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:02.780109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131c06d-370a-4101-8cb9-7adc3491835d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:02.780784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131c06d-370a-4101-8cb9-7adc3491835d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:02.781266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131c06d-370a-4101-8cb9-7adc3491835d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:02.782109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131c06d-370a-4101-8cb9-7adc3491835d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:02.784374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131c06d-370a-4101-8cb9-7adc3491835d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-b131c06d-370a-4101-8cb9-7adc3491835d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:02.795102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:02.796118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:02.797030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:02.797030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:02.797030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:02.797030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:02.797030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:02.797030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:02.797030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:02.797030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:02.797030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:02.797030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:02.797030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:02.797030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:02.797030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 06:25:02.797030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:02.801175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 406/798] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Sep 13 06:25:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:02.802892 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb1d7b-4126-4afc-8df3-c23051229fb0 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:02.803388 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb1d7b-4126-4afc-8df3-c23051229fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:02.803878 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bb1d7b-4126-4afc-8df3-c23051229fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:02.833865 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d0bb1d7b-4126-4afc-8df3-c23051229fb0 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:02.838045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d0bb1d7b-4126-4afc-8df3-c23051229fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:02.854555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26deea55-2a52-46ae-b3fa-71dd13ee77e1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:02.888690 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:02.894601 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a85d53-71f9-433b-8fb6-548647d6aa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:02.895257 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a85d53-71f9-433b-8fb6-548647d6aa6f None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:02.895535 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a85d53-71f9-433b-8fb6-548647d6aa6f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:02.895810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a85d53-71f9-433b-8fb6-548647d6aa6f None admin] PATH_INFO: `/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/de05d038c2124f43a3acc70f4fb5b44e/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:02.897740 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a85d53-71f9-433b-8fb6-548647d6aa6f None admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c3f0aa3b746108e73737491b003e7, user_id=de05d038c2124f43a3acc70f4fb5b44e, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:02.899157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a85d53-71f9-433b-8fb6-548647d6aa6f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:02.912646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 393/799] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:25:02 2022] PUT /identity/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/de05d038c2124f43a3acc70f4fb5b44e/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:25:02.913542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a85d53-71f9-433b-8fb6-548647d6aa6f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:02.957232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 407/800] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:02 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:02.958539 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb1d7b-4126-4afc-8df3-c23051229fb0 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:03.054889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:03.089410 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bb1d7b-4126-4afc-8df3-c23051229fb0 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:03.129018 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a85d53-71f9-433b-8fb6-548647d6aa6f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:03.131280 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede75f56-a2ee-4f00-8a3c-b977c8508240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:03.132135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede75f56-a2ee-4f00-8a3c-b977c8508240 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:03.133436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede75f56-a2ee-4f00-8a3c-b977c8508240 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:03.133916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede75f56-a2ee-4f00-8a3c-b977c8508240 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:03.146725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede75f56-a2ee-4f00-8a3c-b977c8508240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-ede75f56-a2ee-4f00-8a3c-b977c8508240 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:25:03.152531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:03.154145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:03.155003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:03.155003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:03.155003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:03.155003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:03.155003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:25:03.155003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:25:03.155003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:25:03.155003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:25:03.155003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:25:03.155003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:25:03.155003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:25:03.155003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:03.157718 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 408/801] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:25:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:03.164094 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede75f56-a2ee-4f00-8a3c-b977c8508240 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:03.222047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70eb6f-aa94-4c7a-a3a0-bd3355194f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:03.222575 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70eb6f-aa94-4c7a-a3a0-bd3355194f68 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:03.222856 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70eb6f-aa94-4c7a-a3a0-bd3355194f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:03.223129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70eb6f-aa94-4c7a-a3a0-bd3355194f68 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:03.223763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70eb6f-aa94-4c7a-a3a0-bd3355194f68 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:03.224069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70eb6f-aa94-4c7a-a3a0-bd3355194f68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:03.225458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70eb6f-aa94-4c7a-a3a0-bd3355194f68 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:03.242996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 394/802] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Sep 13 06:25:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:03.254735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70eb6f-aa94-4c7a-a3a0-bd3355194f68 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:03.283279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede75f56-a2ee-4f00-8a3c-b977c8508240 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:03.325000 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125cf56-5e86-4397-903c-536d8aab3f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:03.326108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125cf56-5e86-4397-903c-536d8aab3f22 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:03.326388 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125cf56-5e86-4397-903c-536d8aab3f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:03.326660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7125cf56-5e86-4397-903c-536d8aab3f22 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:03.327323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125cf56-5e86-4397-903c-536d8aab3f22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:03.327626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125cf56-5e86-4397-903c-536d8aab3f22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:03.329009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7125cf56-5e86-4397-903c-536d8aab3f22 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:03.330429 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:03.340905 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 409/803] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:25:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:03.341741 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125cf56-5e86-4397-903c-536d8aab3f22 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:03.351687 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:03.408912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70eb6f-aa94-4c7a-a3a0-bd3355194f68 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:03.458437 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8252d66-0458-416e-bb2a-bc2c4eaa6926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:03.459046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8252d66-0458-416e-bb2a-bc2c4eaa6926 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:03.459329 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8252d66-0458-416e-bb2a-bc2c4eaa6926 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:03.459603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8252d66-0458-416e-bb2a-bc2c4eaa6926 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:03.460239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8252d66-0458-416e-bb2a-bc2c4eaa6926 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:03.461110 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8252d66-0458-416e-bb2a-bc2c4eaa6926 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:03.462827 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8252d66-0458-416e-bb2a-bc2c4eaa6926 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:03.470409 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 395/804] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Sep 13 06:25:03 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:03.471269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8252d66-0458-416e-bb2a-bc2c4eaa6926 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:03.479308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7125cf56-5e86-4397-903c-536d8aab3f22 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:03.521175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc06caa-44bb-495f-a7cc-d08dc07d991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:03.521829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06caa-44bb-495f-a7cc-d08dc07d991b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:03.522113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06caa-44bb-495f-a7cc-d08dc07d991b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:03.522466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc06caa-44bb-495f-a7cc-d08dc07d991b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:03.535523 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc06caa-44bb-495f-a7cc-d08dc07d991b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-4fc06caa-44bb-495f-a7cc-d08dc07d991b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:25:03.541249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:03.542265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:03.543570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:03.543570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:03.543570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:03.543570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:03.543570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:25:03.543570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:25:03.543570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:25:03.543570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:25:03.543570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:25:03.543570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:25:03.543570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:25:03.543570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:03.543570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 410/805] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:25:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:03.544860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc06caa-44bb-495f-a7cc-d08dc07d991b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:03.625224 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:03.677375 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc06caa-44bb-495f-a7cc-d08dc07d991b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:03.701041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8252d66-0458-416e-bb2a-bc2c4eaa6926 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:03.713014 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd93996-0f21-4dc6-8e22-2316a0fb8883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:03.713623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd93996-0f21-4dc6-8e22-2316a0fb8883 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:03.713903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd93996-0f21-4dc6-8e22-2316a0fb8883 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:03.714176 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd93996-0f21-4dc6-8e22-2316a0fb8883 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:03.714839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd93996-0f21-4dc6-8e22-2316a0fb8883 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:03.716273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd93996-0f21-4dc6-8e22-2316a0fb8883 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:03.721463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:03.737289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d8a18-0de5-4c84-806c-bcf351d7045a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:03.738187 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d8a18-0de5-4c84-806c-bcf351d7045a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:03.738464 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d8a18-0de5-4c84-806c-bcf351d7045a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:03.738856 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d8a18-0de5-4c84-806c-bcf351d7045a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:03.749479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 411/806] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:25:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:25:03.750340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd93996-0f21-4dc6-8e22-2316a0fb8883 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:03.759974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d8a18-0de5-4c84-806c-bcf351d7045a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:03.762124 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d8a18-0de5-4c84-806c-bcf351d7045a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-116d8a18-0de5-4c84-806c-bcf351d7045a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:03.783971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:03.785077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:03.785992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:03.785992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:03.785992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:03.785992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 396/807] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:03.786918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa084e0-dc98-4ef9-8778-98c8816ad14c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:03.787205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa084e0-dc98-4ef9-8778-98c8816ad14c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:03.787476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa084e0-dc98-4ef9-8778-98c8816ad14c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:03.792812 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 397/808] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:03.794146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa084e0-dc98-4ef9-8778-98c8816ad14c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:03.904743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd93996-0f21-4dc6-8e22-2316a0fb8883 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:03.912099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa084e0-dc98-4ef9-8778-98c8816ad14c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:03.920602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:03.955037 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbe187-88f7-428b-ab8d-8dd79145f25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:03.955268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a830b90-19f0-4f83-92ea-82c67bbca203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:03.955829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a830b90-19f0-4f83-92ea-82c67bbca203 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:03.956114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a830b90-19f0-4f83-92ea-82c67bbca203 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:03.956388 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a830b90-19f0-4f83-92ea-82c67bbca203 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:03.956825 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbe187-88f7-428b-ab8d-8dd79145f25b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:03.957073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a830b90-19f0-4f83-92ea-82c67bbca203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:03.957378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a830b90-19f0-4f83-92ea-82c67bbca203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:03.957729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbe187-88f7-428b-ab8d-8dd79145f25b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:03.958190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbbe187-88f7-428b-ab8d-8dd79145f25b None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:03.958736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a830b90-19f0-4f83-92ea-82c67bbca203 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:03.959258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbe187-88f7-428b-ab8d-8dd79145f25b None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:03.959753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbe187-88f7-428b-ab8d-8dd79145f25b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:03.962223 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbbe187-88f7-428b-ab8d-8dd79145f25b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:03.973930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 398/809] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:03.974882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 412/810] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:25:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:03.975020 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e2252-4112-4a0c-9de5-a6d783eda7aa None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:03.975129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e2252-4112-4a0c-9de5-a6d783eda7aa None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:03.975355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3e2252-4112-4a0c-9de5-a6d783eda7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:03.982246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbe187-88f7-428b-ab8d-8dd79145f25b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:03.998864 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6b3e2252-4112-4a0c-9de5-a6d783eda7aa None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:03.999976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6b3e2252-4112-4a0c-9de5-a6d783eda7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:04.041047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:04.084470 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 399/811] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:04.085467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e2252-4112-4a0c-9de5-a6d783eda7aa None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:04.118455 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbbe187-88f7-428b-ab8d-8dd79145f25b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:04.185780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f65d5-2162-43c6-bd76-7af45f915153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:04.186420 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f65d5-2162-43c6-bd76-7af45f915153 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:04.186698 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f65d5-2162-43c6-bd76-7af45f915153 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:04.186970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2f65d5-2162-43c6-bd76-7af45f915153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:04.191499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3e2252-4112-4a0c-9de5-a6d783eda7aa None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:04.213562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f65d5-2162-43c6-bd76-7af45f915153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:04.215179 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2f65d5-2162-43c6-bd76-7af45f915153 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-ae2f65d5-2162-43c6-bd76-7af45f915153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:04.239514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:04.240566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:04.241516 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:04.241516 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:04.241516 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:04.241516 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 413/812] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:04.241749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4672ec-ca79-4256-9058-ae373548e96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:04.242284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4672ec-ca79-4256-9058-ae373548e96d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:04.242284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4672ec-ca79-4256-9058-ae373548e96d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:04.242520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4672ec-ca79-4256-9058-ae373548e96d None admin] PATH_INFO: `/v3/users/nova` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:04.249851 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f65d5-2162-43c6-bd76-7af45f915153 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:04.256820 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4672ec-ca79-4256-9058-ae373548e96d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:04.258338 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4672ec-ca79-4256-9058-ae373548e96d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-fd4672ec-ca79-4256-9058-ae373548e96d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:25:04.270727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:04.271701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:04.272628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:04.272628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:04.272628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:25:04.272628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:25:04.272628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:25:04.272628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:25:04.272628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:25:04.272628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:25:04.272628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:25:04.272628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:04.272628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 400/813] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 13 06:25:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:04.280750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4672ec-ca79-4256-9058-ae373548e96d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:04.300480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:04.333150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:04.424019 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2f65d5-2162-43c6-bd76-7af45f915153 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:04.461323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdbfb0-cdd6-4daa-90df-b4630d560f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:04.461932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdbfb0-cdd6-4daa-90df-b4630d560f30 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:04.462212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdbfb0-cdd6-4daa-90df-b4630d560f30 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:04.462482 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cdbfb0-cdd6-4daa-90df-b4630d560f30 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:04.463127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdbfb0-cdd6-4daa-90df-b4630d560f30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:04.463433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdbfb0-cdd6-4daa-90df-b4630d560f30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:04.464813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cdbfb0-cdd6-4daa-90df-b4630d560f30 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:04.483929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 414/814] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:04.485278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdbfb0-cdd6-4daa-90df-b4630d560f30 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:04.503056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4672ec-ca79-4256-9058-ae373548e96d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:04.539566 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da807267-7c09-4762-b8cc-eb1dd2857cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:04.540323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da807267-7c09-4762-b8cc-eb1dd2857cda None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:04.540750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da807267-7c09-4762-b8cc-eb1dd2857cda None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:04.541118 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da807267-7c09-4762-b8cc-eb1dd2857cda None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:04.541941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da807267-7c09-4762-b8cc-eb1dd2857cda None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:04.542434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da807267-7c09-4762-b8cc-eb1dd2857cda None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:04.543841 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da807267-7c09-4762-b8cc-eb1dd2857cda None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:04.562553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 401/815] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 13 06:25:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:04.563476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da807267-7c09-4762-b8cc-eb1dd2857cda None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:04.584196 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:04.608449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cdbfb0-cdd6-4daa-90df-b4630d560f30 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:04.661055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:04.662486 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592d4b6-4251-4a74-bc5b-48e9023fbaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:04.663611 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592d4b6-4251-4a74-bc5b-48e9023fbaf4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:04.663970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592d4b6-4251-4a74-bc5b-48e9023fbaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:04.664321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592d4b6-4251-4a74-bc5b-48e9023fbaf4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:04.674084 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592d4b6-4251-4a74-bc5b-48e9023fbaf4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:04.676317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592d4b6-4251-4a74-bc5b-48e9023fbaf4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:04.684023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da807267-7c09-4762-b8cc-eb1dd2857cda None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2592d4b6-4251-4a74-bc5b-48e9023fbaf4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:25:04.692403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:04.693400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:04.694345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:04.694345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:04.694345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:25:04.694345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:25:04.694345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:25:04.694345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:25:04.694345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:25:04.694345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:25:04.694345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:25:04.694345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:04.698664 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 415/816] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 13 06:25:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:04.699581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592d4b6-4251-4a74-bc5b-48e9023fbaf4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:04.726137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2b6c5-7e13-4ad7-819c-fe3fa802b355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:04.727119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2b6c5-7e13-4ad7-819c-fe3fa802b355 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:04.727602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2b6c5-7e13-4ad7-819c-fe3fa802b355 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:04.728072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a2b6c5-7e13-4ad7-819c-fe3fa802b355 None admin] PATH_INFO: `/v3/services/network` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:04.729180 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2b6c5-7e13-4ad7-819c-fe3fa802b355 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:04.730729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a2b6c5-7e13-4ad7-819c-fe3fa802b355 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e3a2b6c5-7e13-4ad7-819c-fe3fa802b355 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:04.740431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:04.741620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:04.742508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:04.742508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:04.742508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:04.742508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:04.742508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:04.742508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:04.742508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:04.742508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:04.742508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:04.742508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:04.742508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:04.742508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:04.742508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 06:25:04.742508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:04.750113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 402/817] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:04 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:04.752804 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2b6c5-7e13-4ad7-819c-fe3fa802b355 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:04.825762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592d4b6-4251-4a74-bc5b-48e9023fbaf4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:04.861564 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d84c7-62c0-46dd-9f75-8ee41c119170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:04.862140 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d84c7-62c0-46dd-9f75-8ee41c119170 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:04.862423 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d84c7-62c0-46dd-9f75-8ee41c119170 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:04.862696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d84c7-62c0-46dd-9f75-8ee41c119170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:04.871782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a2b6c5-7e13-4ad7-819c-fe3fa802b355 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:04.875443 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:04.911921 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c113016-7c7c-485d-b847-0d1cb8d573d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:04.912999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113016-7c7c-485d-b847-0d1cb8d573d7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:04.913918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113016-7c7c-485d-b847-0d1cb8d573d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:04.914403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c113016-7c7c-485d-b847-0d1cb8d573d7 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:04.915436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c113016-7c7c-485d-b847-0d1cb8d573d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:04.915995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c113016-7c7c-485d-b847-0d1cb8d573d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:04.917645 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c113016-7c7c-485d-b847-0d1cb8d573d7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:04.935006 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d84c7-62c0-46dd-9f75-8ee41c119170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:04.936619 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7d84c7-62c0-46dd-9f75-8ee41c119170 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:04.937135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 403/818] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Sep 13 06:25:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:04.938168 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c113016-7c7c-485d-b847-0d1cb8d573d7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:04.941034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:05.051144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 416/819] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:25:04 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:25:05.052068 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d84c7-62c0-46dd-9f75-8ee41c119170 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:05.053749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c113016-7c7c-485d-b847-0d1cb8d573d7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:05.092625 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd9bcb-c1e6-4395-81c9-8d5c1451b64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:05.093594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd9bcb-c1e6-4395-81c9-8d5c1451b64d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:05.094075 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd9bcb-c1e6-4395-81c9-8d5c1451b64d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:05.094569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd9bcb-c1e6-4395-81c9-8d5c1451b64d None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:05.095396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd9bcb-c1e6-4395-81c9-8d5c1451b64d None admin] RBAC: Adding query filter params (name=network) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:05.096036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd9bcb-c1e6-4395-81c9-8d5c1451b64d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:05.097634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd9bcb-c1e6-4395-81c9-8d5c1451b64d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:05.101523 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:05.109149 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 404/820] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 13 06:25:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:05.110501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd9bcb-c1e6-4395-81c9-8d5c1451b64d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:05.165644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d84c7-62c0-46dd-9f75-8ee41c119170 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:05.188444 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:05.202279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fb4b4-4441-4dad-bffe-97a473852f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:05.203126 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fb4b4-4441-4dad-bffe-97a473852f85 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:05.203241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fb4b4-4441-4dad-bffe-97a473852f85 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:05.203433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17fb4b4-4441-4dad-bffe-97a473852f85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:05.214216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fb4b4-4441-4dad-bffe-97a473852f85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:05.215665 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17fb4b4-4441-4dad-bffe-97a473852f85 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:05.228331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd9bcb-c1e6-4395-81c9-8d5c1451b64d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-e17fb4b4-4441-4dad-bffe-97a473852f85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:05.230912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:05.232403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:05.233341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:05.233341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:05.233341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:05.237278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 417/821] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:05.238126 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fb4b4-4441-4dad-bffe-97a473852f85 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:05.269552 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e412b0-7a84-4167-994b-409789175ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:05.270616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e412b0-7a84-4167-994b-409789175ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:05.271121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e412b0-7a84-4167-994b-409789175ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:05.271461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e412b0-7a84-4167-994b-409789175ee0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:05.286472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e412b0-7a84-4167-994b-409789175ee0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:05.287919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e412b0-7a84-4167-994b-409789175ee0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d1e412b0-7a84-4167-994b-409789175ee0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:05.303400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:05.304360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:05.305295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:05.305295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:05.305295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:05.305295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 405/822] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:05.305295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e412b0-7a84-4167-994b-409789175ee0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:05.343287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:05.350445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17fb4b4-4441-4dad-bffe-97a473852f85 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:05.388714 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23cb8ba-74b6-4e07-bba6-ea7c5392957a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:05.389313 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cb8ba-74b6-4e07-bba6-ea7c5392957a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:05.389598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cb8ba-74b6-4e07-bba6-ea7c5392957a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:05.389859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23cb8ba-74b6-4e07-bba6-ea7c5392957a None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:05.390492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23cb8ba-74b6-4e07-bba6-ea7c5392957a None admin] RBAC: Adding query filter params (type=network) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:05.390796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23cb8ba-74b6-4e07-bba6-ea7c5392957a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:05.392146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23cb8ba-74b6-4e07-bba6-ea7c5392957a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:05.397178 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 418/823] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 13 06:25:05 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:05.398294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff6e84-9996-48c5-a962-d8cab7f29079 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:05.398567 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff6e84-9996-48c5-a962-d8cab7f29079 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:05.398836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ff6e84-9996-48c5-a962-d8cab7f29079 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:05.404345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 419/824] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:05.404345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff6e84-9996-48c5-a962-d8cab7f29079 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:05.413919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e412b0-7a84-4167-994b-409789175ee0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:05.434011 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:05.453578 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3924452-312a-4f95-b845-2df7302ff7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:05.454570 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3924452-312a-4f95-b845-2df7302ff7d8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:05.454828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3924452-312a-4f95-b845-2df7302ff7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:05.455099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3924452-312a-4f95-b845-2df7302ff7d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:05.456054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3924452-312a-4f95-b845-2df7302ff7d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:05.456516 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3924452-312a-4f95-b845-2df7302ff7d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:05.458064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3924452-312a-4f95-b845-2df7302ff7d8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:05.471983 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 406/825] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:05.473076 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3924452-312a-4f95-b845-2df7302ff7d8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:05.520088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ff6e84-9996-48c5-a962-d8cab7f29079 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:05.556994 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603230a-2904-4842-af31-cf81991160d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:05.557597 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603230a-2904-4842-af31-cf81991160d0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:05.557874 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603230a-2904-4842-af31-cf81991160d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:05.558144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603230a-2904-4842-af31-cf81991160d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:05.558780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603230a-2904-4842-af31-cf81991160d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:05.559084 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603230a-2904-4842-af31-cf81991160d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:05.560474 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603230a-2904-4842-af31-cf81991160d0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:05.572454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 420/826] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:05.577182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364483be-1570-489c-871b-03cfad1fa7fb None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:05.577182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364483be-1570-489c-871b-03cfad1fa7fb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:05.577182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364483be-1570-489c-871b-03cfad1fa7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:05.586720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3924452-312a-4f95-b845-2df7302ff7d8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:05.593566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-364483be-1570-489c-871b-03cfad1fa7fb None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:05.595129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-364483be-1570-489c-871b-03cfad1fa7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:05.610834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:05.630180 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fb2b6-fdc8-49ae-b244-ed3f13a40e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:05.630824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fb2b6-fdc8-49ae-b244-ed3f13a40e48 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:05.631105 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fb2b6-fdc8-49ae-b244-ed3f13a40e48 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:05.631377 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8fb2b6-fdc8-49ae-b244-ed3f13a40e48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:05.632071 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fb2b6-fdc8-49ae-b244-ed3f13a40e48 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:05.633438 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8fb2b6-fdc8-49ae-b244-ed3f13a40e48 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:05.661743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 407/827] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:25:05 2022] POST /identity/v3/endpoints => generated 337 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:25:05.662573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fb2b6-fdc8-49ae-b244-ed3f13a40e48 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:05.701040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 421/828] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:05 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:05.702501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364483be-1570-489c-871b-03cfad1fa7fb None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:05.715271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:05.837013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8fb2b6-fdc8-49ae-b244-ed3f13a40e48 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:05.879213 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90e017-bfa2-4d98-8da7-12cc4baf7466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:05.879744 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90e017-bfa2-4d98-8da7-12cc4baf7466 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:05.880023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90e017-bfa2-4d98-8da7-12cc4baf7466 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:05.880294 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90e017-bfa2-4d98-8da7-12cc4baf7466 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:05.894947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90e017-bfa2-4d98-8da7-12cc4baf7466 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:05.896883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90e017-bfa2-4d98-8da7-12cc4baf7466 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:05.909939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364483be-1570-489c-871b-03cfad1fa7fb None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:05.910476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2e90e017-bfa2-4d98-8da7-12cc4baf7466 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:05.910476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:05.910476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:05.910476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:05.910476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:05.910476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:05.910476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:05.910476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:05.910476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:05.910476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:05.910476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:05.910476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:05.910476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:25:05.910476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:25:05.910476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:05.911363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:05.912834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:25:05.912834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:25:05.912834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:25:05.912834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:25:05.912834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:25:05.912834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:25:05.912834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:05.912834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:05.912834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 408/829] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:05.917497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90e017-bfa2-4d98-8da7-12cc4baf7466 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:05.951463 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b51315-5dbb-4bb9-bd05-7045708e215d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:05.952214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b51315-5dbb-4bb9-bd05-7045708e215d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:05.952491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b51315-5dbb-4bb9-bd05-7045708e215d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:05.952930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b51315-5dbb-4bb9-bd05-7045708e215d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:05.962102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b51315-5dbb-4bb9-bd05-7045708e215d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:05.963542 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b51315-5dbb-4bb9-bd05-7045708e215d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:05.976209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-f2b51315-5dbb-4bb9-bd05-7045708e215d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:05.976209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:05.976209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:05.976209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:05.976209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:05.976209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:05.976209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:05.976209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:05.976209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:05.976209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:05.976209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:05.976209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:05.976209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:25:05.976209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:25:05.976209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:05.977243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:05.978856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:25:05.978856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:25:05.978856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:25:05.978856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:25:05.978856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:25:05.978856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:25:05.978856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:05.978856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:05.978856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 422/830] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:05.984046 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b51315-5dbb-4bb9-bd05-7045708e215d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:05.989253 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:06.043031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:06.052010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90e017-bfa2-4d98-8da7-12cc4baf7466 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:06.100877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bc960-078f-4f9e-b4e0-da82ebd0b5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:06.101914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bc960-078f-4f9e-b4e0-da82ebd0b5ae None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:06.102263 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bc960-078f-4f9e-b4e0-da82ebd0b5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:06.102641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bc960-078f-4f9e-b4e0-da82ebd0b5ae None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:06.103569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bc960-078f-4f9e-b4e0-da82ebd0b5ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:06.103947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bc960-078f-4f9e-b4e0-da82ebd0b5ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:06.108021 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bc960-078f-4f9e-b4e0-da82ebd0b5ae None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:06.119663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b51315-5dbb-4bb9-bd05-7045708e215d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:06.120808 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 409/831] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:25:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:06.121624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bc960-078f-4f9e-b4e0-da82ebd0b5ae None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:06.155012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d22a70-9cd1-4814-a6f7-86320856a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:06.155719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d22a70-9cd1-4814-a6f7-86320856a974 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:06.156075 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d22a70-9cd1-4814-a6f7-86320856a974 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:06.156422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d22a70-9cd1-4814-a6f7-86320856a974 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:06.157557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d22a70-9cd1-4814-a6f7-86320856a974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:06.157557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d22a70-9cd1-4814-a6f7-86320856a974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:06.158953 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d22a70-9cd1-4814-a6f7-86320856a974 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:06.174024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 423/832] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:25:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:06.175234 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb21d9-2dc4-453d-921b-ab8c1701ad29 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:06.175525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb21d9-2dc4-453d-921b-ab8c1701ad29 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:06.175799 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cb21d9-2dc4-453d-921b-ab8c1701ad29 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:06.177150 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 424/833] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:06.177765 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb21d9-2dc4-453d-921b-ab8c1701ad29 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:06.222479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bc960-078f-4f9e-b4e0-da82ebd0b5ae None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:06.240022 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:06.257575 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee302e-5b8c-4947-bd32-2447f3eb10e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:06.258198 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee302e-5b8c-4947-bd32-2447f3eb10e9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:06.258475 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee302e-5b8c-4947-bd32-2447f3eb10e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:06.258746 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee302e-5b8c-4947-bd32-2447f3eb10e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:06.268692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee302e-5b8c-4947-bd32-2447f3eb10e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ceee302e-5b8c-4947-bd32-2447f3eb10e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:25:06.273362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:06.274410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:06.275271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:06.275271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:06.275271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:06.275271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:06.275271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:25:06.275271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:25:06.275271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:25:06.275271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:25:06.275271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:25:06.275271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:25:06.275271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:25:06.275271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:06.275271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 410/834] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:25:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:06.275271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee302e-5b8c-4947-bd32-2447f3eb10e9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:06.283844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cb21d9-2dc4-453d-921b-ab8c1701ad29 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:06.292100 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:06.318933 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059dbb3-a9b8-48f2-9386-5284744bcd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:06.319578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059dbb3-a9b8-48f2-9386-5284744bcd0b None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:06.319864 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059dbb3-a9b8-48f2-9386-5284744bcd0b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:06.320135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059dbb3-a9b8-48f2-9386-5284744bcd0b None admin] PATH_INFO: `/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/3739971aa30548d6932d7af156e1fdaf/roles/dc60d33cb0c649b3b903d99258a19c98` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:06.335085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059dbb3-a9b8-48f2-9386-5284744bcd0b None admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c3f0aa3b746108e73737491b003e7, user_id=3739971aa30548d6932d7af156e1fdaf, role_id=dc60d33cb0c649b3b903d99258a19c98)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:06.336523 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059dbb3-a9b8-48f2-9386-5284744bcd0b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:06.349789 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 425/835] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:25:06 2022] PUT /identity/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/3739971aa30548d6932d7af156e1fdaf/roles/dc60d33cb0c649b3b903d99258a19c98 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:25:06.361493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0f3b7-2d59-4321-a192-3d8a98e47e32 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:06.361493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0f3b7-2d59-4321-a192-3d8a98e47e32 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:06.361493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b0f3b7-2d59-4321-a192-3d8a98e47e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:06.378495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d9b0f3b7-2d59-4321-a192-3d8a98e47e32 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:06.378943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee302e-5b8c-4947-bd32-2447f3eb10e9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:06.379729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d9b0f3b7-2d59-4321-a192-3d8a98e47e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:06.419529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b9bfc-8c44-4ae1-b731-90696eb83f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:06.420089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b9bfc-8c44-4ae1-b731-90696eb83f07 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:06.420370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b9bfc-8c44-4ae1-b731-90696eb83f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:06.420641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2b9bfc-8c44-4ae1-b731-90696eb83f07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:06.421406 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b9bfc-8c44-4ae1-b731-90696eb83f07 None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=7fbb67072ba544e39073787eb25fcf1e) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:06.421721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b9bfc-8c44-4ae1-b731-90696eb83f07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:06.423160 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2b9bfc-8c44-4ae1-b731-90696eb83f07 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:06.429830 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 411/836] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:25:06 2022] GET /identity/v3/role_assignments?user.id=7fbb67072ba544e39073787eb25fcf1e&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=6382a06103714d068409d25cbeb48744 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:06.430706 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b9bfc-8c44-4ae1-b731-90696eb83f07 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:06.465397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 426/837] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:06.539789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:06.561804 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2b9bfc-8c44-4ae1-b731-90696eb83f07 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:06.600069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4ddf6-d4de-4136-8e26-9444b69a93e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:06.600721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4ddf6-d4de-4136-8e26-9444b69a93e7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:06.601002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4ddf6-d4de-4136-8e26-9444b69a93e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:06.601270 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4ddf6-d4de-4136-8e26-9444b69a93e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:06.601947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4ddf6-d4de-4136-8e26-9444b69a93e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:06.602245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4ddf6-d4de-4136-8e26-9444b69a93e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:06.603606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4ddf6-d4de-4136-8e26-9444b69a93e7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:06.613811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 412/838] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:25:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:06.619336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0f3b7-2d59-4321-a192-3d8a98e47e32 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:06.672483 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:06.733709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b0f3b7-2d59-4321-a192-3d8a98e47e32 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:06.754445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4ddf6-d4de-4136-8e26-9444b69a93e7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:06.773725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c182b2-4d29-46fb-830e-52d52f1304d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:06.774366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c182b2-4d29-46fb-830e-52d52f1304d4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:06.774644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c182b2-4d29-46fb-830e-52d52f1304d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:06.774917 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c182b2-4d29-46fb-830e-52d52f1304d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:06.790837 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c182b2-4d29-46fb-830e-52d52f1304d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:06.793161 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c182b2-4d29-46fb-830e-52d52f1304d4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-d8c182b2-4d29-46fb-830e-52d52f1304d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:06.814275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:06.815250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:06.816166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:06.816166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:06.816166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:06.818100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 427/839] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:06.823718 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c182b2-4d29-46fb-830e-52d52f1304d4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:06.898205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4ddf6-d4de-4136-8e26-9444b69a93e7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:06.941877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbea1f9-2d5c-49d5-9039-134a6650d6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:06.942498 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbea1f9-2d5c-49d5-9039-134a6650d6f6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:06.942728 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbea1f9-2d5c-49d5-9039-134a6650d6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:06.942966 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbea1f9-2d5c-49d5-9039-134a6650d6f6 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:06.943835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbea1f9-2d5c-49d5-9039-134a6650d6f6 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:06.945285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbea1f9-2d5c-49d5-9039-134a6650d6f6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:06.954840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-1cbea1f9-2d5c-49d5-9039-134a6650d6f6 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:06.957234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:06.958236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:06.959102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:06.959102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:06.959102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:06.959102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:06.959102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:06.959102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:06.959102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:06.959102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:06.959102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:06.959102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:06.959102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:06.959102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:06.959102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:25:06.959102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:06.959102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 413/840] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:25:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:06.966272 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c182b2-4d29-46fb-830e-52d52f1304d4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:06.968818 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbea1f9-2d5c-49d5-9039-134a6650d6f6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:06.974777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:07.013696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18639749-da4a-4141-a397-a5b77022be7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:07.014938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18639749-da4a-4141-a397-a5b77022be7e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:07.016265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18639749-da4a-4141-a397-a5b77022be7e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:07.016771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18639749-da4a-4141-a397-a5b77022be7e None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:07.017620 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18639749-da4a-4141-a397-a5b77022be7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:07.018146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18639749-da4a-4141-a397-a5b77022be7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:07.019698 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18639749-da4a-4141-a397-a5b77022be7e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:07.040947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 428/841] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:07.041966 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18639749-da4a-4141-a397-a5b77022be7e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:07.105423 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbea1f9-2d5c-49d5-9039-134a6650d6f6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:07.148234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c9d6c-9990-4652-b297-05f9daf7e0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:07.148911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c9d6c-9990-4652-b297-05f9daf7e0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:07.149195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c9d6c-9990-4652-b297-05f9daf7e0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:07.149471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c9d6c-9990-4652-b297-05f9daf7e0e0 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:07.150485 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c9d6c-9990-4652-b297-05f9daf7e0e0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:07.150807 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c9d6c-9990-4652-b297-05f9daf7e0e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:07.152480 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c9d6c-9990-4652-b297-05f9daf7e0e0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:07.162711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 414/842] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:25:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:07.164935 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c9d6c-9990-4652-b297-05f9daf7e0e0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:07.177139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18639749-da4a-4141-a397-a5b77022be7e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:07.222504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d6b9b-a5bc-4c26-a1ed-c0912e312052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:07.223083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d6b9b-a5bc-4c26-a1ed-c0912e312052 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:07.223361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d6b9b-a5bc-4c26-a1ed-c0912e312052 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:07.223637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d6b9b-a5bc-4c26-a1ed-c0912e312052 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:07.231223 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d6b9b-a5bc-4c26-a1ed-c0912e312052 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:07.232716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d6b9b-a5bc-4c26-a1ed-c0912e312052 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-390d6b9b-a5bc-4c26-a1ed-c0912e312052 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:25:07.245030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:07.246284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:07.247787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:07.247787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:07.247787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:25:07.247787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:25:07.247787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:25:07.247787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:25:07.247787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:25:07.247787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:25:07.247787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 06:25:07.247787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:07.251734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 429/843] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:25:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:07.253126 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d6b9b-a5bc-4c26-a1ed-c0912e312052 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:07.254188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:07.274490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:07.297532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c9d6c-9990-4652-b297-05f9daf7e0e0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:07.340092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3f5b2-4152-47ed-9318-007c6d0179e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:07.341429 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3f5b2-4152-47ed-9318-007c6d0179e5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:07.341714 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3f5b2-4152-47ed-9318-007c6d0179e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:07.343331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a3f5b2-4152-47ed-9318-007c6d0179e5 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:07.343876 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3f5b2-4152-47ed-9318-007c6d0179e5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:07.344188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3f5b2-4152-47ed-9318-007c6d0179e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:07.345588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a3f5b2-4152-47ed-9318-007c6d0179e5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:07.356713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 415/844] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:25:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:07.375703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d6b9b-a5bc-4c26-a1ed-c0912e312052 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:07.414123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b95cd7-ea8b-4b66-a0ec-30845600a700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:07.414759 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b95cd7-ea8b-4b66-a0ec-30845600a700 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:07.415039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b95cd7-ea8b-4b66-a0ec-30845600a700 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:07.415314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b95cd7-ea8b-4b66-a0ec-30845600a700 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:07.416079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b95cd7-ea8b-4b66-a0ec-30845600a700 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:07.416389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b95cd7-ea8b-4b66-a0ec-30845600a700 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:07.417941 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b95cd7-ea8b-4b66-a0ec-30845600a700 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:07.443492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 430/845] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Sep 13 06:25:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:07.446002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3f5b2-4152-47ed-9318-007c6d0179e5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:07.554249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a3f5b2-4152-47ed-9318-007c6d0179e5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:07.584434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:07.592297 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e5888-a897-4816-9cb7-08d9acc5d6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:07.592967 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e5888-a897-4816-9cb7-08d9acc5d6cf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:07.593411 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e5888-a897-4816-9cb7-08d9acc5d6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:07.593867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54e5888-a897-4816-9cb7-08d9acc5d6cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:07.665304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e5888-a897-4816-9cb7-08d9acc5d6cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:07.667044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54e5888-a897-4816-9cb7-08d9acc5d6cf None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:07.766713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 416/846] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:25:07 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:25:07.772722 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b95cd7-ea8b-4b66-a0ec-30845600a700 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:07.859884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:07.886833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b95cd7-ea8b-4b66-a0ec-30845600a700 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:07.928132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3df7c-ca94-4ed9-813f-1aa513507205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:07.928853 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3df7c-ca94-4ed9-813f-1aa513507205 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:07.929136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3df7c-ca94-4ed9-813f-1aa513507205 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:07.929414 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3df7c-ca94-4ed9-813f-1aa513507205 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:07.939855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3df7c-ca94-4ed9-813f-1aa513507205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:07.941337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3df7c-ca94-4ed9-813f-1aa513507205 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-0ff3df7c-ca94-4ed9-813f-1aa513507205 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:07.958215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:07.959168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:07.960061 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:07.960061 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:07.960061 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:07.964040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 431/847] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:07.965404 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e5888-a897-4816-9cb7-08d9acc5d6cf None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:07.997307 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:08.067067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54e5888-a897-4816-9cb7-08d9acc5d6cf None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:08.101894 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93499b13-738f-4028-9b4f-8feb7be14b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:08.102507 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93499b13-738f-4028-9b4f-8feb7be14b81 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:08.102782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93499b13-738f-4028-9b4f-8feb7be14b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:08.103051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93499b13-738f-4028-9b4f-8feb7be14b81 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:08.103687 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93499b13-738f-4028-9b4f-8feb7be14b81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:08.103987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93499b13-738f-4028-9b4f-8feb7be14b81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:08.105397 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93499b13-738f-4028-9b4f-8feb7be14b81 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:08.118209 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 417/848] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:08.124184 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3df7c-ca94-4ed9-813f-1aa513507205 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:08.231555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3df7c-ca94-4ed9-813f-1aa513507205 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:08.258992 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:08.269268 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560948d-fc21-40c2-9451-cda2a8c5dcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:08.270204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560948d-fc21-40c2-9451-cda2a8c5dcbc None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:08.270770 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560948d-fc21-40c2-9451-cda2a8c5dcbc None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:08.271245 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2560948d-fc21-40c2-9451-cda2a8c5dcbc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:08.279210 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560948d-fc21-40c2-9451-cda2a8c5dcbc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:08.280976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2560948d-fc21-40c2-9451-cda2a8c5dcbc None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:08.293197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2560948d-fc21-40c2-9451-cda2a8c5dcbc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:08.293197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:08.293197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:08.293197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:08.293197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:08.293197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:08.293197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:08.293197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:08.293197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:08.293197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:08.293197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:08.293197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:08.293197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:25:08.293197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:25:08.293197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:08.294185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:08.295108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:25:08.295108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:25:08.295108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:25:08.295108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:25:08.295108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:25:08.295108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:25:08.295108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:08.295108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:08.300848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 432/849] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:08.304321 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93499b13-738f-4028-9b4f-8feb7be14b81 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:08.401870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:08.411673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93499b13-738f-4028-9b4f-8feb7be14b81 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:08.445590 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a63c3-006e-4d4f-a4d0-6dd3c7b4db6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:08.446576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a63c3-006e-4d4f-a4d0-6dd3c7b4db6d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:08.447080 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a63c3-006e-4d4f-a4d0-6dd3c7b4db6d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:08.447558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a63c3-006e-4d4f-a4d0-6dd3c7b4db6d None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:08.448453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a63c3-006e-4d4f-a4d0-6dd3c7b4db6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:08.449089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a63c3-006e-4d4f-a4d0-6dd3c7b4db6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:08.451249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a63c3-006e-4d4f-a4d0-6dd3c7b4db6d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:08.468774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 418/850] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:25:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:08.470897 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560948d-fc21-40c2-9451-cda2a8c5dcbc None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:08.579681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2560948d-fc21-40c2-9451-cda2a8c5dcbc None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:08.622817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86faa3b9-592d-41cb-ab74-0ac21ad5de5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:08.623436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faa3b9-592d-41cb-ab74-0ac21ad5de5d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:08.623711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faa3b9-592d-41cb-ab74-0ac21ad5de5d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:08.623976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86faa3b9-592d-41cb-ab74-0ac21ad5de5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:08.624729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faa3b9-592d-41cb-ab74-0ac21ad5de5d None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=de05d038c2124f43a3acc70f4fb5b44e) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:08.625107 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faa3b9-592d-41cb-ab74-0ac21ad5de5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:08.626605 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86faa3b9-592d-41cb-ab74-0ac21ad5de5d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:08.633601 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 433/851] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:25:08 2022] GET /identity/v3/role_assignments?user.id=de05d038c2124f43a3acc70f4fb5b44e&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=6382a06103714d068409d25cbeb48744 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:08.711435 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3efb2-ff00-458c-a318-a459b83ed1c5 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:08.711632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3efb2-ff00-458c-a318-a459b83ed1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:08.711891 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3efb2-ff00-458c-a318-a459b83ed1c5 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:08.713645 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 419/852] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:08.719619 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec365e6-b089-4e23-877d-d7678655d6d3 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:08.719926 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec365e6-b089-4e23-877d-d7678655d6d3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:08.720172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec365e6-b089-4e23-877d-d7678655d6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:08.729615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec69228-e815-423e-96d1-eac55c9c337a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:08.729938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec69228-e815-423e-96d1-eac55c9c337a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:08.730158 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec69228-e815-423e-96d1-eac55c9c337a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:08.731853 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 420/853] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:25:08.737499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fe8fa-4485-4145-bcc4-2d17ae34fd85 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:08.737824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fe8fa-4485-4145-bcc4-2d17ae34fd85 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:08.738042 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fe8fa-4485-4145-bcc4-2d17ae34fd85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:08.740109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-5ec365e6-b089-4e23-877d-d7678655d6d3 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:08.741651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5ec365e6-b089-4e23-877d-d7678655d6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:08.757494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c83fe8fa-4485-4145-bcc4-2d17ae34fd85 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:08.758710 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c83fe8fa-4485-4145-bcc4-2d17ae34fd85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:08.808142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:08.834343 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 434/854] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:08.839777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 421/855] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:25:09.102273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec365e6-b089-4e23-877d-d7678655d6d3 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:09.108986 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fe8fa-4485-4145-bcc4-2d17ae34fd85 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:09.210519 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:09.221859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec365e6-b089-4e23-877d-d7678655d6d3 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:09.235196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fe8fa-4485-4145-bcc4-2d17ae34fd85 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:09.270121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef1fb5-ba4d-43e6-95c6-5c6e937bb128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:09.270752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef1fb5-ba4d-43e6-95c6-5c6e937bb128 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:09.271026 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef1fb5-ba4d-43e6-95c6-5c6e937bb128 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:09.271294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef1fb5-ba4d-43e6-95c6-5c6e937bb128 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:09.281836 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1672304-fa62-4694-882b-a5b48991222a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:09.282441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bef1fb5-ba4d-43e6-95c6-5c6e937bb128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:25:09.282618 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1672304-fa62-4694-882b-a5b48991222a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:09.282900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1672304-fa62-4694-882b-a5b48991222a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:09.283176 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1672304-fa62-4694-882b-a5b48991222a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:09.283762 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1672304-fa62-4694-882b-a5b48991222a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:09.285138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1672304-fa62-4694-882b-a5b48991222a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-9bef1fb5-ba4d-43e6-95c6-5c6e937bb128 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:25:09.287558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:09.288711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:09.289819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:09.289819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:09.289819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:09.289819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:09.289819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:25:09.289819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:25:09.289819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:25:09.289819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:25:09.289819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:25:09.289819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:25:09.289819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:25:09.289819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e1672304-fa62-4694-882b-a5b48991222a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:09.294658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:09.296899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:09.298034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:09.298034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:09.298034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:09.298034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:09.298034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:09.298034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:09.298034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:09.298034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:09.298034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:09.298034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:09.298034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:09.298034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:09.298034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:25:09.298034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:09.298965 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 435/856] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:25:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:09.298965 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef1fb5-ba4d-43e6-95c6-5c6e937bb128 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:09.301703 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 422/857] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Sep 13 06:25:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:09.301703 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1672304-fa62-4694-882b-a5b48991222a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:09.345001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:09.406521 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bef1fb5-ba4d-43e6-95c6-5c6e937bb128 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:09.442445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885dfa03-221a-42c3-ab0f-8e705ba93af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:09.443197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885dfa03-221a-42c3-ab0f-8e705ba93af7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:09.443575 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885dfa03-221a-42c3-ab0f-8e705ba93af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:09.443944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885dfa03-221a-42c3-ab0f-8e705ba93af7 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:09.444752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885dfa03-221a-42c3-ab0f-8e705ba93af7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:09.445147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885dfa03-221a-42c3-ab0f-8e705ba93af7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:09.445353 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1672304-fa62-4694-882b-a5b48991222a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:09.446700 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885dfa03-221a-42c3-ab0f-8e705ba93af7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:09.460006 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 436/858] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:25:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:09.461075 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885dfa03-221a-42c3-ab0f-8e705ba93af7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:09.484020 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55548106-53cd-40fe-9043-79c92cd2fa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:09.484920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55548106-53cd-40fe-9043-79c92cd2fa9b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:09.485291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55548106-53cd-40fe-9043-79c92cd2fa9b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:09.485684 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55548106-53cd-40fe-9043-79c92cd2fa9b None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:09.486437 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55548106-53cd-40fe-9043-79c92cd2fa9b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:09.486908 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55548106-53cd-40fe-9043-79c92cd2fa9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:09.488483 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55548106-53cd-40fe-9043-79c92cd2fa9b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:09.494658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 423/859] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 13 06:25:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:09.501046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55548106-53cd-40fe-9043-79c92cd2fa9b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:09.515961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:09.603120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885dfa03-221a-42c3-ab0f-8e705ba93af7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:09.605130 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:09.613851 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55548106-53cd-40fe-9043-79c92cd2fa9b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:09.648711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbccf0-0d75-4b8c-ab3e-f673c64cc4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:09.649382 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbccf0-0d75-4b8c-ab3e-f673c64cc4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:09.649730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbccf0-0d75-4b8c-ab3e-f673c64cc4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:09.650006 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbccf0-0d75-4b8c-ab3e-f673c64cc4b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:09.656766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b83b30-f8e0-492f-8d28-23436e2e6a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:09.657320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b83b30-f8e0-492f-8d28-23436e2e6a58 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:09.657599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b83b30-f8e0-492f-8d28-23436e2e6a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:09.657877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b83b30-f8e0-492f-8d28-23436e2e6a58 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:09.658510 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b83b30-f8e0-492f-8d28-23436e2e6a58 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:09.658816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b83b30-f8e0-492f-8d28-23436e2e6a58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:09.660167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b83b30-f8e0-492f-8d28-23436e2e6a58 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:09.661467 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbccf0-0d75-4b8c-ab3e-f673c64cc4b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:09.663192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbccf0-0d75-4b8c-ab3e-f673c64cc4b1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:09.670036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 424/860] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 13 06:25:09 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:09.670036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedc8ab-76a8-4265-881a-cb997bb3f231 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:09.670036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedc8ab-76a8-4265-881a-cb997bb3f231 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:09.670036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebedc8ab-76a8-4265-881a-cb997bb3f231 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:09.672203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 425/861] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:09.673609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf57e5-9dbf-4498-a40e-9ebe111dcc39 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:09.673894 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf57e5-9dbf-4498-a40e-9ebe111dcc39 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:09.674166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf57e5-9dbf-4498-a40e-9ebe111dcc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-84cbccf0-0d75-4b8c-ab3e-f673c64cc4b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:09.692541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:09.693582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:09.694568 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:09.694568 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:09.694568 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:09.695516 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fbcf57e5-9dbf-4498-a40e-9ebe111dcc39 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:09.701317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fbcf57e5-9dbf-4498-a40e-9ebe111dcc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:09.701540 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 437/862] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:09.704184 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbccf0-0d75-4b8c-ab3e-f673c64cc4b1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:09.793020 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 426/863] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:09.833721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbccf0-0d75-4b8c-ab3e-f673c64cc4b1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:09.869648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311196a-c576-46e3-99bf-6ad19cf9e7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:09.870883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311196a-c576-46e3-99bf-6ad19cf9e7ae None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:09.871376 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311196a-c576-46e3-99bf-6ad19cf9e7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:09.871845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311196a-c576-46e3-99bf-6ad19cf9e7ae None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:09.873263 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311196a-c576-46e3-99bf-6ad19cf9e7ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:09.873764 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311196a-c576-46e3-99bf-6ad19cf9e7ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:09.875342 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311196a-c576-46e3-99bf-6ad19cf9e7ae None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:09.887939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 438/864] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:09.893653 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf57e5-9dbf-4498-a40e-9ebe111dcc39 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:09.898288 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:09.998232 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf57e5-9dbf-4498-a40e-9ebe111dcc39 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:10.033317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0056800-2963-4035-8004-844ba26a32ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:10.034346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0056800-2963-4035-8004-844ba26a32ca None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:10.034824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0056800-2963-4035-8004-844ba26a32ca None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:10.035291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0056800-2963-4035-8004-844ba26a32ca None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:10.042571 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0056800-2963-4035-8004-844ba26a32ca None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:10.044809 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0056800-2963-4035-8004-844ba26a32ca None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-c0056800-2963-4035-8004-844ba26a32ca None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:25:10.056636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:10.057621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:10.058585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:10.058585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:10.058585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:25:10.058585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:25:10.058585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:25:10.058585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:25:10.058585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:25:10.058585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:25:10.058585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:25:10.058585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:10.061042 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 427/865] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 13 06:25:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:10.066801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311196a-c576-46e3-99bf-6ad19cf9e7ae None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:10.078072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0056800-2963-4035-8004-844ba26a32ca None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:10.097143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:10.144208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:10.186758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0056800-2963-4035-8004-844ba26a32ca None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:10.193042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311196a-c576-46e3-99bf-6ad19cf9e7ae None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:10.222907 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1335757-f5c8-477d-8c95-abe0f6ae372d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:10.223675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1335757-f5c8-477d-8c95-abe0f6ae372d None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:10.224139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1335757-f5c8-477d-8c95-abe0f6ae372d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:10.224295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1335757-f5c8-477d-8c95-abe0f6ae372d None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:10.225163 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1335757-f5c8-477d-8c95-abe0f6ae372d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:10.226713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1335757-f5c8-477d-8c95-abe0f6ae372d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:10.237128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddf2b0-af87-49d7-bd53-e3fcb80685ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:10.237992 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddf2b0-af87-49d7-bd53-e3fcb80685ff None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:10.238445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddf2b0-af87-49d7-bd53-e3fcb80685ff None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:10.238916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ddf2b0-af87-49d7-bd53-e3fcb80685ff None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:10.239891 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddf2b0-af87-49d7-bd53-e3fcb80685ff None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:10.240391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddf2b0-af87-49d7-bd53-e3fcb80685ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:10.242043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ddf2b0-af87-49d7-bd53-e3fcb80685ff None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:10.249175 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 428/866] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 13 06:25:10 2022] POST /identity/v3/services => generated 251 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:25:10.262753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 439/867] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Sep 13 06:25:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:10.269846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1335757-f5c8-477d-8c95-abe0f6ae372d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:10.390468 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1335757-f5c8-477d-8c95-abe0f6ae372d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:10.413602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:10.431734 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3cf59-aa48-4257-b785-36aac37d128b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:10.432817 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3cf59-aa48-4257-b785-36aac37d128b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:10.433303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3cf59-aa48-4257-b785-36aac37d128b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:10.433777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3cf59-aa48-4257-b785-36aac37d128b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:10.507898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3cf59-aa48-4257-b785-36aac37d128b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:10.509780 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f3cf59-aa48-4257-b785-36aac37d128b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:10.615220 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 429/868] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:25:10 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:25:10.621245 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddf2b0-af87-49d7-bd53-e3fcb80685ff None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:10.693767 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:10.726205 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ddf2b0-af87-49d7-bd53-e3fcb80685ff None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:10.761812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2811c-b85b-4247-b609-e25864f4b806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:10.762364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2811c-b85b-4247-b609-e25864f4b806 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:10.762672 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2811c-b85b-4247-b609-e25864f4b806 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:10.762947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2811c-b85b-4247-b609-e25864f4b806 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:10.774197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2811c-b85b-4247-b609-e25864f4b806 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:10.775762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2811c-b85b-4247-b609-e25864f4b806 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-42e2811c-b85b-4247-b609-e25864f4b806 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:10.792754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:10.793848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:10.795308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:10.795308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:10.795308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:10.795308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 440/869] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:10.800758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3cf59-aa48-4257-b785-36aac37d128b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:10.824234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:10.901378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55e79-0816-49b9-b513-5e77b8d4a51e None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:10.901651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55e79-0816-49b9-b513-5e77b8d4a51e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:10.902005 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a55e79-0816-49b9-b513-5e77b8d4a51e None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:10.904047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 441/870] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:10.909570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58290a51-c1a3-4118-aed5-e817d328d829 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:10.909908 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58290a51-c1a3-4118-aed5-e817d328d829 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:10.910187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58290a51-c1a3-4118-aed5-e817d328d829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:10.911108 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f3cf59-aa48-4257-b785-36aac37d128b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:10.937066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-58290a51-c1a3-4118-aed5-e817d328d829 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:10.938212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-58290a51-c1a3-4118-aed5-e817d328d829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:10.950652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288060c-33e9-42a7-bfec-f17358bdff1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:10.951266 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288060c-33e9-42a7-bfec-f17358bdff1a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:10.951548 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288060c-33e9-42a7-bfec-f17358bdff1a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:10.951826 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d288060c-33e9-42a7-bfec-f17358bdff1a None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:10.952659 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288060c-33e9-42a7-bfec-f17358bdff1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:10.952914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288060c-33e9-42a7-bfec-f17358bdff1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:10.954388 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d288060c-33e9-42a7-bfec-f17358bdff1a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:10.967911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 430/871] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:10.973586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288060c-33e9-42a7-bfec-f17358bdff1a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:11.016750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 442/872] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:10 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:11.075434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:11.095914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d288060c-33e9-42a7-bfec-f17358bdff1a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:11.130911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb6b78-4c8e-4c91-8068-94bd077135ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:11.131537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb6b78-4c8e-4c91-8068-94bd077135ba None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:11.131816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb6b78-4c8e-4c91-8068-94bd077135ba None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:11.132086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb6b78-4c8e-4c91-8068-94bd077135ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:11.139489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb6b78-4c8e-4c91-8068-94bd077135ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:11.141135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb6b78-4c8e-4c91-8068-94bd077135ba None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:11.155342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-b4eb6b78-4c8e-4c91-8068-94bd077135ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:11.155342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:11.155342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:11.155342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:11.155342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:11.155342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:11.155342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:11.155342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:11.155342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:11.155342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:11.155342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:11.155342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:11.155342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:25:11.155342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:25:11.155342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:11.156717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:11.157650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:25:11.157650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:25:11.157650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:25:11.157650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:25:11.157650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:25:11.157650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:25:11.157650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:11.157650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:11.160899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 431/873] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:11.162636 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58290a51-c1a3-4118-aed5-e817d328d829 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:11.220144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:11.268318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58290a51-c1a3-4118-aed5-e817d328d829 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:11.300714 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb6b78-4c8e-4c91-8068-94bd077135ba None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:11.304179 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff2c18-a297-4cda-bdbd-f634724c355b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:11.305659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff2c18-a297-4cda-bdbd-f634724c355b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:11.305942 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff2c18-a297-4cda-bdbd-f634724c355b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:11.306214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff2c18-a297-4cda-bdbd-f634724c355b None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:11.306911 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff2c18-a297-4cda-bdbd-f634724c355b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:11.307214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff2c18-a297-4cda-bdbd-f634724c355b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:11.308644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff2c18-a297-4cda-bdbd-f634724c355b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:11.331631 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 443/874] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:25:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:11.332636 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff2c18-a297-4cda-bdbd-f634724c355b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:11.429727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb6b78-4c8e-4c91-8068-94bd077135ba None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:11.470965 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b15a35-1e5d-4a00-9635-8bd723c5d465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:11.471597 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b15a35-1e5d-4a00-9635-8bd723c5d465 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:11.471876 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b15a35-1e5d-4a00-9635-8bd723c5d465 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:11.472149 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b15a35-1e5d-4a00-9635-8bd723c5d465 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:11.472756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b15a35-1e5d-4a00-9635-8bd723c5d465 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:11.474126 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b15a35-1e5d-4a00-9635-8bd723c5d465 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:11.476460 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff2c18-a297-4cda-bdbd-f634724c355b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-56b15a35-1e5d-4a00-9635-8bd723c5d465 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:11.483567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:11.485525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:11.486532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:11.486532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:11.486532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:11.486532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:11.486532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:11.486532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:11.486532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:11.486532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:11.486532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:11.486532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:11.486532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:11.486532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:11.486532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:25:11.486532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:11.486532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 432/875] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 13 06:25:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:11.490421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b15a35-1e5d-4a00-9635-8bd723c5d465 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:11.496350 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:11.499860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:11.533812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56ccb9-c98c-4aba-8a08-aac1d4365ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:11.535189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56ccb9-c98c-4aba-8a08-aac1d4365ee8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:11.535747 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56ccb9-c98c-4aba-8a08-aac1d4365ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:11.536174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56ccb9-c98c-4aba-8a08-aac1d4365ee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:11.537129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56ccb9-c98c-4aba-8a08-aac1d4365ee8 None admin] RBAC: Adding query filter params (role.id=dc60d33cb0c649b3b903d99258a19c98, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=3739971aa30548d6932d7af156e1fdaf) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:11.537599 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56ccb9-c98c-4aba-8a08-aac1d4365ee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:11.540251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56ccb9-c98c-4aba-8a08-aac1d4365ee8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:11.553140 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 444/876] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:25:11 2022] GET /identity/v3/role_assignments?user.id=3739971aa30548d6932d7af156e1fdaf&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=dc60d33cb0c649b3b903d99258a19c98 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:11.629469 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b15a35-1e5d-4a00-9635-8bd723c5d465 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:11.668743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a626846d-ad37-4068-9f63-2a0e0dc5cbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:11.669955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626846d-ad37-4068-9f63-2a0e0dc5cbd5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:11.670230 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626846d-ad37-4068-9f63-2a0e0dc5cbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:11.670498 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a626846d-ad37-4068-9f63-2a0e0dc5cbd5 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:11.671133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626846d-ad37-4068-9f63-2a0e0dc5cbd5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:11.671430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626846d-ad37-4068-9f63-2a0e0dc5cbd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:11.673007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a626846d-ad37-4068-9f63-2a0e0dc5cbd5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:11.678872 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 433/877] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 13 06:25:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:11.684715 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56ccb9-c98c-4aba-8a08-aac1d4365ee8 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:11.795321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56ccb9-c98c-4aba-8a08-aac1d4365ee8 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:11.832732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de0a27a-5633-40a8-acb9-b796e4855230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:11.833336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0a27a-5633-40a8-acb9-b796e4855230 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:11.833612 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0a27a-5633-40a8-acb9-b796e4855230 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:11.833883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de0a27a-5633-40a8-acb9-b796e4855230 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:11.834538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0a27a-5633-40a8-acb9-b796e4855230 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:11.834839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0a27a-5633-40a8-acb9-b796e4855230 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:11.836270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de0a27a-5633-40a8-acb9-b796e4855230 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:11.842733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 445/878] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 13 06:25:11 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:11.945485 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df766bf-9ba4-493e-ac8a-198ec9b03274 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:11.946136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df766bf-9ba4-493e-ac8a-198ec9b03274 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:11.946634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df766bf-9ba4-493e-ac8a-198ec9b03274 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:11.948482 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 434/879] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:11.953835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c5c66-03e8-4a80-9178-fdfeb2a23d55 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:11.954110 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c5c66-03e8-4a80-9178-fdfeb2a23d55 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:11.954379 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c5c66-03e8-4a80-9178-fdfeb2a23d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:11.973621 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d10c5c66-03e8-4a80-9178-fdfeb2a23d55 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:11.974841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d10c5c66-03e8-4a80-9178-fdfeb2a23d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:12.018663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:12.055948 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 446/880] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:11 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:25:12.320795 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df766bf-9ba4-493e-ac8a-198ec9b03274 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:12.392311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:12.428802 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df766bf-9ba4-493e-ac8a-198ec9b03274 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:12.462521 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf212e46-f6ac-4db7-b6dc-7bbc90b19842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:12.463116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf212e46-f6ac-4db7-b6dc-7bbc90b19842 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:12.463393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf212e46-f6ac-4db7-b6dc-7bbc90b19842 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:12.463661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf212e46-f6ac-4db7-b6dc-7bbc90b19842 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:12.464310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf212e46-f6ac-4db7-b6dc-7bbc90b19842 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:12.466201 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf212e46-f6ac-4db7-b6dc-7bbc90b19842 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:12.483025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 435/881] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 13 06:25:12 2022] POST /identity/v3/services => generated 269 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:25:12.680267 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce42be3-25ad-4f38-abb1-ea22979c5d88 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:12.680597 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce42be3-25ad-4f38-abb1-ea22979c5d88 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:12.680863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce42be3-25ad-4f38-abb1-ea22979c5d88 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:12.682477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 447/882] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:12.687811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb20441-35a2-420f-8bfe-c8a46848731d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:12.688102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb20441-35a2-420f-8bfe-c8a46848731d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:12.688381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb20441-35a2-420f-8bfe-c8a46848731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:12.707066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fbb20441-35a2-420f-8bfe-c8a46848731d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:12.708257 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fbb20441-35a2-420f-8bfe-c8a46848731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:12.784294 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 436/883] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:12 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:13.052919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce42be3-25ad-4f38-abb1-ea22979c5d88 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:13.169410 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce42be3-25ad-4f38-abb1-ea22979c5d88 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:13.205316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fb522-75fe-45af-ad1a-5e509e1687ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:13.205944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fb522-75fe-45af-ad1a-5e509e1687ae None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:13.206225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fb522-75fe-45af-ad1a-5e509e1687ae None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:13.206495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717fb522-75fe-45af-ad1a-5e509e1687ae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:13.207077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717fb522-75fe-45af-ad1a-5e509e1687ae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:13.208450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717fb522-75fe-45af-ad1a-5e509e1687ae None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-717fb522-75fe-45af-ad1a-5e509e1687ae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:13.218028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:13.219100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:13.220012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:13.220012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:13.220012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:13.220012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:13.220012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:13.220012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:13.220012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:13.220012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:13.220012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:13.220012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:13.220012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:13.220012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:13.220012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:25:13.220012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:13.220012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 448/884] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:25:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:13.225050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb20441-35a2-420f-8bfe-c8a46848731d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:13.280174 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:13.327977 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb20441-35a2-420f-8bfe-c8a46848731d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:13.363135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f07c0c-902a-47e7-80a6-1f984ea6ce95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:13.363740 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f07c0c-902a-47e7-80a6-1f984ea6ce95 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:13.364018 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f07c0c-902a-47e7-80a6-1f984ea6ce95 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:13.364292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f07c0c-902a-47e7-80a6-1f984ea6ce95 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:13.364946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f07c0c-902a-47e7-80a6-1f984ea6ce95 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:13.365248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f07c0c-902a-47e7-80a6-1f984ea6ce95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:13.366710 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f07c0c-902a-47e7-80a6-1f984ea6ce95 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:13.371990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 437/885] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:25:13 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:13.377642 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fb522-75fe-45af-ad1a-5e509e1687ae None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:13.417032 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:13.486380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717fb522-75fe-45af-ad1a-5e509e1687ae None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:13.522319 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a7a7-2fc7-49f5-990e-9553f1cbb55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:13.522929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a7a7-2fc7-49f5-990e-9553f1cbb55b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:13.523209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a7a7-2fc7-49f5-990e-9553f1cbb55b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:13.523483 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84a7a7-2fc7-49f5-990e-9553f1cbb55b None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:13.524162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84a7a7-2fc7-49f5-990e-9553f1cbb55b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:13.524471 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84a7a7-2fc7-49f5-990e-9553f1cbb55b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:13.525898 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84a7a7-2fc7-49f5-990e-9553f1cbb55b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:13.531219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 449/886] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:25:13 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:13.537069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f07c0c-902a-47e7-80a6-1f984ea6ce95 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:13.648410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f07c0c-902a-47e7-80a6-1f984ea6ce95 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:13.666648 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:13.685859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e70de96-1fc7-4354-bf64-1ec1c674e08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:13.686470 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70de96-1fc7-4354-bf64-1ec1c674e08c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:13.686752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70de96-1fc7-4354-bf64-1ec1c674e08c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:13.687026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e70de96-1fc7-4354-bf64-1ec1c674e08c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:13.687733 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70de96-1fc7-4354-bf64-1ec1c674e08c None admin] RBAC: Adding query filter params (interface=public, service_id=53d00fece7914e468c303c6cadade51e, region_id=RegionOne) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:13.688043 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70de96-1fc7-4354-bf64-1ec1c674e08c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:13.689430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e70de96-1fc7-4354-bf64-1ec1c674e08c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:13.695045 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 438/887] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 13 06:25:13 2022] GET /identity/v3/endpoints?service_id=53d00fece7914e468c303c6cadade51e&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:13.700424 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a7a7-2fc7-49f5-990e-9553f1cbb55b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:13.814407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:13.817646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84a7a7-2fc7-49f5-990e-9553f1cbb55b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:13.862362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926928ac-0d0b-4a81-9815-571544b5ca12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:13.862987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926928ac-0d0b-4a81-9815-571544b5ca12 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:13.863268 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926928ac-0d0b-4a81-9815-571544b5ca12 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:13.863540 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926928ac-0d0b-4a81-9815-571544b5ca12 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:13.864156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926928ac-0d0b-4a81-9815-571544b5ca12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:13.865645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926928ac-0d0b-4a81-9815-571544b5ca12 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:13.873059 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 450/888] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 13 06:25:13 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:25:13.956462 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f7f02-c450-4cb3-8b9c-376e98819386 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:13.956846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f7f02-c450-4cb3-8b9c-376e98819386 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:13.957074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f7f02-c450-4cb3-8b9c-376e98819386 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:13.958703 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 439/889] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:13.964473 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170d574-df74-4841-9297-1aa9bba40194 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:13.964795 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170d574-df74-4841-9297-1aa9bba40194 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:13.965074 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b170d574-df74-4841-9297-1aa9bba40194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:13.985424 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b170d574-df74-4841-9297-1aa9bba40194 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:13.986660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b170d574-df74-4841-9297-1aa9bba40194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:14.070733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 451/890] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:13 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:14.146743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd025e6-f178-4bc0-b103-7151e2e8e443 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:14.147091 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd025e6-f178-4bc0-b103-7151e2e8e443 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:14.147300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd025e6-f178-4bc0-b103-7151e2e8e443 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:14.148946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 440/891] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:14.154306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f92acf-b46e-4fda-9668-f85e46539f98 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:14.154592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f92acf-b46e-4fda-9668-f85e46539f98 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:14.154863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f92acf-b46e-4fda-9668-f85e46539f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:14.173957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-19f92acf-b46e-4fda-9668-f85e46539f98 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:14.175137 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-19f92acf-b46e-4fda-9668-f85e46539f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:14.250569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 452/892] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:14 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:14.344446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd025e6-f178-4bc0-b103-7151e2e8e443 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:14.449804 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd025e6-f178-4bc0-b103-7151e2e8e443 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:14.484386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc430a-38e2-4999-82d5-0a445e87a42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:14.485043 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc430a-38e2-4999-82d5-0a445e87a42e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:14.485318 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc430a-38e2-4999-82d5-0a445e87a42e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:14.485586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc430a-38e2-4999-82d5-0a445e87a42e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:14.496071 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fc430a-38e2-4999-82d5-0a445e87a42e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-27fc430a-38e2-4999-82d5-0a445e87a42e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:25:14.501445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:14.503517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:14.505540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:14.505540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:14.505540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:14.505540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:14.505540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:25:14.505540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:25:14.505540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:25:14.505540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:25:14.505540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:25:14.505540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:25:14.505540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:25:14.505540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:14.505540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 441/893] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Sep 13 06:25:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:14.512696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f92acf-b46e-4fda-9668-f85e46539f98 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:14.519952 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc430a-38e2-4999-82d5-0a445e87a42e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:14.539812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:14.574361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:14.647037 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f92acf-b46e-4fda-9668-f85e46539f98 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:14.647930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fc430a-38e2-4999-82d5-0a445e87a42e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:14.684329 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcc1ca-7649-42c1-8d82-70c8d78d6d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:14.686052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcc1ca-7649-42c1-8d82-70c8d78d6d5c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:14.686605 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcc1ca-7649-42c1-8d82-70c8d78d6d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:14.687092 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bcc1ca-7649-42c1-8d82-70c8d78d6d5c None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:14.688070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcc1ca-7649-42c1-8d82-70c8d78d6d5c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:14.688592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcc1ca-7649-42c1-8d82-70c8d78d6d5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:14.690421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bcc1ca-7649-42c1-8d82-70c8d78d6d5c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:14.691236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e559d11d-1922-4286-9f38-19fa994f810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:14.692327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559d11d-1922-4286-9f38-19fa994f810f None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:14.692779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559d11d-1922-4286-9f38-19fa994f810f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:14.693630 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e559d11d-1922-4286-9f38-19fa994f810f None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:14.694450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559d11d-1922-4286-9f38-19fa994f810f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:14.695949 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e559d11d-1922-4286-9f38-19fa994f810f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:14.704922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 453/894] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Sep 13 06:25:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:14.706779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcc1ca-7649-42c1-8d82-70c8d78d6d5c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:14.728765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 442/895] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 13 06:25:14 2022] POST /identity/v3/services => generated 241 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:25:14.736227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d30e3-a300-42e3-9012-4cf49acf202e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:14.739430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d30e3-a300-42e3-9012-4cf49acf202e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:14.739830 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d30e3-a300-42e3-9012-4cf49acf202e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:14.741606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 443/896] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:25:14.748919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f76b32-5f6d-4fb3-961d-84882aa99d40 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:14.749337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f76b32-5f6d-4fb3-961d-84882aa99d40 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:14.749677 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f76b32-5f6d-4fb3-961d-84882aa99d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:14.775463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-31f76b32-5f6d-4fb3-961d-84882aa99d40 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:14.777260 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-31f76b32-5f6d-4fb3-961d-84882aa99d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:14.831635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:14.858480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bcc1ca-7649-42c1-8d82-70c8d78d6d5c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:14.869584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 444/897] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:14.897828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39518dce-54c1-407c-b582-2772c9ebd2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:14.898474 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39518dce-54c1-407c-b582-2772c9ebd2f1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:14.898750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39518dce-54c1-407c-b582-2772c9ebd2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:14.899021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39518dce-54c1-407c-b582-2772c9ebd2f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:14.911235 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39518dce-54c1-407c-b582-2772c9ebd2f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:14.912712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39518dce-54c1-407c-b582-2772c9ebd2f1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-39518dce-54c1-407c-b582-2772c9ebd2f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:14.928364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:14.929433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:14.930368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:14.930368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:14.930368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:14.930368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 454/898] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:14.936048 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f76b32-5f6d-4fb3-961d-84882aa99d40 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:14.964770 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:15.041103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f76b32-5f6d-4fb3-961d-84882aa99d40 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:15.075639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcb06c-c754-4891-bfa4-d98eacc4b9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:15.076250 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcb06c-c754-4891-bfa4-d98eacc4b9ea None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:15.076529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcb06c-c754-4891-bfa4-d98eacc4b9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:15.076829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dcb06c-c754-4891-bfa4-d98eacc4b9ea None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:15.077472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcb06c-c754-4891-bfa4-d98eacc4b9ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:15.077774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcb06c-c754-4891-bfa4-d98eacc4b9ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:15.079122 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dcb06c-c754-4891-bfa4-d98eacc4b9ea None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:15.092465 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 445/899] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:15.098287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39518dce-54c1-407c-b582-2772c9ebd2f1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:15.147692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcb06c-c754-4891-bfa4-d98eacc4b9ea None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:15.215927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39518dce-54c1-407c-b582-2772c9ebd2f1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:15.252056 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fe8c1-36a1-4a7e-b485-2c600d592fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:15.252936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:15.253189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fe8c1-36a1-4a7e-b485-2c600d592fb4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:15.253915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fe8c1-36a1-4a7e-b485-2c600d592fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:15.254193 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79fe8c1-36a1-4a7e-b485-2c600d592fb4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:15.263418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fe8c1-36a1-4a7e-b485-2c600d592fb4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:15.264912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79fe8c1-36a1-4a7e-b485-2c600d592fb4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:15.267139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:15.270660 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dcb06c-c754-4891-bfa4-d98eacc4b9ea None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-e79fe8c1-36a1-4a7e-b485-2c600d592fb4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:25:15.278771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:15.279745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:15.280810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:15.280810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:15.280810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:25:15.280810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:25:15.280810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:25:15.280810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:25:15.280810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:25:15.280810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:25:15.280810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:25:15.280810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:15.285541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 455/900] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 13 06:25:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:15.289049 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fe8c1-36a1-4a7e-b485-2c600d592fb4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:15.331914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695dd46-1c5d-43dd-a7c1-62691a36c0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:15.333461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695dd46-1c5d-43dd-a7c1-62691a36c0b9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:15.333959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695dd46-1c5d-43dd-a7c1-62691a36c0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:15.334865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f695dd46-1c5d-43dd-a7c1-62691a36c0b9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:15.335658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695dd46-1c5d-43dd-a7c1-62691a36c0b9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:15.337907 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f695dd46-1c5d-43dd-a7c1-62691a36c0b9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f695dd46-1c5d-43dd-a7c1-62691a36c0b9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:15.351265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:15.352661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:15.353587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:15.353587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:15.353587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:15.353587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:15.353587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:15.353587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:15.353587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:15.353587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:15.353587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:15.353587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:15.353587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:15.353587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:15.353587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:25:15.353587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:15.356458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 446/901] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Sep 13 06:25:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:15.362671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695dd46-1c5d-43dd-a7c1-62691a36c0b9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:15.406526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79fe8c1-36a1-4a7e-b485-2c600d592fb4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:15.445488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717ee2b-361f-44a5-ade7-095ca94dfe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:15.446116 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717ee2b-361f-44a5-ade7-095ca94dfe03 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:15.446433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717ee2b-361f-44a5-ade7-095ca94dfe03 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:15.446673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717ee2b-361f-44a5-ade7-095ca94dfe03 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:15.447420 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717ee2b-361f-44a5-ade7-095ca94dfe03 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:15.447730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717ee2b-361f-44a5-ade7-095ca94dfe03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:15.449290 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717ee2b-361f-44a5-ade7-095ca94dfe03 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:15.473268 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 456/902] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Sep 13 06:25:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:15.474568 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717ee2b-361f-44a5-ade7-095ca94dfe03 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:15.503426 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f695dd46-1c5d-43dd-a7c1-62691a36c0b9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:15.536271 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:15.552610 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e894d7f-a864-4f88-be19-4d78de2f9bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:15.554447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e894d7f-a864-4f88-be19-4d78de2f9bf4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:15.554961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e894d7f-a864-4f88-be19-4d78de2f9bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:15.555441 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e894d7f-a864-4f88-be19-4d78de2f9bf4 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:15.556363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e894d7f-a864-4f88-be19-4d78de2f9bf4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:15.556914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e894d7f-a864-4f88-be19-4d78de2f9bf4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:15.558984 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e894d7f-a864-4f88-be19-4d78de2f9bf4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:15.566332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 447/903] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 13 06:25:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:15.571585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e894d7f-a864-4f88-be19-4d78de2f9bf4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:15.593425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717ee2b-361f-44a5-ade7-095ca94dfe03 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:15.594259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:15.636958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6a7d0-da04-457b-9bb7-284ddeb52c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:15.638490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6a7d0-da04-457b-9bb7-284ddeb52c96 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:15.638988 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6a7d0-da04-457b-9bb7-284ddeb52c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:15.639488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6a7d0-da04-457b-9bb7-284ddeb52c96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:15.708352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e894d7f-a864-4f88-be19-4d78de2f9bf4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:15.719066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6a7d0-da04-457b-9bb7-284ddeb52c96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:15.720557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6a7d0-da04-457b-9bb7-284ddeb52c96 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:15.756747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687ff84-e83a-4342-8158-0c71a2c4fd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:15.758600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687ff84-e83a-4342-8158-0c71a2c4fd80 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:15.759094 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687ff84-e83a-4342-8158-0c71a2c4fd80 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:15.759594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8687ff84-e83a-4342-8158-0c71a2c4fd80 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:15.760415 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687ff84-e83a-4342-8158-0c71a2c4fd80 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:15.760935 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687ff84-e83a-4342-8158-0c71a2c4fd80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:15.763534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8687ff84-e83a-4342-8158-0c71a2c4fd80 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:15.774748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 448/904] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 13 06:25:15 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:15.775922 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687ff84-e83a-4342-8158-0c71a2c4fd80 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:15.787685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:15.843200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 457/905] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:25:15 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:25:15.850050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6a7d0-da04-457b-9bb7-284ddeb52c96 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:15.883267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:15.910001 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8687ff84-e83a-4342-8158-0c71a2c4fd80 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:15.947763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952857a5-3b5b-41e5-9972-047da7619b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:15.948721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952857a5-3b5b-41e5-9972-047da7619b5e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:15.949396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952857a5-3b5b-41e5-9972-047da7619b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:15.950845 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952857a5-3b5b-41e5-9972-047da7619b5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:15.952015 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952857a5-3b5b-41e5-9972-047da7619b5e None admin] RBAC: Adding query filter params (interface=public, service_id=f901991fd50943ac8c351f3ec85ee853, region_id=RegionOne) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:15.952532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952857a5-3b5b-41e5-9972-047da7619b5e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:15.954290 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952857a5-3b5b-41e5-9972-047da7619b5e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:15.960505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 449/906] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 13 06:25:15 2022] GET /identity/v3/endpoints?service_id=f901991fd50943ac8c351f3ec85ee853&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:15.965721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952857a5-3b5b-41e5-9972-047da7619b5e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:15.972888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6a7d0-da04-457b-9bb7-284ddeb52c96 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:16.009827 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf0a1e-b610-40d1-bf42-bc1a772a1fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:16.010776 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf0a1e-b610-40d1-bf42-bc1a772a1fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:16.011305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf0a1e-b610-40d1-bf42-bc1a772a1fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:16.011802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf0a1e-b610-40d1-bf42-bc1a772a1fa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:16.025842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf0a1e-b610-40d1-bf42-bc1a772a1fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:16.027731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cf0a1e-b610-40d1-bf42-bc1a772a1fa7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-91cf0a1e-b610-40d1-bf42-bc1a772a1fa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:16.044858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:16.045916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:16.046835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:16.046835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:16.046835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:16.049151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 458/907] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:16.054598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf0a1e-b610-40d1-bf42-bc1a772a1fa7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:16.067034 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:16.096371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952857a5-3b5b-41e5-9972-047da7619b5e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:16.137434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30df2a-568e-43e1-ae91-dc604698fd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:16.138554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30df2a-568e-43e1-ae91-dc604698fd99 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:16.138831 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30df2a-568e-43e1-ae91-dc604698fd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:16.139099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30df2a-568e-43e1-ae91-dc604698fd99 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:16.140116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30df2a-568e-43e1-ae91-dc604698fd99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:16.141074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30df2a-568e-43e1-ae91-dc604698fd99 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:16.148710 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 450/908] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 13 06:25:15 2022] GET /identity/v3/services => generated 1497 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:25:16.153858 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b8e9f-f131-4e43-8bfa-ff1533906318 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:16.154461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b8e9f-f131-4e43-8bfa-ff1533906318 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:16.154931 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53b8e9f-f131-4e43-8bfa-ff1533906318 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:16.156866 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 451/909] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:25:16.163100 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8be7ec-9acf-44e6-afc5-19aa8447f520 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:16.164157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8be7ec-9acf-44e6-afc5-19aa8447f520 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:16.165029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8be7ec-9acf-44e6-afc5-19aa8447f520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:16.173774 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf0a1e-b610-40d1-bf42-bc1a772a1fa7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:16.187218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4b8be7ec-9acf-44e6-afc5-19aa8447f520 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:16.189063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4b8be7ec-9acf-44e6-afc5-19aa8447f520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:16.192316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:16.213340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb683818-7cf4-42e4-8d51-3ccaf0ad0227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:16.213964 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb683818-7cf4-42e4-8d51-3ccaf0ad0227 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:16.214245 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb683818-7cf4-42e4-8d51-3ccaf0ad0227 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:16.214519 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb683818-7cf4-42e4-8d51-3ccaf0ad0227 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:16.215470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb683818-7cf4-42e4-8d51-3ccaf0ad0227 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:16.215814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb683818-7cf4-42e4-8d51-3ccaf0ad0227 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:16.217698 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb683818-7cf4-42e4-8d51-3ccaf0ad0227 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:16.239653 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 459/910] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:16.241748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb683818-7cf4-42e4-8d51-3ccaf0ad0227 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:16.284707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 452/911] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:25:16.319768 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:16.355450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb683818-7cf4-42e4-8d51-3ccaf0ad0227 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:16.393590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb584df-e9c3-4dd8-ba70-d7a7c0d2256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:16.394193 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb584df-e9c3-4dd8-ba70-d7a7c0d2256c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:16.394477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb584df-e9c3-4dd8-ba70-d7a7c0d2256c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:16.394751 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb584df-e9c3-4dd8-ba70-d7a7c0d2256c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:16.402067 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb584df-e9c3-4dd8-ba70-d7a7c0d2256c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:16.403559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb584df-e9c3-4dd8-ba70-d7a7c0d2256c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:16.415189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-dcb584df-e9c3-4dd8-ba70-d7a7c0d2256c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:16.415189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:16.415189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:16.415189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:16.415189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:16.415189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:16.415189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:16.415189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:16.415189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:16.415189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:16.415189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:16.415189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:16.415189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:25:16.415189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:25:16.415189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:16.416188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:16.417117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:25:16.417117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:25:16.417117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:25:16.417117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:25:16.417117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:25:16.417117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:25:16.417117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:16.417117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:16.417117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 460/912] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:16.423369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8be7ec-9acf-44e6-afc5-19aa8447f520 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:16.529828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8be7ec-9acf-44e6-afc5-19aa8447f520 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:16.565649 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb584df-e9c3-4dd8-ba70-d7a7c0d2256c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:16.566023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d412b8-630a-41de-9def-8e557bafdb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:16.566640 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d412b8-630a-41de-9def-8e557bafdb05 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:16.566925 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d412b8-630a-41de-9def-8e557bafdb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:16.567200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d412b8-630a-41de-9def-8e557bafdb05 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:16.567964 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d412b8-630a-41de-9def-8e557bafdb05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:16.568270 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d412b8-630a-41de-9def-8e557bafdb05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:16.569792 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d412b8-630a-41de-9def-8e557bafdb05 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:16.577326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:16.588888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 453/913] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:25:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:16.590630 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d412b8-630a-41de-9def-8e557bafdb05 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:16.687048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb584df-e9c3-4dd8-ba70-d7a7c0d2256c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:16.706443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d412b8-630a-41de-9def-8e557bafdb05 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:16.715699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:16.725870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3491e-0f60-43bd-ad17-e4ff5f270fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:16.726592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3491e-0f60-43bd-ad17-e4ff5f270fe1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:16.727054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3491e-0f60-43bd-ad17-e4ff5f270fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:16.727441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb3491e-0f60-43bd-ad17-e4ff5f270fe1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:16.728192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3491e-0f60-43bd-ad17-e4ff5f270fe1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:16.729676 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb3491e-0f60-43bd-ad17-e4ff5f270fe1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-ccb3491e-0f60-43bd-ad17-e4ff5f270fe1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:16.739525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:16.740845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:16.742734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:16.742734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:16.742734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:16.742734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:16.742734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:16.742734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:16.742734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:16.742734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:16.742734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:16.742734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:16.742734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:16.742734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:16.742734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 06:25:16.742734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:16.742734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 461/914] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:25:16 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:16.749167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3491e-0f60-43bd-ad17-e4ff5f270fe1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:16.751782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818fc66-5c8d-4b52-a200-1b0c152901f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:16.752399 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818fc66-5c8d-4b52-a200-1b0c152901f8 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:16.752860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818fc66-5c8d-4b52-a200-1b0c152901f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:16.753332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f818fc66-5c8d-4b52-a200-1b0c152901f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:16.755685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818fc66-5c8d-4b52-a200-1b0c152901f8 None admin] RBAC: Adding query filter params (role.id=fd480c5e32754513a580f7d7c11deaab, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=3739971aa30548d6932d7af156e1fdaf) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:16.756247 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818fc66-5c8d-4b52-a200-1b0c152901f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:16.762243 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f818fc66-5c8d-4b52-a200-1b0c152901f8 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:16.769195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 454/915] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:25:16 2022] GET /identity/v3/role_assignments?user.id=3739971aa30548d6932d7af156e1fdaf&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=fd480c5e32754513a580f7d7c11deaab => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:16.870055 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb3491e-0f60-43bd-ad17-e4ff5f270fe1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:16.911524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28565b-ceac-4c05-a71d-544f6be500f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:16.912411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28565b-ceac-4c05-a71d-544f6be500f5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:16.912893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28565b-ceac-4c05-a71d-544f6be500f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:16.913306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28565b-ceac-4c05-a71d-544f6be500f5 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:16.914086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28565b-ceac-4c05-a71d-544f6be500f5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:16.914553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28565b-ceac-4c05-a71d-544f6be500f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:16.916099 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28565b-ceac-4c05-a71d-544f6be500f5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:16.922467 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 462/916] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:25:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:16.929850 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818fc66-5c8d-4b52-a200-1b0c152901f8 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:17.000147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:17.040634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f818fc66-5c8d-4b52-a200-1b0c152901f8 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:17.067817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8beb4-7a71-4f02-9198-4fccd5c553a5 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:17.068302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8beb4-7a71-4f02-9198-4fccd5c553a5 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:17.068578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d8beb4-7a71-4f02-9198-4fccd5c553a5 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:17.070401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 463/917] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:25:17.076148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95129545-b068-49f2-ba78-eda9535b3f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:17.076787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95129545-b068-49f2-ba78-eda9535b3f24 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:17.076991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac59581-392b-426f-8d9f-85d539c5eefb None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:17.077098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95129545-b068-49f2-ba78-eda9535b3f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:17.077319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95129545-b068-49f2-ba78-eda9535b3f24 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:17.077546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac59581-392b-426f-8d9f-85d539c5eefb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:17.077819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac59581-392b-426f-8d9f-85d539c5eefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:17.077928 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95129545-b068-49f2-ba78-eda9535b3f24 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:17.078235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95129545-b068-49f2-ba78-eda9535b3f24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:17.079585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95129545-b068-49f2-ba78-eda9535b3f24 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:17.086987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 455/918] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 13 06:25:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:17.094592 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95129545-b068-49f2-ba78-eda9535b3f24 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:17.098185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-dac59581-392b-426f-8d9f-85d539c5eefb None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:17.099404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-dac59581-392b-426f-8d9f-85d539c5eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:17.154321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:17.180843 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 464/919] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:17 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:17.212392 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95129545-b068-49f2-ba78-eda9535b3f24 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:17.238150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:17.247421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db1dcb-c8d2-4b37-b6d4-4d0b29e21b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:17.248150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db1dcb-c8d2-4b37-b6d4-4d0b29e21b8f None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:17.248861 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db1dcb-c8d2-4b37-b6d4-4d0b29e21b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:17.249471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db1dcb-c8d2-4b37-b6d4-4d0b29e21b8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:17.250141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db1dcb-c8d2-4b37-b6d4-4d0b29e21b8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:17.251960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db1dcb-c8d2-4b37-b6d4-4d0b29e21b8f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:17.284912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 456/920] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:25:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:25:17.440371 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac59581-392b-426f-8d9f-85d539c5eefb None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:17.546033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac59581-392b-426f-8d9f-85d539c5eefb None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:17.585637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8c8c-2654-4d18-b52d-23acc1ffb128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:17.586264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8c8c-2654-4d18-b52d-23acc1ffb128 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:17.586537 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8c8c-2654-4d18-b52d-23acc1ffb128 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:17.586805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be8c8c-2654-4d18-b52d-23acc1ffb128 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:17.587377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be8c8c-2654-4d18-b52d-23acc1ffb128 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:17.588762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04be8c8c-2654-4d18-b52d-23acc1ffb128 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-04be8c8c-2654-4d18-b52d-23acc1ffb128 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:17.598109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:17.599136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:17.600008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:17.600008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:17.600008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:17.600008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:17.600008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:17.600008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:17.600008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:17.600008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:17.600008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:17.600008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:17.600008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:17.600008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:17.600008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:25:17.600008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:17.600008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 465/921] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 13 06:25:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:17.605348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db1dcb-c8d2-4b37-b6d4-4d0b29e21b8f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:17.728415 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db1dcb-c8d2-4b37-b6d4-4d0b29e21b8f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:17.764467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e2c98-5b8d-4dc2-867c-7a12cccd5477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:17.765111 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e2c98-5b8d-4dc2-867c-7a12cccd5477 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:17.765392 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e2c98-5b8d-4dc2-867c-7a12cccd5477 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:17.765665 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e2c98-5b8d-4dc2-867c-7a12cccd5477 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:17.766295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e2c98-5b8d-4dc2-867c-7a12cccd5477 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:17.766599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e2c98-5b8d-4dc2-867c-7a12cccd5477 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:17.767945 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041e2c98-5b8d-4dc2-867c-7a12cccd5477 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:17.773106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 457/922] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 13 06:25:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:17.778424 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8c8c-2654-4d18-b52d-23acc1ffb128 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:17.835054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:17.895282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be8c8c-2654-4d18-b52d-23acc1ffb128 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:17.930723 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce997b-25ee-40f4-98ad-29114dd203d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:17.931333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce997b-25ee-40f4-98ad-29114dd203d2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:17.931607 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce997b-25ee-40f4-98ad-29114dd203d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:17.931875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce997b-25ee-40f4-98ad-29114dd203d2 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:17.932501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce997b-25ee-40f4-98ad-29114dd203d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:17.932826 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce997b-25ee-40f4-98ad-29114dd203d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:17.934173 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ce997b-25ee-40f4-98ad-29114dd203d2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:17.940380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 466/923] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 13 06:25:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:17.946069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e2c98-5b8d-4dc2-867c-7a12cccd5477 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:17.994980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:18.060540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e2c98-5b8d-4dc2-867c-7a12cccd5477 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:18.099240 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f29ac-4d83-4c83-91f1-ffc5b85d956a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:18.100319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f29ac-4d83-4c83-91f1-ffc5b85d956a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:18.100861 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f29ac-4d83-4c83-91f1-ffc5b85d956a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:18.101348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f29ac-4d83-4c83-91f1-ffc5b85d956a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:18.102259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f29ac-4d83-4c83-91f1-ffc5b85d956a None admin] RBAC: Adding query filter params (interface=public, service_id=a2b6923ca0a14b31a507254ca34dcf6b, region_id=RegionOne) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:18.102777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f29ac-4d83-4c83-91f1-ffc5b85d956a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:18.104363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f29ac-4d83-4c83-91f1-ffc5b85d956a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:18.110886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 458/924] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 13 06:25:17 2022] GET /identity/v3/endpoints?service_id=a2b6923ca0a14b31a507254ca34dcf6b&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:18.116813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce997b-25ee-40f4-98ad-29114dd203d2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:18.222835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ce997b-25ee-40f4-98ad-29114dd203d2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:18.234554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:18.265635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e20d11-9295-4041-b31c-c668b2b2bae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:18.266166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e20d11-9295-4041-b31c-c668b2b2bae3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:18.266446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e20d11-9295-4041-b31c-c668b2b2bae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:18.266720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e20d11-9295-4041-b31c-c668b2b2bae3 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:18.267330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e20d11-9295-4041-b31c-c668b2b2bae3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:18.268696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e20d11-9295-4041-b31c-c668b2b2bae3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:18.275302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 467/925] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 13 06:25:18 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:25:18.423772 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cdaac-7275-4b60-ba4c-3c5ba4a796b6 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:18.424277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cdaac-7275-4b60-ba4c-3c5ba4a796b6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:18.424560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cdaac-7275-4b60-ba4c-3c5ba4a796b6 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:18.426173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 459/926] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:18.431984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe656604-eb2d-43d1-b8ea-4b2e8e950597 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:18.432279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe656604-eb2d-43d1-b8ea-4b2e8e950597 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:18.432543 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe656604-eb2d-43d1-b8ea-4b2e8e950597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:18.455083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-fe656604-eb2d-43d1-b8ea-4b2e8e950597 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:18.456288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fe656604-eb2d-43d1-b8ea-4b2e8e950597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:18.529912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 468/927] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:18 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:18.797431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cdaac-7275-4b60-ba4c-3c5ba4a796b6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:18.904619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cdaac-7275-4b60-ba4c-3c5ba4a796b6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:18.917551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:18.944245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd1ee1-b5da-4093-af22-634887113458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:18.945347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd1ee1-b5da-4093-af22-634887113458 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:18.945840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd1ee1-b5da-4093-af22-634887113458 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:18.946305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd1ee1-b5da-4093-af22-634887113458 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:18.947107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd1ee1-b5da-4093-af22-634887113458 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:18.948644 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dd1ee1-b5da-4093-af22-634887113458 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-47dd1ee1-b5da-4093-af22-634887113458 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:18.957896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:18.958843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:18.959736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:18.959736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:18.959736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:18.959736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:18.959736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:18.959736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:18.959736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:18.959736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:18.959736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:18.959736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:18.959736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:18.959736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:18.959736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 06:25:18.959736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:18.962404 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 460/928] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Sep 13 06:25:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:18.969429 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe656604-eb2d-43d1-b8ea-4b2e8e950597 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:19.026992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e62618-e6f7-4207-8c6f-fa765b67a0fd None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:19.027320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e62618-e6f7-4207-8c6f-fa765b67a0fd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:19.027543 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e62618-e6f7-4207-8c6f-fa765b67a0fd None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:19.029666 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 461/929] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:25:19.034732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27261d-430d-41cd-b74a-ddd56e9ab36b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:19.035013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27261d-430d-41cd-b74a-ddd56e9ab36b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:19.035284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27261d-430d-41cd-b74a-ddd56e9ab36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:19.054279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4f27261d-430d-41cd-b74a-ddd56e9ab36b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:19.055391 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4f27261d-430d-41cd-b74a-ddd56e9ab36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:19.088235 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe656604-eb2d-43d1-b8ea-4b2e8e950597 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:19.091625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:19.136467 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f64aee-4ddc-499e-a02b-3e2944105751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:19.137099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 462/930] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:19.140686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f64aee-4ddc-499e-a02b-3e2944105751 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:19.140686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f64aee-4ddc-499e-a02b-3e2944105751 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:19.140686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f64aee-4ddc-499e-a02b-3e2944105751 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:19.140686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f64aee-4ddc-499e-a02b-3e2944105751 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:19.140686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f64aee-4ddc-499e-a02b-3e2944105751 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:19.140686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f64aee-4ddc-499e-a02b-3e2944105751 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:19.146106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 469/931] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 13 06:25:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:19.151367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27261d-430d-41cd-b74a-ddd56e9ab36b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:19.264442 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27261d-430d-41cd-b74a-ddd56e9ab36b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:19.266855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:19.301411 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31494b07-b53c-4075-bae4-bc380046453c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:19.302026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31494b07-b53c-4075-bae4-bc380046453c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:19.302308 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31494b07-b53c-4075-bae4-bc380046453c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:19.302581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31494b07-b53c-4075-bae4-bc380046453c None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:19.303211 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31494b07-b53c-4075-bae4-bc380046453c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:19.303514 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31494b07-b53c-4075-bae4-bc380046453c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:19.304959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31494b07-b53c-4075-bae4-bc380046453c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:19.310737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 463/932] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 13 06:25:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:19.316295 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f64aee-4ddc-499e-a02b-3e2944105751 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:19.405664 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31494b07-b53c-4075-bae4-bc380046453c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:19.436158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f64aee-4ddc-499e-a02b-3e2944105751 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:19.485643 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462adbac-2716-48f9-ba2b-b61a93183f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:19.487733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462adbac-2716-48f9-ba2b-b61a93183f7b None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:19.488237 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462adbac-2716-48f9-ba2b-b61a93183f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:19.488734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462adbac-2716-48f9-ba2b-b61a93183f7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:19.489614 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462adbac-2716-48f9-ba2b-b61a93183f7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:19.491186 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462adbac-2716-48f9-ba2b-b61a93183f7b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:19.521097 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 470/933] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:25:19 2022] POST /identity/v3/endpoints => generated 347 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:25:19.522317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31494b07-b53c-4075-bae4-bc380046453c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:19.576734 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05044c3f-ca3e-486e-adf5-885e12dbdaaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:19.577292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05044c3f-ca3e-486e-adf5-885e12dbdaaf None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:19.577573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05044c3f-ca3e-486e-adf5-885e12dbdaaf None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:19.577847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05044c3f-ca3e-486e-adf5-885e12dbdaaf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:19.590546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05044c3f-ca3e-486e-adf5-885e12dbdaaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-05044c3f-ca3e-486e-adf5-885e12dbdaaf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:25:19.596082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:19.597107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:19.597940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:19.597940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:19.597940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:19.597940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:19.597940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:25:19.597940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:25:19.597940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:25:19.597940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:25:19.597940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:25:19.597940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:25:19.597940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:25:19.597940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:19.597940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 464/934] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Sep 13 06:25:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:19.605409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462adbac-2716-48f9-ba2b-b61a93183f7b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:19.649455 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:19.657330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02ac29-f6ae-402d-aaad-79da3060f0bd None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:19.657970 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02ac29-f6ae-402d-aaad-79da3060f0bd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:19.658459 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c02ac29-f6ae-402d-aaad-79da3060f0bd None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:19.660469 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 465/935] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:25:19.668331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9662b-2383-4836-bfef-1351561f3a42 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:19.668646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9662b-2383-4836-bfef-1351561f3a42 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:19.668948 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f9662b-2383-4836-bfef-1351561f3a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:19.689232 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f1f9662b-2383-4836-bfef-1351561f3a42 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:19.690734 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f1f9662b-2383-4836-bfef-1351561f3a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:19.715352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:19.750059 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462adbac-2716-48f9-ba2b-b61a93183f7b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:19.791503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 466/936] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:19 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:19.798321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe296a-6670-4f27-8e8c-13f8c22fdad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:19.799015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe296a-6670-4f27-8e8c-13f8c22fdad2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:19.799626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe296a-6670-4f27-8e8c-13f8c22fdad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:19.799626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fe296a-6670-4f27-8e8c-13f8c22fdad2 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:19.800121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe296a-6670-4f27-8e8c-13f8c22fdad2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:19.800425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe296a-6670-4f27-8e8c-13f8c22fdad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:19.802170 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fe296a-6670-4f27-8e8c-13f8c22fdad2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:19.811162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 471/937] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Sep 13 06:25:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:19.816891 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9662b-2383-4836-bfef-1351561f3a42 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:19.919908 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f9662b-2383-4836-bfef-1351561f3a42 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:19.956332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ac170-3729-4b95-bd4e-9b23e87be55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:19.957339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac170-3729-4b95-bd4e-9b23e87be55c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:19.957859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac170-3729-4b95-bd4e-9b23e87be55c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:19.958353 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361ac170-3729-4b95-bd4e-9b23e87be55c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:19.969174 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ac170-3729-4b95-bd4e-9b23e87be55c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:19.970897 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361ac170-3729-4b95-bd4e-9b23e87be55c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-361ac170-3729-4b95-bd4e-9b23e87be55c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:19.986154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:19.987137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:19.988050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:19.988050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:19.988050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:19.990121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 467/938] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:19.996310 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe296a-6670-4f27-8e8c-13f8c22fdad2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:20.090135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:20.108089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fe296a-6670-4f27-8e8c-13f8c22fdad2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:20.115756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ac170-3729-4b95-bd4e-9b23e87be55c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:20.129088 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:20.157772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8f713-761a-48d8-9528-2aea990a0352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:20.158676 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8f713-761a-48d8-9528-2aea990a0352 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:20.159401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8f713-761a-48d8-9528-2aea990a0352 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:20.159873 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8f713-761a-48d8-9528-2aea990a0352 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:20.161423 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8f713-761a-48d8-9528-2aea990a0352 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:20.161730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8f713-761a-48d8-9528-2aea990a0352 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:20.163087 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8f713-761a-48d8-9528-2aea990a0352 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:20.184239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 472/939] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:20.190334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8f713-761a-48d8-9528-2aea990a0352 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:20.241190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361ac170-3729-4b95-bd4e-9b23e87be55c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:20.283157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f79089-4b8b-4a1f-a02e-4ac13c3d14f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:20.283772 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f79089-4b8b-4a1f-a02e-4ac13c3d14f3 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:20.284054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f79089-4b8b-4a1f-a02e-4ac13c3d14f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:20.284324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f79089-4b8b-4a1f-a02e-4ac13c3d14f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:20.285025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f79089-4b8b-4a1f-a02e-4ac13c3d14f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:20.286457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f79089-4b8b-4a1f-a02e-4ac13c3d14f3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:20.289845 dv-cinder-856385-1-smb devstack@keystone.service[81460]: WARNING keystone.server.flask.common [None req-f0f79089-4b8b-4a1f-a02e-4ac13c3d14f3 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 06:25:20.312081 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.sql.core [None req-f0f79089-4b8b-4a1f-a02e-4ac13c3d14f3 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 06:25:20.312081 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 06:25:20.312081 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [parameters: {'id': '8555faf10c8a45ab96cd19dd8174d149', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 06:25:20.312081 dv-cinder-856385-1-smb devstack@keystone.service[81460]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81460) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 06:25:20.320484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8f713-761a-48d8-9528-2aea990a0352 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:20.334190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f0f79089-4b8b-4a1f-a02e-4ac13c3d14f3 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8555faf10c8a45ab96cd19dd8174d149.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8555faf10c8a45ab96cd19dd8174d149. Sep 13 06:25:20.334190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:20.334190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 06:25:20.334190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 06:25:20.334190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 06:25:20.334190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 06:25:20.334190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 06:25:20.334190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 06:25:20.334190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 06:25:20.334190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application conn.query(q) Sep 13 06:25:20.334190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 06:25:20.334190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 06:25:20.334190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result.read() Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 13 06:25:20.335096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application next(self.gen) Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application yield resource Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application next(self.gen) Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise self.value Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application session.commit() Sep 13 06:25:20.336064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.session.flush() Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application compat.raise_( Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 06:25:20.336987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 06:25:20.337885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 06:25:20.337885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 06:25:20.337885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 06:25:20.337885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 06:25:20.337885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 06:25:20.337885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 06:25:20.337885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 06:25:20.337885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 06:25:20.337885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 06:25:20.337885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 06:25:20.337885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 06:25:20.337885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 06:25:20.337885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 06:25:20.337885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 06:25:20.337885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application conn.query(q) Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application result.read() Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 06:25:20.340022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 06:25:20.342360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 06:25:20.342360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 06:25:20.342360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 06:25:20.342360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 06:25:20.342360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 06:25:20.342360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 06:25:20.342360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 06:25:20.342360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 06:25:20.342360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [parameters: {'id': '8555faf10c8a45ab96cd19dd8174d149', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 06:25:20.342360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 06:25:20.342360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:20.342360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:20.342360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:20.342360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:20.342360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:20.344068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:20.346026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:20.346026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 13 06:25:20.346026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 13 06:25:20.346026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:20.346026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:20.346026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 13 06:25:20.346026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 13 06:25:20.346026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8555faf10c8a45ab96cd19dd8174d149. Sep 13 06:25:20.346026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:20.346026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 468/940] 10.222.0.42 () {60 vars in 1140 bytes} [Tue Sep 13 06:25:20 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:20.346026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f79089-4b8b-4a1f-a02e-4ac13c3d14f3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:20.378670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f55c0f-1c47-43f6-b599-6cf631ecc1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:20.379978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f55c0f-1c47-43f6-b599-6cf631ecc1eb None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:20.380409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f55c0f-1c47-43f6-b599-6cf631ecc1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:20.381107 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f55c0f-1c47-43f6-b599-6cf631ecc1eb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:20.390893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f55c0f-1c47-43f6-b599-6cf631ecc1eb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:20.392518 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f55c0f-1c47-43f6-b599-6cf631ecc1eb None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-b9f55c0f-1c47-43f6-b599-6cf631ecc1eb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:25:20.408476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:20.409578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:20.410557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:20.410557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:20.410557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:25:20.410557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:25:20.410557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:25:20.410557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:25:20.410557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:25:20.410557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:25:20.410557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:25:20.410557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:20.419269 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 473/941] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 13 06:25:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:20.420750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:20.421162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f55c0f-1c47-43f6-b599-6cf631ecc1eb None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:20.434081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:20.477377 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f79089-4b8b-4a1f-a02e-4ac13c3d14f3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:20.519202 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c5f52-b62d-4e6f-97d4-6c500bef23e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:20.520208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c5f52-b62d-4e6f-97d4-6c500bef23e4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:20.520936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c5f52-b62d-4e6f-97d4-6c500bef23e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:20.521730 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c5f52-b62d-4e6f-97d4-6c500bef23e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:20.529998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c5f52-b62d-4e6f-97d4-6c500bef23e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:20.532945 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c5f52-b62d-4e6f-97d4-6c500bef23e4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:20.547106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-893c5f52-b62d-4e6f-97d4-6c500bef23e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:20.547106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:20.547106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:20.547106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:20.547106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:20.547106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:20.547106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:20.547106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:20.547106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:20.547106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:20.547106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:20.547106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:20.547106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:25:20.547106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:25:20.547106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:20.548057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:20.549029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:25:20.549029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:25:20.549029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:25:20.549029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:25:20.549029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:25:20.549029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:25:20.549029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:20.549029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:20.555650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 469/942] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:20.556271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c5f52-b62d-4e6f-97d4-6c500bef23e4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:20.573926 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f55c0f-1c47-43f6-b599-6cf631ecc1eb None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:20.608817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c1e327-d2fb-45bb-8e62-149545c1f99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:20.609422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1e327-d2fb-45bb-8e62-149545c1f99e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:20.609697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1e327-d2fb-45bb-8e62-149545c1f99e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:20.609967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c1e327-d2fb-45bb-8e62-149545c1f99e None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:20.610682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1e327-d2fb-45bb-8e62-149545c1f99e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:20.610983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1e327-d2fb-45bb-8e62-149545c1f99e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:20.612395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c1e327-d2fb-45bb-8e62-149545c1f99e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:20.634999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 474/943] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Sep 13 06:25:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:20.634999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1680d7-198d-43e9-807f-5b34c8e41a1a None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:20.634999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1680d7-198d-43e9-807f-5b34c8e41a1a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:20.634999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1680d7-198d-43e9-807f-5b34c8e41a1a None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:20.634999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 475/944] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:20.636466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1680d7-198d-43e9-807f-5b34c8e41a1a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:20.679716 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c5f52-b62d-4e6f-97d4-6c500bef23e4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:20.702431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:20.714627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:20.716037 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdebf10e-99cf-4a45-bd09-4ae17b883f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:20.716804 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebf10e-99cf-4a45-bd09-4ae17b883f20 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:20.717375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebf10e-99cf-4a45-bd09-4ae17b883f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:20.717661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdebf10e-99cf-4a45-bd09-4ae17b883f20 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:20.718331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebf10e-99cf-4a45-bd09-4ae17b883f20 None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:20.718638 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebf10e-99cf-4a45-bd09-4ae17b883f20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:20.720057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdebf10e-99cf-4a45-bd09-4ae17b883f20 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:20.742805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 470/945] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 13 06:25:20 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:20.744574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30ae4d-18b8-41b3-8186-d6d610f25398 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:20.745126 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30ae4d-18b8-41b3-8186-d6d610f25398 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:20.745892 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30ae4d-18b8-41b3-8186-d6d610f25398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:20.768754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ec30ae4d-18b8-41b3-8186-d6d610f25398 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:20.770384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ec30ae4d-18b8-41b3-8186-d6d610f25398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:20.771216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1680d7-198d-43e9-807f-5b34c8e41a1a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:20.813103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594bee6-eabf-4534-bb54-43fdc741bf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:20.814158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594bee6-eabf-4534-bb54-43fdc741bf72 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:20.814785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594bee6-eabf-4534-bb54-43fdc741bf72 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:20.815162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594bee6-eabf-4534-bb54-43fdc741bf72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:20.827676 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594bee6-eabf-4534-bb54-43fdc741bf72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:20.829481 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594bee6-eabf-4534-bb54-43fdc741bf72 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:20.846900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 471/946] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-0594bee6-eabf-4534-bb54-43fdc741bf72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:20.850938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:20.852050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:20.853047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:20.853047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:20.853047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:20.853047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 476/947] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:20.860930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594bee6-eabf-4534-bb54-43fdc741bf72 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:20.983034 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594bee6-eabf-4534-bb54-43fdc741bf72 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:21.000979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:21.020314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab24913-3246-4768-a632-f6e0c26f8aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:21.020950 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab24913-3246-4768-a632-f6e0c26f8aef None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:21.021222 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab24913-3246-4768-a632-f6e0c26f8aef None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:21.021536 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab24913-3246-4768-a632-f6e0c26f8aef None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:21.022234 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab24913-3246-4768-a632-f6e0c26f8aef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:21.022538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab24913-3246-4768-a632-f6e0c26f8aef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:21.023887 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab24913-3246-4768-a632-f6e0c26f8aef None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:21.036554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 477/948] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:21.042703 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30ae4d-18b8-41b3-8186-d6d610f25398 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:21.134838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab24913-3246-4768-a632-f6e0c26f8aef None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:21.158127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30ae4d-18b8-41b3-8186-d6d610f25398 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:21.175562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:21.206424 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465e349-ae3f-4d39-8643-b03d636d3082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:21.207062 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465e349-ae3f-4d39-8643-b03d636d3082 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:21.207339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465e349-ae3f-4d39-8643-b03d636d3082 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:21.207611 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0465e349-ae3f-4d39-8643-b03d636d3082 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:21.216056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465e349-ae3f-4d39-8643-b03d636d3082 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:21.217516 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0465e349-ae3f-4d39-8643-b03d636d3082 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:21.233518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-0465e349-ae3f-4d39-8643-b03d636d3082 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:21.233518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:21.233518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:21.233518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:21.233518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:21.233518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:21.233518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:21.233518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:21.233518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:21.233518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:21.233518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:21.233518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:21.233518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:25:21.233518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:25:21.233518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:21.234669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:21.235589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:25:21.235589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:25:21.235589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:25:21.235589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:25:21.235589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:25:21.235589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:25:21.235589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:21.235589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:21.235589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 472/949] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:21.245957 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465e349-ae3f-4d39-8643-b03d636d3082 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:21.254737 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab24913-3246-4768-a632-f6e0c26f8aef None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:21.292841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43590c31-e0fa-4269-a261-0ed64e542938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:21.293480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43590c31-e0fa-4269-a261-0ed64e542938 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:21.294324 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43590c31-e0fa-4269-a261-0ed64e542938 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:21.294608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43590c31-e0fa-4269-a261-0ed64e542938 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:21.295192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43590c31-e0fa-4269-a261-0ed64e542938 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:21.296699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43590c31-e0fa-4269-a261-0ed64e542938 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-43590c31-e0fa-4269-a261-0ed64e542938 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:21.306264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:21.307484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:21.308634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:21.308634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:21.308634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:21.308634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:21.308634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:21.308634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:21.308634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:21.308634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:21.308634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:21.308634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:21.308634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:21.308634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:21.308634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:25:21.308634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:21.312457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 478/950] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 13 06:25:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:21.313934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43590c31-e0fa-4269-a261-0ed64e542938 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:21.361088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:21.370101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0465e349-ae3f-4d39-8643-b03d636d3082 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:21.416636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb6bc1-9878-403d-9599-b9dcc8df0e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:21.417756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb6bc1-9878-403d-9599-b9dcc8df0e9f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:21.418092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb6bc1-9878-403d-9599-b9dcc8df0e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:21.418372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb6bc1-9878-403d-9599-b9dcc8df0e9f None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:21.419640 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb6bc1-9878-403d-9599-b9dcc8df0e9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:21.419975 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb6bc1-9878-403d-9599-b9dcc8df0e9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:21.421686 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb6bc1-9878-403d-9599-b9dcc8df0e9f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:21.428376 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43590c31-e0fa-4269-a261-0ed64e542938 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:21.436825 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 473/951] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:25:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:21.441920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb6bc1-9878-403d-9599-b9dcc8df0e9f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:21.479190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fd014-b1a0-426d-863b-c976a6aff61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:21.479793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fd014-b1a0-426d-863b-c976a6aff61f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:21.480067 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fd014-b1a0-426d-863b-c976a6aff61f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:21.480332 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427fd014-b1a0-426d-863b-c976a6aff61f None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:21.480987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fd014-b1a0-426d-863b-c976a6aff61f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:21.481851 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fd014-b1a0-426d-863b-c976a6aff61f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:21.482636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:21.484794 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427fd014-b1a0-426d-863b-c976a6aff61f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:21.491838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 479/952] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 13 06:25:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:21.500697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fd014-b1a0-426d-863b-c976a6aff61f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:21.575723 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb6bc1-9878-403d-9599-b9dcc8df0e9f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:21.607227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427fd014-b1a0-426d-863b-c976a6aff61f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:21.611868 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:21.632638 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86030082-1cb1-4cb1-bf6a-bb3db97871f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:21.633355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030082-1cb1-4cb1-bf6a-bb3db97871f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:21.633640 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030082-1cb1-4cb1-bf6a-bb3db97871f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:21.633909 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86030082-1cb1-4cb1-bf6a-bb3db97871f4 None admin] PATH_INFO: `/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/3739971aa30548d6932d7af156e1fdaf/roles/fd480c5e32754513a580f7d7c11deaab` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:21.636263 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86030082-1cb1-4cb1-bf6a-bb3db97871f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c3f0aa3b746108e73737491b003e7, user_id=3739971aa30548d6932d7af156e1fdaf, role_id=fd480c5e32754513a580f7d7c11deaab)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:21.638310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86030082-1cb1-4cb1-bf6a-bb3db97871f4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:21.664374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 474/953] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:25:21 2022] PUT /identity/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/3739971aa30548d6932d7af156e1fdaf/roles/fd480c5e32754513a580f7d7c11deaab => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:25:21.665639 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd885a6-7089-4884-9af0-cf3e7c7e602f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:21.666291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd885a6-7089-4884-9af0-cf3e7c7e602f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:21.666574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd885a6-7089-4884-9af0-cf3e7c7e602f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:21.666853 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd885a6-7089-4884-9af0-cf3e7c7e602f None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:21.667508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd885a6-7089-4884-9af0-cf3e7c7e602f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:21.667815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd885a6-7089-4884-9af0-cf3e7c7e602f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:21.670208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd885a6-7089-4884-9af0-cf3e7c7e602f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:21.681452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 480/954] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 13 06:25:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:21.682950 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86030082-1cb1-4cb1-bf6a-bb3db97871f4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:21.794864 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:21.805856 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86030082-1cb1-4cb1-bf6a-bb3db97871f4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:21.816954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff29279-6e48-40fd-b313-dc4fde065fe8 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:21.817284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff29279-6e48-40fd-b313-dc4fde065fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:21.817510 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff29279-6e48-40fd-b313-dc4fde065fe8 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:21.819960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 481/955] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:21.833780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b31b89-563e-41f5-a1f0-9ac93753f61c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:21.833965 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b31b89-563e-41f5-a1f0-9ac93753f61c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:21.834244 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b31b89-563e-41f5-a1f0-9ac93753f61c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:21.853634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ee703-832e-4e12-985d-36ea82466df3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:21.854304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee703-832e-4e12-985d-36ea82466df3 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:21.854524 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee703-832e-4e12-985d-36ea82466df3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:21.854805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ee703-832e-4e12-985d-36ea82466df3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:21.855488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ee703-832e-4e12-985d-36ea82466df3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:21.856913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ee703-832e-4e12-985d-36ea82466df3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:21.860347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a0b31b89-563e-41f5-a1f0-9ac93753f61c None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:21.861594 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a0b31b89-563e-41f5-a1f0-9ac93753f61c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:21.885342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 475/956] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:25:21 2022] POST /identity/v3/endpoints => generated 349 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:25:21.964356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 482/957] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:22.235207 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ee703-832e-4e12-985d-36ea82466df3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:22.343354 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ee703-832e-4e12-985d-36ea82466df3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:22.387396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5599e9-5e93-4d99-bc32-4ac908e39095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:22.388941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5599e9-5e93-4d99-bc32-4ac908e39095 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:22.389477 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5599e9-5e93-4d99-bc32-4ac908e39095 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:22.389948 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5599e9-5e93-4d99-bc32-4ac908e39095 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:22.390739 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5599e9-5e93-4d99-bc32-4ac908e39095 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:22.392395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5599e9-5e93-4d99-bc32-4ac908e39095 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ab5599e9-5e93-4d99-bc32-4ac908e39095 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:22.401773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:22.402846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:22.403777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:22.403777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:22.403777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:22.403777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:22.403777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:22.403777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:22.403777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:22.403777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:22.403777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:22.403777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:22.403777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:22.403777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:22.403777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:25:22.403777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:22.406164 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 476/958] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:22.414132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b31b89-563e-41f5-a1f0-9ac93753f61c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:22.512119 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:22.520225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b31b89-563e-41f5-a1f0-9ac93753f61c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:22.555848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd37f3-cc56-46d0-a18a-46242e26ea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:22.556451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd37f3-cc56-46d0-a18a-46242e26ea50 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:22.556777 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd37f3-cc56-46d0-a18a-46242e26ea50 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:22.557026 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd37f3-cc56-46d0-a18a-46242e26ea50 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:22.557649 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd37f3-cc56-46d0-a18a-46242e26ea50 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:22.557950 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd37f3-cc56-46d0-a18a-46242e26ea50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:22.559358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcd37f3-cc56-46d0-a18a-46242e26ea50 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:22.568776 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 483/959] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 13 06:25:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:22.570889 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5599e9-5e93-4d99-bc32-4ac908e39095 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:22.588539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:22.678840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5599e9-5e93-4d99-bc32-4ac908e39095 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:22.713540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d11412-5d7b-47d8-b010-5e1ed06c8472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:22.714147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d11412-5d7b-47d8-b010-5e1ed06c8472 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:22.714477 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d11412-5d7b-47d8-b010-5e1ed06c8472 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:22.714755 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d11412-5d7b-47d8-b010-5e1ed06c8472 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:22.715378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d11412-5d7b-47d8-b010-5e1ed06c8472 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:22.715707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d11412-5d7b-47d8-b010-5e1ed06c8472 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:22.717160 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d11412-5d7b-47d8-b010-5e1ed06c8472 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:22.726114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 477/960] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 13 06:25:22 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:23.137496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f9cd2-e4c9-4995-a89c-4ce57dbe4f93 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:23.137855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f9cd2-e4c9-4995-a89c-4ce57dbe4f93 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:23.138049 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f9cd2-e4c9-4995-a89c-4ce57dbe4f93 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:23.139625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 484/961] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:23.144815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94803b64-dde1-4b5d-b7e6-b3cd96fcee23 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:23.145265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94803b64-dde1-4b5d-b7e6-b3cd96fcee23 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:23.145352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94803b64-dde1-4b5d-b7e6-b3cd96fcee23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:23.164193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-94803b64-dde1-4b5d-b7e6-b3cd96fcee23 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:23.165413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-94803b64-dde1-4b5d-b7e6-b3cd96fcee23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:23.237466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 478/962] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:23.512873 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f9cd2-e4c9-4995-a89c-4ce57dbe4f93 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:23.621007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f9cd2-e4c9-4995-a89c-4ce57dbe4f93 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:23.659044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1a2171-95ac-4795-a05d-5a80fb60a831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:23.659672 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a2171-95ac-4795-a05d-5a80fb60a831 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:23.659943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a2171-95ac-4795-a05d-5a80fb60a831 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:23.660212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1a2171-95ac-4795-a05d-5a80fb60a831 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:23.660902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a2171-95ac-4795-a05d-5a80fb60a831 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:23.662371 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1a2171-95ac-4795-a05d-5a80fb60a831 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:23.665000 dv-cinder-856385-1-smb devstack@keystone.service[81461]: WARNING keystone.server.flask.common [None req-ad1a2171-95ac-4795-a05d-5a80fb60a831 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 06:25:23.679278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.sql.core [None req-ad1a2171-95ac-4795-a05d-5a80fb60a831 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 06:25:23.679278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 06:25:23.679278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [parameters: {'user_id': '88c230d50207428499aa39b090ae63b6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 06:25:23.679278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81461) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 06:25:23.686947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-ad1a2171-95ac-4795-a05d-5a80fb60a831 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 06:25:23.686947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:23.686947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 06:25:23.686947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 06:25:23.686947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 06:25:23.686947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 06:25:23.686947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 06:25:23.686947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 06:25:23.686947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 06:25:23.686947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application conn.query(q) Sep 13 06:25:23.686947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 06:25:23.686947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 06:25:23.686947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 06:25:23.686947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application result.read() Sep 13 06:25:23.686947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 06:25:23.687889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application next(self.gen) Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application yield resource Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application next(self.gen) Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise self.value Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application session.commit() Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 06:25:23.688938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self.session.flush() Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application compat.raise_( Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 06:25:23.689861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 06:25:23.690798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application conn.query(q) Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application result.read() Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 06:25:23.691677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 06:25:23.692554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 06:25:23.692554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 06:25:23.692554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 06:25:23.692554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 06:25:23.692554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 06:25:23.692554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 06:25:23.692554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [parameters: {'user_id': '88c230d50207428499aa39b090ae63b6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 06:25:23.692554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 06:25:23.692554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:23.692554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:23.692554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:23.692554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:23.692554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:23.692554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:23.692554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 13 06:25:23.694656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 13 06:25:23.695823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 13 06:25:23.695823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 13 06:25:23.695823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 06:25:23.695823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 06:25:23.695823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 06:25:23.695823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:23.695823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 485/963] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Sep 13 06:25:23 2022] POST /identity/v3/users => generated 160 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:23.700543 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94803b64-dde1-4b5d-b7e6-b3cd96fcee23 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:23.709173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:23.815043 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94803b64-dde1-4b5d-b7e6-b3cd96fcee23 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:23.850683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e943612-f2d0-4449-b65c-7ba2e0f2668d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:23.851669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e943612-f2d0-4449-b65c-7ba2e0f2668d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:23.852166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e943612-f2d0-4449-b65c-7ba2e0f2668d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:23.852899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e943612-f2d0-4449-b65c-7ba2e0f2668d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:23.860736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e943612-f2d0-4449-b65c-7ba2e0f2668d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:23.862525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e943612-f2d0-4449-b65c-7ba2e0f2668d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2e943612-f2d0-4449-b65c-7ba2e0f2668d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:25:23.875316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:23.876383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:23.877381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:23.877381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:23.877381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:25:23.877381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:25:23.877381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:25:23.877381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:25:23.877381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:25:23.877381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:25:23.877381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 06:25:23.877381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:23.878520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b74c2-1b04-42eb-9b40-f90a66e0f971 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:23.878808 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b74c2-1b04-42eb-9b40-f90a66e0f971 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:23.879085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b74c2-1b04-42eb-9b40-f90a66e0f971 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:23.880453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 479/964] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:25:23 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:23.886118 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e943612-f2d0-4449-b65c-7ba2e0f2668d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:23.887372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 486/965] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:23.889094 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060bcc2-52f7-43e1-a3d3-4c062dec72d9 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:23.889380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060bcc2-52f7-43e1-a3d3-4c062dec72d9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:23.889657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060bcc2-52f7-43e1-a3d3-4c062dec72d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:23.908555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e060bcc2-52f7-43e1-a3d3-4c062dec72d9 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:23.910106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e060bcc2-52f7-43e1-a3d3-4c062dec72d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:23.926935 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:23.961044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:23.996732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 487/966] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:24.005902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e943612-f2d0-4449-b65c-7ba2e0f2668d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:24.045947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ff09a-2f18-42d2-9d6e-fd3c3cb2e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:24.046880 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff09a-2f18-42d2-9d6e-fd3c3cb2e124 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:24.047327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff09a-2f18-42d2-9d6e-fd3c3cb2e124 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:24.047750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ff09a-2f18-42d2-9d6e-fd3c3cb2e124 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:24.048590 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff09a-2f18-42d2-9d6e-fd3c3cb2e124 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:24.049078 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff09a-2f18-42d2-9d6e-fd3c3cb2e124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:24.050683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ff09a-2f18-42d2-9d6e-fd3c3cb2e124 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:24.093426 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 480/967] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 13 06:25:23 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:24.138060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8145d-189f-445c-87c6-3c3a69956d47 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:24.138585 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8145d-189f-445c-87c6-3c3a69956d47 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:24.139115 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8145d-189f-445c-87c6-3c3a69956d47 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:24.141021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 488/968] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:24.147415 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439ce12-8ee7-455e-96f7-bb5b158214dd None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:24.147936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439ce12-8ee7-455e-96f7-bb5b158214dd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:24.148014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a439ce12-8ee7-455e-96f7-bb5b158214dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:24.169298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a439ce12-8ee7-455e-96f7-bb5b158214dd None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:24.170533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a439ce12-8ee7-455e-96f7-bb5b158214dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:24.245814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 481/969] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:24.289420 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8145d-189f-445c-87c6-3c3a69956d47 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:24.398898 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8145d-189f-445c-87c6-3c3a69956d47 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:24.433964 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1100b8-7e43-4a52-9efa-c2086e43fa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:24.434877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1100b8-7e43-4a52-9efa-c2086e43fa94 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:24.435301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1100b8-7e43-4a52-9efa-c2086e43fa94 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:24.435727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1100b8-7e43-4a52-9efa-c2086e43fa94 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:24.446332 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1100b8-7e43-4a52-9efa-c2086e43fa94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-aa1100b8-7e43-4a52-9efa-c2086e43fa94 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:25:24.451281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:24.452405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:24.453492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:24.453492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:24.453492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:24.453492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:24.453492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:25:24.453492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:25:24.453492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:25:24.453492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:25:24.453492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:25:24.453492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:25:24.453492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:25:24.453492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:24.455586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 489/970] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Sep 13 06:25:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:24.461652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439ce12-8ee7-455e-96f7-bb5b158214dd None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:24.518116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:24.535626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1100b8-7e43-4a52-9efa-c2086e43fa94 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:24.548517 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:24.567445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a439ce12-8ee7-455e-96f7-bb5b158214dd None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:24.604764 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d13c69-770c-4040-b54f-88cc91edccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:24.605402 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d13c69-770c-4040-b54f-88cc91edccd2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:24.605660 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d13c69-770c-4040-b54f-88cc91edccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:24.605932 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d13c69-770c-4040-b54f-88cc91edccd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:24.607155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d13c69-770c-4040-b54f-88cc91edccd2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:24.607460 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d13c69-770c-4040-b54f-88cc91edccd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:24.608848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d13c69-770c-4040-b54f-88cc91edccd2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:24.617575 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 482/971] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Sep 13 06:25:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:24.623137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d13c69-770c-4040-b54f-88cc91edccd2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:24.650129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1100b8-7e43-4a52-9efa-c2086e43fa94 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:24.686976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d40ecc-3e80-4155-80e2-ed6de0eb91a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:24.687722 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d40ecc-3e80-4155-80e2-ed6de0eb91a9 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:24.688112 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d40ecc-3e80-4155-80e2-ed6de0eb91a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:24.688377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d40ecc-3e80-4155-80e2-ed6de0eb91a9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:24.688995 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d40ecc-3e80-4155-80e2-ed6de0eb91a9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:24.690572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d40ecc-3e80-4155-80e2-ed6de0eb91a9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-67d40ecc-3e80-4155-80e2-ed6de0eb91a9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:24.699800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:24.701383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:24.702246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:24.702246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:24.702246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:24.702246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:24.702246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:24.702246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:24.702246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:24.702246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:24.702246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:24.702246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:24.702246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:24.702246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:24.702246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:25:24.702246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:24.706355 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 490/972] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 13 06:25:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:24.707219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d40ecc-3e80-4155-80e2-ed6de0eb91a9 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:24.729979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d13c69-770c-4040-b54f-88cc91edccd2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:24.746290 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:24.767375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1e037-87f0-45d2-ab7d-18066ed7032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:24.767994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1e037-87f0-45d2-ab7d-18066ed7032b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:24.768277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1e037-87f0-45d2-ab7d-18066ed7032b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:24.768546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1e037-87f0-45d2-ab7d-18066ed7032b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:24.779836 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1e037-87f0-45d2-ab7d-18066ed7032b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:24.781287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1e037-87f0-45d2-ab7d-18066ed7032b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:24.784839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-98b1e037-87f0-45d2-ab7d-18066ed7032b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:24.796586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:24.797701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:24.798610 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:24.798610 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:24.798610 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:24.798610 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 483/973] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:24.803291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1e037-87f0-45d2-ab7d-18066ed7032b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:24.814307 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d40ecc-3e80-4155-80e2-ed6de0eb91a9 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:24.854907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ec496-b635-4b15-ac58-e86da926c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:24.856109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ec496-b635-4b15-ac58-e86da926c348 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:24.856601 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ec496-b635-4b15-ac58-e86da926c348 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:24.857098 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ec496-b635-4b15-ac58-e86da926c348 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:24.857784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ec496-b635-4b15-ac58-e86da926c348 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:24.858090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ec496-b635-4b15-ac58-e86da926c348 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:24.859544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ec496-b635-4b15-ac58-e86da926c348 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:24.867785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 491/974] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 13 06:25:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:24.872035 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ec496-b635-4b15-ac58-e86da926c348 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:24.916613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1e037-87f0-45d2-ab7d-18066ed7032b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:24.954469 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c2721-a21a-4d74-925b-982ab070c5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:24.955493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c2721-a21a-4d74-925b-982ab070c5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:24.955874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c2721-a21a-4d74-925b-982ab070c5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:24.956530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15c2721-a21a-4d74-925b-982ab070c5e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:24.957356 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c2721-a21a-4d74-925b-982ab070c5e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:24.957651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c2721-a21a-4d74-925b-982ab070c5e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:24.959071 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15c2721-a21a-4d74-925b-982ab070c5e6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:24.971583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 484/975] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:24.977038 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c2721-a21a-4d74-925b-982ab070c5e6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:24.985149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ec496-b635-4b15-ac58-e86da926c348 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:25.004606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:25.020081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef466bd8-dd01-4adb-9d2d-100bb3d92bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:25.020690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef466bd8-dd01-4adb-9d2d-100bb3d92bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:25.020981 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef466bd8-dd01-4adb-9d2d-100bb3d92bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:25.021246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef466bd8-dd01-4adb-9d2d-100bb3d92bc5 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:25.021861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef466bd8-dd01-4adb-9d2d-100bb3d92bc5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:25.022160 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef466bd8-dd01-4adb-9d2d-100bb3d92bc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:25.023496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef466bd8-dd01-4adb-9d2d-100bb3d92bc5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:25.028185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 492/976] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 13 06:25:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:25.029351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4083895-695a-43d6-b0b3-03fb7d2d3d03 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:25.029626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4083895-695a-43d6-b0b3-03fb7d2d3d03 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:25.029894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4083895-695a-43d6-b0b3-03fb7d2d3d03 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:25.031216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 493/977] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:25.034298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4083895-695a-43d6-b0b3-03fb7d2d3d03 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:25.037087 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:25.076112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15c2721-a21a-4d74-925b-982ab070c5e6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:25.108589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757d7254-1c1c-40ac-9b47-3bb4838be266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:25.109239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d7254-1c1c-40ac-9b47-3bb4838be266 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:25.109520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d7254-1c1c-40ac-9b47-3bb4838be266 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:25.109794 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757d7254-1c1c-40ac-9b47-3bb4838be266 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:25.116720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d7254-1c1c-40ac-9b47-3bb4838be266 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:25.118173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757d7254-1c1c-40ac-9b47-3bb4838be266 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-757d7254-1c1c-40ac-9b47-3bb4838be266 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:25:25.130192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:25.131322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:25.132446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:25.132446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:25.132446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:25:25.132446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:25:25.132446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:25:25.132446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:25:25.132446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:25:25.132446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:25:25.132446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 06:25:25.132446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:25.132446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 485/978] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 13 06:25:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:25.133114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af222b-25ea-4ea1-ab22-e833cd896082 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:25.133114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af222b-25ea-4ea1-ab22-e833cd896082 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:25.133114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36af222b-25ea-4ea1-ab22-e833cd896082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:25.141701 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4083895-695a-43d6-b0b3-03fb7d2d3d03 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:25.151166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-36af222b-25ea-4ea1-ab22-e833cd896082 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:25.152338 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-36af222b-25ea-4ea1-ab22-e833cd896082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:25.175272 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bd4df-81db-4b14-8015-513225c038b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:25.176286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bd4df-81db-4b14-8015-513225c038b8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:25.176598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bd4df-81db-4b14-8015-513225c038b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:25.176896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4bd4df-81db-4b14-8015-513225c038b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:25.177600 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bd4df-81db-4b14-8015-513225c038b8 None admin] RBAC: Adding query filter params (interface=admin, service_id=a2b6923ca0a14b31a507254ca34dcf6b, region_id=RegionOne) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:25.177903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bd4df-81db-4b14-8015-513225c038b8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:25.179295 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4bd4df-81db-4b14-8015-513225c038b8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:25.186359 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 494/979] 10.222.0.42 () {56 vars in 1249 bytes} [Tue Sep 13 06:25:25 2022] GET /identity/v3/endpoints?service_id=a2b6923ca0a14b31a507254ca34dcf6b&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:25.186359 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bd4df-81db-4b14-8015-513225c038b8 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:25.224413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 486/980] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:25.225307 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af222b-25ea-4ea1-ab22-e833cd896082 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:25.255998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:25.260619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:25.294608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4bd4df-81db-4b14-8015-513225c038b8 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:25.329472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8e116-79cd-4ee2-bb05-6ff84fdc0cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:25.343199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8e116-79cd-4ee2-bb05-6ff84fdc0cdf None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:25.343199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8e116-79cd-4ee2-bb05-6ff84fdc0cdf None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:25.343199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a8e116-79cd-4ee2-bb05-6ff84fdc0cdf None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:25.343199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8e116-79cd-4ee2-bb05-6ff84fdc0cdf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:25.343199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8e116-79cd-4ee2-bb05-6ff84fdc0cdf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:25.343199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a8e116-79cd-4ee2-bb05-6ff84fdc0cdf None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:25.354451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36af222b-25ea-4ea1-ab22-e833cd896082 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:25.362951 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 495/981] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Sep 13 06:25:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:25.363961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8e116-79cd-4ee2-bb05-6ff84fdc0cdf None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:25.394094 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278abd5-1352-4910-86d7-b192e7ace5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:25.394700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278abd5-1352-4910-86d7-b192e7ace5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:25.394978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278abd5-1352-4910-86d7-b192e7ace5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:25.395246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5278abd5-1352-4910-86d7-b192e7ace5a9 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:25.395852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278abd5-1352-4910-86d7-b192e7ace5a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:25.397232 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5278abd5-1352-4910-86d7-b192e7ace5a9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:25.403364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 487/982] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 13 06:25:25 2022] GET /identity/v3/services => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:25:25.478788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a8e116-79cd-4ee2-bb05-6ff84fdc0cdf None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:25.496215 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278abd5-1352-4910-86d7-b192e7ace5a9 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:25.506986 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:25.521736 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b11f3c-597f-4e12-a950-d3e91a30d821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:25.522498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b11f3c-597f-4e12-a950-d3e91a30d821 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:25.522876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b11f3c-597f-4e12-a950-d3e91a30d821 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:25.523265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b11f3c-597f-4e12-a950-d3e91a30d821 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:25.601695 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b11f3c-597f-4e12-a950-d3e91a30d821 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:25.603860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b11f3c-597f-4e12-a950-d3e91a30d821 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:25.604827 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:25.628212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5278abd5-1352-4910-86d7-b192e7ace5a9 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:25.664735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23de94-2a4e-4174-b022-01c15f72953f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:25.665343 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23de94-2a4e-4174-b022-01c15f72953f None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:25.665620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23de94-2a4e-4174-b022-01c15f72953f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:25.665891 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23de94-2a4e-4174-b022-01c15f72953f None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:25.666606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23de94-2a4e-4174-b022-01c15f72953f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:25.667871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23de94-2a4e-4174-b022-01c15f72953f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:25.683401 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 488/983] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 13 06:25:25 2022] POST /identity/v3/services => generated 242 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:25:25.725497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 496/984] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:25:25 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 06:25:25.732266 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23de94-2a4e-4174-b022-01c15f72953f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:25.851986 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23de94-2a4e-4174-b022-01c15f72953f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:25.891608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b09a60-a9f3-41de-9bad-03304929a76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:25.892249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b09a60-a9f3-41de-9bad-03304929a76c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:25.892530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b09a60-a9f3-41de-9bad-03304929a76c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:25.892846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b09a60-a9f3-41de-9bad-03304929a76c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:25.900513 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:25.905614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b09a60-a9f3-41de-9bad-03304929a76c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:25.907087 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b09a60-a9f3-41de-9bad-03304929a76c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d7b09a60-a9f3-41de-9bad-03304929a76c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:25.922342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:25.923583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:25.924577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:25.924577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:25.924577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:25.924577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 489/985] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:25.929092 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b11f3c-597f-4e12-a950-d3e91a30d821 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:25.953146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:26.028613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b11f3c-597f-4e12-a950-d3e91a30d821 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:26.062595 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64801f2f-62c7-4f56-b9e1-86e56fc9bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:26.063196 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64801f2f-62c7-4f56-b9e1-86e56fc9bf3f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:26.063471 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64801f2f-62c7-4f56-b9e1-86e56fc9bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:26.063739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64801f2f-62c7-4f56-b9e1-86e56fc9bf3f None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:26.064368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64801f2f-62c7-4f56-b9e1-86e56fc9bf3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:26.064694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64801f2f-62c7-4f56-b9e1-86e56fc9bf3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:26.066031 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64801f2f-62c7-4f56-b9e1-86e56fc9bf3f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:26.081820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 497/986] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:26.083402 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b09a60-a9f3-41de-9bad-03304929a76c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:26.186827 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b09a60-a9f3-41de-9bad-03304929a76c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:26.223391 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aec5b3-a28a-4d57-b5e7-0f2055e54cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:26.224267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aec5b3-a28a-4d57-b5e7-0f2055e54cda None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:26.224764 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aec5b3-a28a-4d57-b5e7-0f2055e54cda None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:26.225235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aec5b3-a28a-4d57-b5e7-0f2055e54cda None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:26.232039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aec5b3-a28a-4d57-b5e7-0f2055e54cda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:26.233693 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aec5b3-a28a-4d57-b5e7-0f2055e54cda None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:26.245227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e4aec5b3-a28a-4d57-b5e7-0f2055e54cda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:26.245227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:26.245227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:26.245227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:26.245227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:26.245227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:26.245227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:26.245227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:26.245227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:26.245227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:26.245227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:26.245227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:26.245227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:25:26.245227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:25:26.245227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:26.246528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:26.247609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:25:26.247609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:25:26.247609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:25:26.247609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:25:26.247609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:25:26.247609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:25:26.247609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:26.247609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:26.253793 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 490/987] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:26.255446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64801f2f-62c7-4f56-b9e1-86e56fc9bf3f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:26.345541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:26.362979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64801f2f-62c7-4f56-b9e1-86e56fc9bf3f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:26.397004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a70222-ad5b-44dd-8f69-d548560e1601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:26.397607 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a70222-ad5b-44dd-8f69-d548560e1601 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:26.397888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a70222-ad5b-44dd-8f69-d548560e1601 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:26.398161 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a70222-ad5b-44dd-8f69-d548560e1601 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:26.398847 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a70222-ad5b-44dd-8f69-d548560e1601 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:26.399151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a70222-ad5b-44dd-8f69-d548560e1601 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:26.400571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a70222-ad5b-44dd-8f69-d548560e1601 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:26.412780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 498/988] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:25:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:26.419175 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aec5b3-a28a-4d57-b5e7-0f2055e54cda None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:26.471732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:26.531092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aec5b3-a28a-4d57-b5e7-0f2055e54cda None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:26.564835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d218601-01dc-42ce-89a0-14adcc6c5a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:26.565438 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d218601-01dc-42ce-89a0-14adcc6c5a1c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:26.565766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d218601-01dc-42ce-89a0-14adcc6c5a1c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:26.566044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d218601-01dc-42ce-89a0-14adcc6c5a1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:26.566767 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d218601-01dc-42ce-89a0-14adcc6c5a1c None admin] RBAC: Adding query filter params (role.id=fd480c5e32754513a580f7d7c11deaab, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=3739971aa30548d6932d7af156e1fdaf) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:26.567075 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d218601-01dc-42ce-89a0-14adcc6c5a1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:26.568492 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d218601-01dc-42ce-89a0-14adcc6c5a1c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:26.580917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 491/989] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:25:26 2022] GET /identity/v3/role_assignments?user.id=3739971aa30548d6932d7af156e1fdaf&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=fd480c5e32754513a580f7d7c11deaab => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:27.571456 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28392fd5-39d0-4ebf-83ce-38dcb9fb02ad None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:27.572023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28392fd5-39d0-4ebf-83ce-38dcb9fb02ad None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:27.572023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28392fd5-39d0-4ebf-83ce-38dcb9fb02ad None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:27.573380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 499/990] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:27.578575 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e702bf-d1a9-4729-83e8-6c05ba97a89d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:27.578982 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e702bf-d1a9-4729-83e8-6c05ba97a89d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:27.579152 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e702bf-d1a9-4729-83e8-6c05ba97a89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:27.598036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f5e702bf-d1a9-4729-83e8-6c05ba97a89d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:27.599207 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f5e702bf-d1a9-4729-83e8-6c05ba97a89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:27.671246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 492/991] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:27.905878 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64430798-f330-4e65-bbf4-87cfead1140b None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:27.906215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64430798-f330-4e65-bbf4-87cfead1140b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:27.906430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64430798-f330-4e65-bbf4-87cfead1140b None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:27.907804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 500/992] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:27.912908 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffbf71-9fa1-4be2-8ee6-bc6f122e6984 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:27.913202 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffbf71-9fa1-4be2-8ee6-bc6f122e6984 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:27.913475 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffbf71-9fa1-4be2-8ee6-bc6f122e6984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:27.931421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a0ffbf71-9fa1-4be2-8ee6-bc6f122e6984 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:27.932604 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a0ffbf71-9fa1-4be2-8ee6-bc6f122e6984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:27.946582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64430798-f330-4e65-bbf4-87cfead1140b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:27.973287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:28.004916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 493/993] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:27 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:28.058840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64430798-f330-4e65-bbf4-87cfead1140b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:28.097230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7aa140-75a2-4f4a-8c29-9bad311ab25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:28.098179 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7aa140-75a2-4f4a-8c29-9bad311ab25d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:28.098676 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7aa140-75a2-4f4a-8c29-9bad311ab25d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:28.099164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7aa140-75a2-4f4a-8c29-9bad311ab25d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:28.099955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7aa140-75a2-4f4a-8c29-9bad311ab25d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:28.101548 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7aa140-75a2-4f4a-8c29-9bad311ab25d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-5e7aa140-75a2-4f4a-8c29-9bad311ab25d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:28.111623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:28.112731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:28.114618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:28.114618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:28.114618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:28.114618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:28.114618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:28.114618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:28.114618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:28.114618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:28.114618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:28.114618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:28.114618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:28.114618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:28.114618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 06:25:28.114618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:28.117519 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 501/994] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 13 06:25:27 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:28.129383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffbf71-9fa1-4be2-8ee6-bc6f122e6984 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:28.257988 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffbf71-9fa1-4be2-8ee6-bc6f122e6984 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:28.275740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7aa140-75a2-4f4a-8c29-9bad311ab25d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:28.290103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:28.302609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0730bc0-5fa5-49a3-bfb8-c3f7a0a7e32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:28.303310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0730bc0-5fa5-49a3-bfb8-c3f7a0a7e32f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:28.303675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0730bc0-5fa5-49a3-bfb8-c3f7a0a7e32f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:28.303943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0730bc0-5fa5-49a3-bfb8-c3f7a0a7e32f None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:28.304576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0730bc0-5fa5-49a3-bfb8-c3f7a0a7e32f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:28.304915 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0730bc0-5fa5-49a3-bfb8-c3f7a0a7e32f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:28.306272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0730bc0-5fa5-49a3-bfb8-c3f7a0a7e32f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:28.312711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 494/995] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 13 06:25:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:28.318700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0730bc0-5fa5-49a3-bfb8-c3f7a0a7e32f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:28.372175 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:28.413577 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7aa140-75a2-4f4a-8c29-9bad311ab25d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:28.451084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0730bc0-5fa5-49a3-bfb8-c3f7a0a7e32f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:28.459741 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cf993-a851-45ce-afca-415a54b45427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:28.460368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cf993-a851-45ce-afca-415a54b45427 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:28.460645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cf993-a851-45ce-afca-415a54b45427 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:28.460946 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4cf993-a851-45ce-afca-415a54b45427 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:28.461525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cf993-a851-45ce-afca-415a54b45427 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:28.462879 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4cf993-a851-45ce-afca-415a54b45427 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-3c4cf993-a851-45ce-afca-415a54b45427 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:28.472033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:28.473082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:28.473940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:28.473940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:28.473940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:28.473940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:28.473940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:28.473940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:28.473940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:28.473940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:28.473940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:28.473940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:28.473940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:28.473940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:28.473940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:25:28.473940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:28.473940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 502/996] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:28.478892 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cf993-a851-45ce-afca-415a54b45427 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:28.497854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66f87b-d107-46f3-8909-6a4a02abff5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:28.498465 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66f87b-d107-46f3-8909-6a4a02abff5d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:28.498743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66f87b-d107-46f3-8909-6a4a02abff5d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:28.499013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66f87b-d107-46f3-8909-6a4a02abff5d None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:28.499644 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66f87b-d107-46f3-8909-6a4a02abff5d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:28.499955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66f87b-d107-46f3-8909-6a4a02abff5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:28.501321 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66f87b-d107-46f3-8909-6a4a02abff5d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:28.508773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 495/997] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 13 06:25:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:28.511554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66f87b-d107-46f3-8909-6a4a02abff5d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:28.560333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:28.595753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4cf993-a851-45ce-afca-415a54b45427 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:28.634500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66f87b-d107-46f3-8909-6a4a02abff5d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:28.636209 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:28.637779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66590bad-22cf-4118-a6e6-194804acde99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:28.638447 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66590bad-22cf-4118-a6e6-194804acde99 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:28.638760 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66590bad-22cf-4118-a6e6-194804acde99 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:28.639023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66590bad-22cf-4118-a6e6-194804acde99 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:28.639679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66590bad-22cf-4118-a6e6-194804acde99 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:28.639977 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66590bad-22cf-4118-a6e6-194804acde99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:28.643261 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66590bad-22cf-4118-a6e6-194804acde99 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:28.647030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 503/998] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 13 06:25:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:28.652978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66590bad-22cf-4118-a6e6-194804acde99 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:28.680146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358072f4-2d74-4b11-9989-c86861ee4fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:28.680909 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358072f4-2d74-4b11-9989-c86861ee4fc9 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:28.681133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358072f4-2d74-4b11-9989-c86861ee4fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:28.681406 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358072f4-2d74-4b11-9989-c86861ee4fc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:28.682073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358072f4-2d74-4b11-9989-c86861ee4fc9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:28.683429 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358072f4-2d74-4b11-9989-c86861ee4fc9 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:28.703638 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 496/999] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:25:28 2022] POST /identity/v3/endpoints => generated 325 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:25:28.765693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66590bad-22cf-4118-a6e6-194804acde99 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:28.772405 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e63b8-f567-4bd8-8ba1-79f5c46036aa None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:28.772712 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e63b8-f567-4bd8-8ba1-79f5c46036aa None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:28.772994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e63b8-f567-4bd8-8ba1-79f5c46036aa None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:28.774331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 497/1000] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:25:28.780507 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082ee91-5d7a-40bd-b8a7-8a4b361f0675 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:28.780848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082ee91-5d7a-40bd-b8a7-8a4b361f0675 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:28.781096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082ee91-5d7a-40bd-b8a7-8a4b361f0675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:28.801390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2082ee91-5d7a-40bd-b8a7-8a4b361f0675 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:28.803041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2082ee91-5d7a-40bd-b8a7-8a4b361f0675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:28.808815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:28.815895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb78fe-8a1c-4733-9bfa-92d34d58ee97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:28.816534 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb78fe-8a1c-4733-9bfa-92d34d58ee97 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:28.816872 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb78fe-8a1c-4733-9bfa-92d34d58ee97 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:28.817167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb78fe-8a1c-4733-9bfa-92d34d58ee97 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:28.817866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb78fe-8a1c-4733-9bfa-92d34d58ee97 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:28.818192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb78fe-8a1c-4733-9bfa-92d34d58ee97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:28.819629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb78fe-8a1c-4733-9bfa-92d34d58ee97 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:28.825045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 504/1001] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 13 06:25:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:28.831333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb78fe-8a1c-4733-9bfa-92d34d58ee97 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:28.885120 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 498/1002] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:28 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:25:28.940345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb78fe-8a1c-4733-9bfa-92d34d58ee97 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:28.973868 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a3ca9-cffd-43a3-a631-6a2b586bd65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:28.974466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a3ca9-cffd-43a3-a631-6a2b586bd65a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:28.974742 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a3ca9-cffd-43a3-a631-6a2b586bd65a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:28.975009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50a3ca9-cffd-43a3-a631-6a2b586bd65a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:28.975701 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a3ca9-cffd-43a3-a631-6a2b586bd65a None admin] RBAC: Adding query filter params (interface=public, service_id=7f60e931d8b54c5eb63aa2bcee5c0932, region_id=RegionOne) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:28.976006 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a3ca9-cffd-43a3-a631-6a2b586bd65a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:28.977418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50a3ca9-cffd-43a3-a631-6a2b586bd65a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:28.983081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 505/1003] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 13 06:25:28 2022] GET /identity/v3/endpoints?service_id=7f60e931d8b54c5eb63aa2bcee5c0932&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:28.988909 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082ee91-5d7a-40bd-b8a7-8a4b361f0675 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:29.080810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:29.092030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082ee91-5d7a-40bd-b8a7-8a4b361f0675 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:29.125701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea90e3a-c455-4dee-8b58-1334c566689d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:29.126307 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea90e3a-c455-4dee-8b58-1334c566689d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:29.126581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea90e3a-c455-4dee-8b58-1334c566689d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:29.126847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea90e3a-c455-4dee-8b58-1334c566689d None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:29.127451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea90e3a-c455-4dee-8b58-1334c566689d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:29.128827 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea90e3a-c455-4dee-8b58-1334c566689d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:29.140744 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 499/1004] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 13 06:25:28 2022] GET /identity/v3/services => generated 1727 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:25:29.152808 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a3ca9-cffd-43a3-a631-6a2b586bd65a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:29.220607 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:29.269262 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50a3ca9-cffd-43a3-a631-6a2b586bd65a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:29.306620 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d06716-cd62-48b1-8ce6-637083def089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:29.307259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d06716-cd62-48b1-8ce6-637083def089 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:29.307539 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d06716-cd62-48b1-8ce6-637083def089 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:29.307812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d06716-cd62-48b1-8ce6-637083def089 None admin] PATH_INFO: `/v3/services/image` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:29.308404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d06716-cd62-48b1-8ce6-637083def089 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:29.309840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d06716-cd62-48b1-8ce6-637083def089 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-89d06716-cd62-48b1-8ce6-637083def089 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:29.319812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:29.320871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:29.322041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:29.322041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:29.322041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:29.322041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:29.322041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:29.322041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:29.322041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:29.322041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:29.322041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:29.322041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:29.322041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:29.322041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:29.322041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:25:29.322041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:29.322041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 506/1005] 10.222.0.42 () {56 vars in 1105 bytes} [Tue Sep 13 06:25:29 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:29.327426 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea90e3a-c455-4dee-8b58-1334c566689d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:29.429826 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea90e3a-c455-4dee-8b58-1334c566689d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:29.463573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77308e2b-8188-471a-913c-82f7a89fc580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:29.464177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77308e2b-8188-471a-913c-82f7a89fc580 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:29.464449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77308e2b-8188-471a-913c-82f7a89fc580 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:29.464737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77308e2b-8188-471a-913c-82f7a89fc580 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:29.465363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77308e2b-8188-471a-913c-82f7a89fc580 None admin] RBAC: Adding query filter params (name=image) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:29.466203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77308e2b-8188-471a-913c-82f7a89fc580 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:29.467540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77308e2b-8188-471a-913c-82f7a89fc580 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:29.472708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 500/1006] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:29 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:29.478527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d06716-cd62-48b1-8ce6-637083def089 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:29.584051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d06716-cd62-48b1-8ce6-637083def089 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:29.607444 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:29.623808 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6f3f67-67f1-4b1a-9e7d-986111baf702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:29.624426 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f3f67-67f1-4b1a-9e7d-986111baf702 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:29.624727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f3f67-67f1-4b1a-9e7d-986111baf702 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:29.625007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f3f67-67f1-4b1a-9e7d-986111baf702 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:29.625651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f3f67-67f1-4b1a-9e7d-986111baf702 None admin] RBAC: Adding query filter params (type=image) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:29.625957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f3f67-67f1-4b1a-9e7d-986111baf702 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:29.627346 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6f3f67-67f1-4b1a-9e7d-986111baf702 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:29.633157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 507/1007] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:29 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:30.927591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598464e-8f75-49ca-9965-30599dd031aa None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:30.928130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598464e-8f75-49ca-9965-30599dd031aa None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:30.928130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598464e-8f75-49ca-9965-30599dd031aa None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:30.932688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 501/1008] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:30.935417 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238113f-9017-4a90-b115-1707e3700ba9 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:30.935880 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238113f-9017-4a90-b115-1707e3700ba9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:30.935962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238113f-9017-4a90-b115-1707e3700ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:30.953915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8238113f-9017-4a90-b115-1707e3700ba9 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:30.955082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8238113f-9017-4a90-b115-1707e3700ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:31.021015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 508/1009] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:30 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:31.284804 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598464e-8f75-49ca-9965-30599dd031aa None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:31.306287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:31.324234 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f400c9e-83b3-450c-8709-a59d1736377a None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:31.326047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f400c9e-83b3-450c-8709-a59d1736377a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:31.326329 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f400c9e-83b3-450c-8709-a59d1736377a None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:31.327840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 509/1010] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:31.332602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d25e5-918c-417a-b9a0-6bf5086a8589 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:31.332978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d25e5-918c-417a-b9a0-6bf5086a8589 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:31.333315 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448d25e5-918c-417a-b9a0-6bf5086a8589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:31.352747 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-448d25e5-918c-417a-b9a0-6bf5086a8589 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:31.353925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-448d25e5-918c-417a-b9a0-6bf5086a8589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:31.394220 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598464e-8f75-49ca-9965-30599dd031aa None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:31.429290 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fd894-ea5a-4a73-ad30-77c692c48e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:31.429918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fd894-ea5a-4a73-ad30-77c692c48e0c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:31.430194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fd894-ea5a-4a73-ad30-77c692c48e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:31.430461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1fd894-ea5a-4a73-ad30-77c692c48e0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:31.431558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fd894-ea5a-4a73-ad30-77c692c48e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:31.432975 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 510/1011] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:31 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:25:31.433099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1fd894-ea5a-4a73-ad30-77c692c48e0c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:31.434829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 502/1012] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:31.440245 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d25e5-918c-417a-b9a0-6bf5086a8589 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:31.490243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:31.542566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448d25e5-918c-417a-b9a0-6bf5086a8589 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:31.575911 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a4f5b-6660-4029-87ff-59698efa370b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:31.576507 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a4f5b-6660-4029-87ff-59698efa370b None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:31.576812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a4f5b-6660-4029-87ff-59698efa370b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:31.577081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a4f5b-6660-4029-87ff-59698efa370b None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:31.577729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a4f5b-6660-4029-87ff-59698efa370b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:31.579134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a4f5b-6660-4029-87ff-59698efa370b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:31.610306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 511/1013] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 13 06:25:31 2022] POST /identity/v3/projects => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:25:31.693113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fd894-ea5a-4a73-ad30-77c692c48e0c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:31.792010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:31.807973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1fd894-ea5a-4a73-ad30-77c692c48e0c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:31.813727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654450f7-6736-47d1-9836-16dc8ee78bdd None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:31.814010 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654450f7-6736-47d1-9836-16dc8ee78bdd None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:31.814278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654450f7-6736-47d1-9836-16dc8ee78bdd None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:31.815599 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 512/1014] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:25:31.820776 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0ce18-8bf3-450b-abc3-06abd8b05375 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:31.821066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0ce18-8bf3-450b-abc3-06abd8b05375 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:31.821348 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc0ce18-8bf3-450b-abc3-06abd8b05375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:31.842005 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8bc0ce18-8bf3-450b-abc3-06abd8b05375 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:31.843213 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8bc0ce18-8bf3-450b-abc3-06abd8b05375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:31.849168 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a689de-2af0-4772-b64f-2284746ecf14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:31.849797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a689de-2af0-4772-b64f-2284746ecf14 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:31.850073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a689de-2af0-4772-b64f-2284746ecf14 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:31.850340 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a689de-2af0-4772-b64f-2284746ecf14 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:31.850922 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a689de-2af0-4772-b64f-2284746ecf14 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:31.852263 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a689de-2af0-4772-b64f-2284746ecf14 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-01a689de-2af0-4772-b64f-2284746ecf14 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:31.861434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:31.862447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:31.863287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:31.863287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:31.863287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:31.863287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:31.863287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:31.863287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:31.863287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:31.863287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:31.863287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:31.863287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:31.863287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:31.863287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:31.863287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 06:25:31.863287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:31.863287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 503/1015] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:31 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:31.868526 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a689de-2af0-4772-b64f-2284746ecf14 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:31.917305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 513/1016] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:31 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:25:31.979036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a689de-2af0-4772-b64f-2284746ecf14 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:32.013574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40f3d9-2cf4-4cc8-8fa4-533699efdaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:32.014185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40f3d9-2cf4-4cc8-8fa4-533699efdaf0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:32.014467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40f3d9-2cf4-4cc8-8fa4-533699efdaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:32.014743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc40f3d9-2cf4-4cc8-8fa4-533699efdaf0 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:32.015374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40f3d9-2cf4-4cc8-8fa4-533699efdaf0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:32.015681 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40f3d9-2cf4-4cc8-8fa4-533699efdaf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:32.017080 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc40f3d9-2cf4-4cc8-8fa4-533699efdaf0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:32.026515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 504/1017] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 13 06:25:31 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:32.028400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0ce18-8bf3-450b-abc3-06abd8b05375 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:32.059490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:32.132754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc0ce18-8bf3-450b-abc3-06abd8b05375 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:32.167824 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5e9c9-aef4-45f2-a0e2-82d98c1f6c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:32.168430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5e9c9-aef4-45f2-a0e2-82d98c1f6c7d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:32.168760 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5e9c9-aef4-45f2-a0e2-82d98c1f6c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:32.169045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e5e9c9-aef4-45f2-a0e2-82d98c1f6c7d None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:32.169662 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5e9c9-aef4-45f2-a0e2-82d98c1f6c7d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:32.169960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5e9c9-aef4-45f2-a0e2-82d98c1f6c7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:32.171315 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e5e9c9-aef4-45f2-a0e2-82d98c1f6c7d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:32.176835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 514/1018] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 13 06:25:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:32.182082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40f3d9-2cf4-4cc8-8fa4-533699efdaf0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:32.201476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:32.205448 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5e9c9-aef4-45f2-a0e2-82d98c1f6c7d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:32.291494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc40f3d9-2cf4-4cc8-8fa4-533699efdaf0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:32.306620 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:32.317352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e5e9c9-aef4-45f2-a0e2-82d98c1f6c7d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:32.331058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c95e0-48cd-4462-a7b2-0b9ca0707e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:32.332066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c95e0-48cd-4462-a7b2-0b9ca0707e85 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:32.332925 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c95e0-48cd-4462-a7b2-0b9ca0707e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:32.333352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c95e0-48cd-4462-a7b2-0b9ca0707e85 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:32.334334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c95e0-48cd-4462-a7b2-0b9ca0707e85 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:32.335898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c95e0-48cd-4462-a7b2-0b9ca0707e85 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:32.354877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee908f06-1f3c-4820-817d-34ad367ecc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:32.355592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee908f06-1f3c-4820-817d-34ad367ecc1e None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:32.355866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee908f06-1f3c-4820-817d-34ad367ecc1e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:32.356140 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee908f06-1f3c-4820-817d-34ad367ecc1e None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:32.356877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee908f06-1f3c-4820-817d-34ad367ecc1e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:32.358210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 505/1019] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:25:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:25:32.358338 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee908f06-1f3c-4820-817d-34ad367ecc1e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:32.383844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 515/1020] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 13 06:25:32 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:25:33.813922 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120db64-902d-48f2-a626-8f0558107e6c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:33.814458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120db64-902d-48f2-a626-8f0558107e6c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:33.814458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120db64-902d-48f2-a626-8f0558107e6c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:33.815958 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 506/1021] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:33.820868 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d26c-bfc3-44d6-afe5-1c2b590fff5c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:33.821240 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d26c-bfc3-44d6-afe5-1c2b590fff5c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:33.821417 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84d26c-bfc3-44d6-afe5-1c2b590fff5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:33.839983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-7e84d26c-bfc3-44d6-afe5-1c2b590fff5c None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:33.841754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-7e84d26c-bfc3-44d6-afe5-1c2b590fff5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:33.913216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 516/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:33 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:34.179048 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120db64-902d-48f2-a626-8f0558107e6c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:34.253985 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:34.287199 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120db64-902d-48f2-a626-8f0558107e6c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:34.321954 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62c423-17f8-4d8c-b4fa-cc8b01b39764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:34.322607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62c423-17f8-4d8c-b4fa-cc8b01b39764 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:34.322885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62c423-17f8-4d8c-b4fa-cc8b01b39764 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:34.323154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62c423-17f8-4d8c-b4fa-cc8b01b39764 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:34.324248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62c423-17f8-4d8c-b4fa-cc8b01b39764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:34.326332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62c423-17f8-4d8c-b4fa-cc8b01b39764 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:34.328046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 507/1023] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:34.333621 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d26c-bfc3-44d6-afe5-1c2b590fff5c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:34.416172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:34.437895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84d26c-bfc3-44d6-afe5-1c2b590fff5c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:34.476080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029e519e-89cd-422c-a0aa-d4c9cb0b2b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:34.476729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e519e-89cd-422c-a0aa-d4c9cb0b2b51 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:34.477071 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e519e-89cd-422c-a0aa-d4c9cb0b2b51 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:34.477347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029e519e-89cd-422c-a0aa-d4c9cb0b2b51 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:34.478024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e519e-89cd-422c-a0aa-d4c9cb0b2b51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:34.479488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029e519e-89cd-422c-a0aa-d4c9cb0b2b51 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:34.511031 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 517/1024] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:25:34 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:25:34.580943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04416cd0-520f-4fb2-8ec7-1fcd8f818ab9 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:34.581226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04416cd0-520f-4fb2-8ec7-1fcd8f818ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:34.581500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04416cd0-520f-4fb2-8ec7-1fcd8f818ab9 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:34.583107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 508/1025] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:34.588679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc69206-1059-4953-894c-1a1e380267d4 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:34.588978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc69206-1059-4953-894c-1a1e380267d4 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:34.589258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc69206-1059-4953-894c-1a1e380267d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:34.609032 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-abc69206-1059-4953-894c-1a1e380267d4 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:34.610264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-abc69206-1059-4953-894c-1a1e380267d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:34.655972 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39214c77-3b12-4566-9183-3ec374ace69c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:34.656303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39214c77-3b12-4566-9183-3ec374ace69c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:34.656521 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39214c77-3b12-4566-9183-3ec374ace69c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:34.658063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 509/1026] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:34.663673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab905d0-d0f7-4ce1-9889-2e243bbd4fef None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:34.663975 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab905d0-d0f7-4ce1-9889-2e243bbd4fef None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:34.664226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab905d0-d0f7-4ce1-9889-2e243bbd4fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:34.684097 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-aab905d0-d0f7-4ce1-9889-2e243bbd4fef None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:34.685363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-aab905d0-d0f7-4ce1-9889-2e243bbd4fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:34.694484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 518/1027] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:34.755648 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 510/1028] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:25:34.962790 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc69206-1059-4953-894c-1a1e380267d4 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:35.031537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab905d0-d0f7-4ce1-9889-2e243bbd4fef None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:35.035819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:35.075563 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc69206-1059-4953-894c-1a1e380267d4 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:35.103324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:35.112723 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1bb38-fad0-487a-b7f9-119b4ef7d1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:35.113361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1bb38-fad0-487a-b7f9-119b4ef7d1f0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:35.113642 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1bb38-fad0-487a-b7f9-119b4ef7d1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:35.113916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf1bb38-fad0-487a-b7f9-119b4ef7d1f0 None admin] PATH_INFO: `/v3/services/image` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:35.114505 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1bb38-fad0-487a-b7f9-119b4ef7d1f0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:35.115875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf1bb38-fad0-487a-b7f9-119b4ef7d1f0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-eaf1bb38-fad0-487a-b7f9-119b4ef7d1f0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:35.125025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:35.126063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:35.126921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:35.126921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:35.126921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:35.126921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:35.126921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:35.126921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:35.126921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:35.126921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:35.126921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:35.126921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:35.126921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:35.126921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:35.126921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:25:35.126921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:35.126921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 519/1029] 10.222.0.42 () {56 vars in 1105 bytes} [Tue Sep 13 06:25:34 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:35.131999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1bb38-fad0-487a-b7f9-119b4ef7d1f0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:35.140210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab905d0-d0f7-4ce1-9889-2e243bbd4fef None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:35.178611 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17412c1-1fbd-42c8-b48d-c89ad06ccb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:35.179505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17412c1-1fbd-42c8-b48d-c89ad06ccb82 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:35.179935 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17412c1-1fbd-42c8-b48d-c89ad06ccb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:35.180365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17412c1-1fbd-42c8-b48d-c89ad06ccb82 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:35.192322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17412c1-1fbd-42c8-b48d-c89ad06ccb82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-c17412c1-1fbd-42c8-b48d-c89ad06ccb82 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:25:35.198009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:35.199146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:35.200763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:35.200763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:35.200763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:35.200763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:35.200763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:25:35.200763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:25:35.200763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:25:35.200763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:25:35.200763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:25:35.200763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:25:35.200763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:25:35.200763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:35.202129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 511/1030] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Sep 13 06:25:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:35.207654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17412c1-1fbd-42c8-b48d-c89ad06ccb82 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:35.237102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf1bb38-fad0-487a-b7f9-119b4ef7d1f0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:35.269123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:35.275981 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fb3df-953d-401f-b36a-2b632b67a4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:35.276855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fb3df-953d-401f-b36a-2b632b67a4b3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:35.277319 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fb3df-953d-401f-b36a-2b632b67a4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:35.277803 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fb3df-953d-401f-b36a-2b632b67a4b3 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:35.278970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fb3df-953d-401f-b36a-2b632b67a4b3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:35.279278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fb3df-953d-401f-b36a-2b632b67a4b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:35.280646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fb3df-953d-401f-b36a-2b632b67a4b3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:35.290796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 520/1031] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:35 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:35.291860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fb3df-953d-401f-b36a-2b632b67a4b3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:35.320235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17412c1-1fbd-42c8-b48d-c89ad06ccb82 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:35.354160 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:35.361453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e6e4a-b50d-4905-9f28-6546fb4faea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:35.361977 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e6e4a-b50d-4905-9f28-6546fb4faea0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:35.362259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e6e4a-b50d-4905-9f28-6546fb4faea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:35.362534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e6e4a-b50d-4905-9f28-6546fb4faea0 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:35.363397 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e6e4a-b50d-4905-9f28-6546fb4faea0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:35.364041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e6e4a-b50d-4905-9f28-6546fb4faea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:35.365433 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e6e4a-b50d-4905-9f28-6546fb4faea0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:35.374867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 512/1032] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Sep 13 06:25:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:35.380297 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e6e4a-b50d-4905-9f28-6546fb4faea0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:35.410742 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fb3df-953d-401f-b36a-2b632b67a4b3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:35.445437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae800bbe-cbc8-4530-8068-f4dfda3d004b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:35.446036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae800bbe-cbc8-4530-8068-f4dfda3d004b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:35.446317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae800bbe-cbc8-4530-8068-f4dfda3d004b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:35.446585 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae800bbe-cbc8-4530-8068-f4dfda3d004b None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:35.447212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae800bbe-cbc8-4530-8068-f4dfda3d004b None admin] RBAC: Adding query filter params (type=image) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:35.447510 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae800bbe-cbc8-4530-8068-f4dfda3d004b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:35.448900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae800bbe-cbc8-4530-8068-f4dfda3d004b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:35.456831 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 521/1033] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:35 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:35.461243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae800bbe-cbc8-4530-8068-f4dfda3d004b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:35.492292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e6e4a-b50d-4905-9f28-6546fb4faea0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:35.525259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:35.531776 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83fb34-84b0-4542-9078-7e734caa104a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:35.532404 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83fb34-84b0-4542-9078-7e734caa104a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:35.532877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83fb34-84b0-4542-9078-7e734caa104a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:35.533155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83fb34-84b0-4542-9078-7e734caa104a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:35.544169 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83fb34-84b0-4542-9078-7e734caa104a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:35.545635 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b83fb34-84b0-4542-9078-7e734caa104a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-5b83fb34-84b0-4542-9078-7e734caa104a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:35.561225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:35.562195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:35.563092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:35.563092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:35.563092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:35.563092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 513/1034] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:35.569752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83fb34-84b0-4542-9078-7e734caa104a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:35.570318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae800bbe-cbc8-4530-8068-f4dfda3d004b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:35.605852 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920b21c-e6d5-45a5-8dc8-0eff2decce4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:35.606479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920b21c-e6d5-45a5-8dc8-0eff2decce4c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:35.606904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920b21c-e6d5-45a5-8dc8-0eff2decce4c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:35.607183 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3920b21c-e6d5-45a5-8dc8-0eff2decce4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:35.608623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920b21c-e6d5-45a5-8dc8-0eff2decce4c None admin] RBAC: Adding query filter params (interface=public, service_id=4bce0d81f4d748738f6d672de898e3ce, region_id=RegionOne) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:35.608965 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920b21c-e6d5-45a5-8dc8-0eff2decce4c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:35.610320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3920b21c-e6d5-45a5-8dc8-0eff2decce4c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:35.621424 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 522/1035] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 13 06:25:35 2022] GET /identity/v3/endpoints?service_id=4bce0d81f4d748738f6d672de898e3ce&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:35.622109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:35.624308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920b21c-e6d5-45a5-8dc8-0eff2decce4c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:35.685591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83fb34-84b0-4542-9078-7e734caa104a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:35.721918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fbf43-8300-43a8-b799-44aaa5bf46ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:35.722528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fbf43-8300-43a8-b799-44aaa5bf46ed None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:35.723078 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fbf43-8300-43a8-b799-44aaa5bf46ed None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:35.723078 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fbf43-8300-43a8-b799-44aaa5bf46ed None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:35.723749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fbf43-8300-43a8-b799-44aaa5bf46ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:35.724073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fbf43-8300-43a8-b799-44aaa5bf46ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:35.725423 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fbf43-8300-43a8-b799-44aaa5bf46ed None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:35.735909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3920b21c-e6d5-45a5-8dc8-0eff2decce4c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:35.738858 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 514/1036] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:35.743979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fbf43-8300-43a8-b799-44aaa5bf46ed None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:35.759841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:35.773009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64eb55-53fa-4b74-b006-b036b57bfc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:35.773605 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64eb55-53fa-4b74-b006-b036b57bfc73 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:35.773983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64eb55-53fa-4b74-b006-b036b57bfc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:35.774143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb64eb55-53fa-4b74-b006-b036b57bfc73 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:35.774743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64eb55-53fa-4b74-b006-b036b57bfc73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:35.776092 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb64eb55-53fa-4b74-b006-b036b57bfc73 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:35.789091 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 523/1037] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 13 06:25:35 2022] GET /identity/v3/services => generated 1957 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:25:35.855263 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fbf43-8300-43a8-b799-44aaa5bf46ed None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:35.858313 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:35.896945 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac374b-2604-4215-b4f9-e29905fdb5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:35.897591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac374b-2604-4215-b4f9-e29905fdb5a3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:35.897870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac374b-2604-4215-b4f9-e29905fdb5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:35.898143 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac374b-2604-4215-b4f9-e29905fdb5a3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:35.906066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac374b-2604-4215-b4f9-e29905fdb5a3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:35.907516 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac374b-2604-4215-b4f9-e29905fdb5a3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-eeac374b-2604-4215-b4f9-e29905fdb5a3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:25:35.920781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:35.921874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:35.922884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:35.922884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:35.922884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:25:35.922884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:25:35.922884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:25:35.922884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:25:35.922884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:25:35.922884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:25:35.922884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:25:35.922884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:35.922884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 515/1038] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 13 06:25:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:35.927820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64eb55-53fa-4b74-b006-b036b57bfc73 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:36.036204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb64eb55-53fa-4b74-b006-b036b57bfc73 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:36.071072 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ac8a-f18d-4b83-b958-b3e59b9c5ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:36.071670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ac8a-f18d-4b83-b958-b3e59b9c5ba1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:36.071946 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ac8a-f18d-4b83-b958-b3e59b9c5ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:36.072216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9ac8a-f18d-4b83-b958-b3e59b9c5ba1 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:36.072970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9ac8a-f18d-4b83-b958-b3e59b9c5ba1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:36.073277 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9ac8a-f18d-4b83-b958-b3e59b9c5ba1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:36.074734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f9ac8a-f18d-4b83-b958-b3e59b9c5ba1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:36.092610 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 524/1039] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 13 06:25:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:36.098114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac374b-2604-4215-b4f9-e29905fdb5a3 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:36.200594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac374b-2604-4215-b4f9-e29905fdb5a3 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:36.234458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f42f2-13f7-4015-9753-a8252d4a3060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:36.235214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f42f2-13f7-4015-9753-a8252d4a3060 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:36.235598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f42f2-13f7-4015-9753-a8252d4a3060 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:36.235976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0f42f2-13f7-4015-9753-a8252d4a3060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:36.267200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:36.307349 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f42f2-13f7-4015-9753-a8252d4a3060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:36.308723 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0f42f2-13f7-4015-9753-a8252d4a3060 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:36.412901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 516/1040] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:25:36 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:25:36.419046 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ac8a-f18d-4b83-b958-b3e59b9c5ba1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:36.464887 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:36.521065 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9ac8a-f18d-4b83-b958-b3e59b9c5ba1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:36.555384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b44ad-906a-4f50-8851-211e168e1019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:36.556003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b44ad-906a-4f50-8851-211e168e1019 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:36.556279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b44ad-906a-4f50-8851-211e168e1019 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:36.556547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b44ad-906a-4f50-8851-211e168e1019 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:36.566531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b44ad-906a-4f50-8851-211e168e1019 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:36.567895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07b44ad-906a-4f50-8851-211e168e1019 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-f07b44ad-906a-4f50-8851-211e168e1019 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:36.582378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:36.583347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:36.584284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:36.584284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:36.584284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:36.588116 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 525/1041] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:36.589127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f42f2-13f7-4015-9753-a8252d4a3060 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:36.665278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:36.706172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0f42f2-13f7-4015-9753-a8252d4a3060 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:36.740469 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7677819-a5d2-4c70-9fbe-7d2f2223a326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:36.741098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7677819-a5d2-4c70-9fbe-7d2f2223a326 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:36.741373 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7677819-a5d2-4c70-9fbe-7d2f2223a326 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:36.741640 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7677819-a5d2-4c70-9fbe-7d2f2223a326 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:36.742264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7677819-a5d2-4c70-9fbe-7d2f2223a326 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:36.742560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7677819-a5d2-4c70-9fbe-7d2f2223a326 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:36.743893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7677819-a5d2-4c70-9fbe-7d2f2223a326 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:36.755411 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 517/1042] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:36.759181 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05356a3f-0ce2-4a28-9742-e7ab414a8a93 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:36.759527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05356a3f-0ce2-4a28-9742-e7ab414a8a93 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:36.759801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05356a3f-0ce2-4a28-9742-e7ab414a8a93 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:36.760605 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7677819-a5d2-4c70-9fbe-7d2f2223a326 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:36.761262 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 526/1043] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:36.766607 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0040a5-4345-4ba2-a2a9-2d076cae4bf8 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:36.766877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0040a5-4345-4ba2-a2a9-2d076cae4bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:36.767146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0040a5-4345-4ba2-a2a9-2d076cae4bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:36.786796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9d0040a5-4345-4ba2-a2a9-2d076cae4bf8 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:36.787981 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9d0040a5-4345-4ba2-a2a9-2d076cae4bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:36.856375 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 527/1044] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:25:36.869034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7677819-a5d2-4c70-9fbe-7d2f2223a326 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:36.893255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:36.905466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5a67f-5e4a-4030-bc3b-a3f90395c913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:36.906095 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5a67f-5e4a-4030-bc3b-a3f90395c913 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:36.906375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5a67f-5e4a-4030-bc3b-a3f90395c913 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:36.906648 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5a67f-5e4a-4030-bc3b-a3f90395c913 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:36.913386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5a67f-5e4a-4030-bc3b-a3f90395c913 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:36.914848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5a67f-5e4a-4030-bc3b-a3f90395c913 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:36.926283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-d5f5a67f-5e4a-4030-bc3b-a3f90395c913 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:36.926283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:36.926283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:36.926283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:36.926283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:36.926283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:36.926283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:36.926283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:36.926283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:36.926283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:36.926283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:36.926283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:36.926283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:25:36.926283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:25:36.926283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:36.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:36.928782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:25:36.928782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:25:36.928782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:25:36.928782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:25:36.928782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:25:36.928782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:25:36.928782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:36.928782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:36.928782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 518/1045] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:36.933147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0040a5-4345-4ba2-a2a9-2d076cae4bf8 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:36.962458 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:37.037139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0040a5-4345-4ba2-a2a9-2d076cae4bf8 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:37.070535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bf673-dc9f-48d7-8f55-eb78dd50a98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:37.071138 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bf673-dc9f-48d7-8f55-eb78dd50a98e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:37.071411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bf673-dc9f-48d7-8f55-eb78dd50a98e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:37.071675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bf673-dc9f-48d7-8f55-eb78dd50a98e None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:37.072353 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bf673-dc9f-48d7-8f55-eb78dd50a98e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:37.072651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bf673-dc9f-48d7-8f55-eb78dd50a98e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:37.074094 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bf673-dc9f-48d7-8f55-eb78dd50a98e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:37.086325 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 528/1046] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:25:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:37.092247 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5a67f-5e4a-4030-bc3b-a3f90395c913 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:37.126794 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bf673-dc9f-48d7-8f55-eb78dd50a98e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:37.196864 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5a67f-5e4a-4030-bc3b-a3f90395c913 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:37.217486 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:37.233091 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb102906-305a-4f61-9f21-e9a3cce03024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:37.233700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102906-305a-4f61-9f21-e9a3cce03024 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:37.233916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bf673-dc9f-48d7-8f55-eb78dd50a98e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:37.234107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102906-305a-4f61-9f21-e9a3cce03024 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:37.234318 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102906-305a-4f61-9f21-e9a3cce03024 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:37.235070 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb102906-305a-4f61-9f21-e9a3cce03024 None admin] RBAC: Adding query filter params (role.id=fd480c5e32754513a580f7d7c11deaab, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=7fbb67072ba544e39073787eb25fcf1e) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:37.235388 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb102906-305a-4f61-9f21-e9a3cce03024 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:37.236828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb102906-305a-4f61-9f21-e9a3cce03024 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:37.242323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 519/1047] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:25:37 2022] GET /identity/v3/role_assignments?user.id=7fbb67072ba544e39073787eb25fcf1e&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=fd480c5e32754513a580f7d7c11deaab => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:37.282265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b63658-26cf-4757-83cf-0f17996d7b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:37.282912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b63658-26cf-4757-83cf-0f17996d7b7a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:37.283191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b63658-26cf-4757-83cf-0f17996d7b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:37.283459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b63658-26cf-4757-83cf-0f17996d7b7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:37.296652 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b63658-26cf-4757-83cf-0f17996d7b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-e7b63658-26cf-4757-83cf-0f17996d7b7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:25:37.303493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:37.304545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:37.310039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:37.310039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:37.310039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:37.310039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:37.310039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:25:37.310039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:25:37.310039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:25:37.310039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:25:37.310039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:25:37.310039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:25:37.310039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:25:37.310039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:37.310039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 529/1048] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:25:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:37.312473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb102906-305a-4f61-9f21-e9a3cce03024 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:37.365683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:37.422623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb102906-305a-4f61-9f21-e9a3cce03024 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:37.458395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf980f33-1929-4d49-a867-3915675bb29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:37.459156 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf980f33-1929-4d49-a867-3915675bb29b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:37.459560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf980f33-1929-4d49-a867-3915675bb29b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:37.459937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf980f33-1929-4d49-a867-3915675bb29b None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:37.460736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf980f33-1929-4d49-a867-3915675bb29b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:37.461145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf980f33-1929-4d49-a867-3915675bb29b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:37.462598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf980f33-1929-4d49-a867-3915675bb29b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:37.476502 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 520/1049] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:25:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:37.477631 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b63658-26cf-4757-83cf-0f17996d7b7a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:37.581341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b63658-26cf-4757-83cf-0f17996d7b7a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:37.615586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6599bb-bb34-421a-9b64-fd2abd8b32e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:37.616217 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6599bb-bb34-421a-9b64-fd2abd8b32e5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:37.616495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6599bb-bb34-421a-9b64-fd2abd8b32e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:37.616870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6599bb-bb34-421a-9b64-fd2abd8b32e5 None admin] PATH_INFO: `/v3/users/f07731609a894b59a798f66838a818ed` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:37.632352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6599bb-bb34-421a-9b64-fd2abd8b32e5 None admin] RBAC: Authorizing `identity:get_user(user_id=f07731609a894b59a798f66838a818ed)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:37.633949 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6599bb-bb34-421a-9b64-fd2abd8b32e5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:37.640578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 530/1050] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:25:37 2022] GET /identity/v3/users/f07731609a894b59a798f66838a818ed => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:37.642053 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf980f33-1929-4d49-a867-3915675bb29b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:37.744657 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf980f33-1929-4d49-a867-3915675bb29b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:37.755998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:37.780235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da125b6-389d-40f0-8068-c84b5a46a06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:37.780873 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da125b6-389d-40f0-8068-c84b5a46a06f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:37.781153 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da125b6-389d-40f0-8068-c84b5a46a06f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:37.781425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da125b6-389d-40f0-8068-c84b5a46a06f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:37.849433 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da125b6-389d-40f0-8068-c84b5a46a06f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:37.850916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da125b6-389d-40f0-8068-c84b5a46a06f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:37.956442 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 521/1051] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:25:37 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:25:37.962108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6599bb-bb34-421a-9b64-fd2abd8b32e5 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:37.966924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:37.974921 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5f95d-e759-437a-bd73-db6145ee9039 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:37.975238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5f95d-e759-437a-bd73-db6145ee9039 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:37.975491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5f95d-e759-437a-bd73-db6145ee9039 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:37.977714 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 522/1052] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:37.982747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58d5b4-a486-4a3f-b536-6fbb7cc79c89 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:37.983340 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58d5b4-a486-4a3f-b536-6fbb7cc79c89 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:37.983619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58d5b4-a486-4a3f-b536-6fbb7cc79c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:38.004605 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-df58d5b4-a486-4a3f-b536-6fbb7cc79c89 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:38.005759 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-df58d5b4-a486-4a3f-b536-6fbb7cc79c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:38.009417 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:38.071725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6599bb-bb34-421a-9b64-fd2abd8b32e5 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:38.087324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 523/1053] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:37 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:25:38.109112 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b05743-bf35-46b7-b407-85c15af32976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:38.109760 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b05743-bf35-46b7-b407-85c15af32976 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:38.110034 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b05743-bf35-46b7-b407-85c15af32976 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:38.110302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b05743-bf35-46b7-b407-85c15af32976 None admin] PATH_INFO: `/v3/projects/1a903a4facb147cc90a96e4d437316be` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:38.111496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b05743-bf35-46b7-b407-85c15af32976 None admin] RBAC: Authorizing `identity:get_project(project_id=1a903a4facb147cc90a96e4d437316be)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:38.113118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b05743-bf35-46b7-b407-85c15af32976 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:38.114993 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 531/1054] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:25:37 2022] GET /identity/v3/projects/1a903a4facb147cc90a96e4d437316be => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:38.121339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58d5b4-a486-4a3f-b536-6fbb7cc79c89 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:38.218516 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58d5b4-a486-4a3f-b536-6fbb7cc79c89 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:38.251959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b1ca3-915b-48cc-ad30-465843e4005f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:38.252548 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b1ca3-915b-48cc-ad30-465843e4005f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:38.252853 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b1ca3-915b-48cc-ad30-465843e4005f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:38.253123 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229b1ca3-915b-48cc-ad30-465843e4005f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:38.253837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b1ca3-915b-48cc-ad30-465843e4005f None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=1a903a4facb147cc90a96e4d437316be, user.id=f07731609a894b59a798f66838a818ed) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:38.254142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b1ca3-915b-48cc-ad30-465843e4005f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:38.255594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229b1ca3-915b-48cc-ad30-465843e4005f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:38.260924 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 524/1055] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:25:38 2022] GET /identity/v3/role_assignments?user.id=f07731609a894b59a798f66838a818ed&scope.project.id=1a903a4facb147cc90a96e4d437316be&role.id=6382a06103714d068409d25cbeb48744 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:38.354029 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b05743-bf35-46b7-b407-85c15af32976 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:38.432373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:38.465425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b05743-bf35-46b7-b407-85c15af32976 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:38.500143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351fc62-5b98-4871-a604-c9e64731e97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:38.500920 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351fc62-5b98-4871-a604-c9e64731e97c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:38.501262 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351fc62-5b98-4871-a604-c9e64731e97c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:38.501596 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351fc62-5b98-4871-a604-c9e64731e97c None admin] PATH_INFO: `/v3/services/image` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:38.502242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351fc62-5b98-4871-a604-c9e64731e97c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:38.503650 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351fc62-5b98-4871-a604-c9e64731e97c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-7351fc62-5b98-4871-a604-c9e64731e97c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:38.512503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:38.513756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:38.514817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:38.514817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:38.514817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:38.514817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:38.514817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:38.514817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:38.514817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:38.514817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:38.514817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:38.514817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:38.514817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:25:38.514817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:25:38.514817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 06:25:38.514817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:38.515996 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 532/1056] 10.222.0.42 () {56 vars in 1105 bytes} [Tue Sep 13 06:25:38 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:38.520749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b1ca3-915b-48cc-ad30-465843e4005f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:38.524554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:38.621664 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229b1ca3-915b-48cc-ad30-465843e4005f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:38.660298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bd8fe-297a-443c-8ab3-1cfe4904e9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:38.660936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd8fe-297a-443c-8ab3-1cfe4904e9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:38.661217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd8fe-297a-443c-8ab3-1cfe4904e9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:38.661488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552bd8fe-297a-443c-8ab3-1cfe4904e9a4 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:38.662116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bd8fe-297a-443c-8ab3-1cfe4904e9a4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:38.662418 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bd8fe-297a-443c-8ab3-1cfe4904e9a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:38.663791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552bd8fe-297a-443c-8ab3-1cfe4904e9a4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:38.674074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 525/1057] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:38 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:38.675022 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351fc62-5b98-4871-a604-c9e64731e97c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:38.779954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351fc62-5b98-4871-a604-c9e64731e97c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:38.815772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9357f-5487-4cc4-a771-2c21454c4a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:38.816386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9357f-5487-4cc4-a771-2c21454c4a48 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:38.816658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9357f-5487-4cc4-a771-2c21454c4a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:38.816951 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9357f-5487-4cc4-a771-2c21454c4a48 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:38.817588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9357f-5487-4cc4-a771-2c21454c4a48 None admin] RBAC: Adding query filter params (type=image) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:38.817887 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9357f-5487-4cc4-a771-2c21454c4a48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:38.819242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f9357f-5487-4cc4-a771-2c21454c4a48 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:38.821588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:38.825134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 533/1058] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:38 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:38.830610 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bd8fe-297a-443c-8ab3-1cfe4904e9a4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:38.898315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:38.933379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552bd8fe-297a-443c-8ab3-1cfe4904e9a4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:38.973646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607a4ab5-2da1-4c75-9cdc-cc4d7c5d5c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:38.974267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a4ab5-2da1-4c75-9cdc-cc4d7c5d5c2a None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:38.974549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a4ab5-2da1-4c75-9cdc-cc4d7c5d5c2a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:38.974823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607a4ab5-2da1-4c75-9cdc-cc4d7c5d5c2a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:38.975693 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a4ab5-2da1-4c75-9cdc-cc4d7c5d5c2a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:38.977348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607a4ab5-2da1-4c75-9cdc-cc4d7c5d5c2a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:38.999088 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 526/1059] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:25:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:25:39.390234 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cac7e5-10f5-48ab-a9e7-de508c7d6428 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:39.390761 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cac7e5-10f5-48ab-a9e7-de508c7d6428 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:39.390761 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cac7e5-10f5-48ab-a9e7-de508c7d6428 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:39.392092 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 534/1060] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:39.397566 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c8b9a-d003-4027-bd2a-1aa87cf947f6 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:39.397992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c8b9a-d003-4027-bd2a-1aa87cf947f6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:39.398160 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c8b9a-d003-4027-bd2a-1aa87cf947f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:39.416143 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2b6c8b9a-d003-4027-bd2a-1aa87cf947f6 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:39.417334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2b6c8b9a-d003-4027-bd2a-1aa87cf947f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:39.491034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 527/1061] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:39.752871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cac7e5-10f5-48ab-a9e7-de508c7d6428 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:39.853204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cac7e5-10f5-48ab-a9e7-de508c7d6428 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:39.887652 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb284fc-127d-420c-b855-b60942a812dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:39.888281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb284fc-127d-420c-b855-b60942a812dd None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:39.888607 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb284fc-127d-420c-b855-b60942a812dd None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:39.888898 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb284fc-127d-420c-b855-b60942a812dd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:39.901034 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb284fc-127d-420c-b855-b60942a812dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-eeb284fc-127d-420c-b855-b60942a812dd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:25:39.905832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:39.906780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:39.907645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:39.907645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:39.907645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:39.907645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:39.907645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:25:39.907645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:25:39.907645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:25:39.907645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:25:39.907645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:25:39.907645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:25:39.907645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:25:39.907645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:39.911975 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 535/1062] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Sep 13 06:25:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:39.913368 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c8b9a-d003-4027-bd2a-1aa87cf947f6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:39.963106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:40.013368 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c8b9a-d003-4027-bd2a-1aa87cf947f6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:40.047285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be18f6-a0d3-4681-9c2c-7d650f29fe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:40.047884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be18f6-a0d3-4681-9c2c-7d650f29fe73 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:40.048156 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be18f6-a0d3-4681-9c2c-7d650f29fe73 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:40.048421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be18f6-a0d3-4681-9c2c-7d650f29fe73 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:40.049105 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be18f6-a0d3-4681-9c2c-7d650f29fe73 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:40.049405 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be18f6-a0d3-4681-9c2c-7d650f29fe73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:40.050804 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be18f6-a0d3-4681-9c2c-7d650f29fe73 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:40.063351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 528/1063] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Sep 13 06:25:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:40.064691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb284fc-127d-420c-b855-b60942a812dd None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:40.126197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:40.169257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb284fc-127d-420c-b855-b60942a812dd None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:40.202327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba630e7-c0ab-4772-b197-2906b9a0ace4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:40.202947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba630e7-c0ab-4772-b197-2906b9a0ace4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:40.203223 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba630e7-c0ab-4772-b197-2906b9a0ace4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:40.203490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba630e7-c0ab-4772-b197-2906b9a0ace4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:40.213532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba630e7-c0ab-4772-b197-2906b9a0ace4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:40.214966 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba630e7-c0ab-4772-b197-2906b9a0ace4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-bba630e7-c0ab-4772-b197-2906b9a0ace4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:40.230251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:40.231875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:40.237464 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:40.237464 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:40.237464 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:40.237464 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 536/1064] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:40.239587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be18f6-a0d3-4681-9c2c-7d650f29fe73 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:40.345557 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be18f6-a0d3-4681-9c2c-7d650f29fe73 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:40.358609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:40.380427 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cc3c73-cb7a-43e9-96d2-0b37c08019b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:40.381068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc3c73-cb7a-43e9-96d2-0b37c08019b0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:40.381345 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc3c73-cb7a-43e9-96d2-0b37c08019b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:40.381613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cc3c73-cb7a-43e9-96d2-0b37c08019b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:40.382248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc3c73-cb7a-43e9-96d2-0b37c08019b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:40.382551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc3c73-cb7a-43e9-96d2-0b37c08019b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:40.383896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cc3c73-cb7a-43e9-96d2-0b37c08019b0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:40.400809 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 529/1065] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:40.404710 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba630e7-c0ab-4772-b197-2906b9a0ace4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:40.405130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adc87c-9e1a-4f2d-b226-b6fa09a33b1d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:40.405130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adc87c-9e1a-4f2d-b226-b6fa09a33b1d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:40.405130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adc87c-9e1a-4f2d-b226-b6fa09a33b1d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:40.405762 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 530/1066] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:25:40.410491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218847-27c1-4131-85ff-33472b3e0384 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:40.410769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218847-27c1-4131-85ff-33472b3e0384 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:40.411035 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4218847-27c1-4131-85ff-33472b3e0384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:40.428357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b4218847-27c1-4131-85ff-33472b3e0384 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:40.429570 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b4218847-27c1-4131-85ff-33472b3e0384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:40.503917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 531/1067] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:25:40.505088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba630e7-c0ab-4772-b197-2906b9a0ace4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:40.521518 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:40.544126 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87db014-bfe0-4d28-b98b-bcb898112363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:40.544773 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87db014-bfe0-4d28-b98b-bcb898112363 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:40.545052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87db014-bfe0-4d28-b98b-bcb898112363 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:40.545323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87db014-bfe0-4d28-b98b-bcb898112363 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:40.552794 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87db014-bfe0-4d28-b98b-bcb898112363 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:40.554218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87db014-bfe0-4d28-b98b-bcb898112363 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-e87db014-bfe0-4d28-b98b-bcb898112363 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:25:40.565326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:40.566291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:40.572199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:40.572199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:40.572199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:25:40.572199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:25:40.572199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:25:40.572199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:25:40.572199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:25:40.572199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:25:40.572199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:25:40.572199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:40.572199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 537/1068] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 13 06:25:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:40.575097 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4218847-27c1-4131-85ff-33472b3e0384 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:40.682610 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4218847-27c1-4131-85ff-33472b3e0384 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:40.684189 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:40.718585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb996575-be51-4621-ab46-4e5961ca87b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:40.719196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb996575-be51-4621-ab46-4e5961ca87b4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:40.719476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb996575-be51-4621-ab46-4e5961ca87b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:40.719748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb996575-be51-4621-ab46-4e5961ca87b4 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:40.720478 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb996575-be51-4621-ab46-4e5961ca87b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:40.720813 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb996575-be51-4621-ab46-4e5961ca87b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:40.722243 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb996575-be51-4621-ab46-4e5961ca87b4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:40.740079 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 532/1069] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 13 06:25:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:40.746246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87db014-bfe0-4d28-b98b-bcb898112363 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:40.781124 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb996575-be51-4621-ab46-4e5961ca87b4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:40.855318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87db014-bfe0-4d28-b98b-bcb898112363 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:40.890837 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c0e66-5d8f-4e27-8f98-8d7d71785b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:40.891465 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c0e66-5d8f-4e27-8f98-8d7d71785b2c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:40.891743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c0e66-5d8f-4e27-8f98-8d7d71785b2c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:40.892011 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c0e66-5d8f-4e27-8f98-8d7d71785b2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:40.892568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb996575-be51-4621-ab46-4e5961ca87b4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:40.902500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c0e66-5d8f-4e27-8f98-8d7d71785b2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:40.903973 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c0e66-5d8f-4e27-8f98-8d7d71785b2c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-cd3c0e66-5d8f-4e27-8f98-8d7d71785b2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:40.918308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:40.919302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:40.920208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:40.920208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:40.920208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:40.920208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 538/1070] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:40.925732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c0e66-5d8f-4e27-8f98-8d7d71785b2c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:40.931078 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12196d6d-ba96-49a9-9b1f-36ccce905fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:40.931709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12196d6d-ba96-49a9-9b1f-36ccce905fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:40.931986 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12196d6d-ba96-49a9-9b1f-36ccce905fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:40.932255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12196d6d-ba96-49a9-9b1f-36ccce905fc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:40.943869 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12196d6d-ba96-49a9-9b1f-36ccce905fc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-12196d6d-ba96-49a9-9b1f-36ccce905fc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:25:40.948493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:40.949454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:40.950887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:40.950887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:40.950887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:40.950887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:40.950887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:25:40.950887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:25:40.950887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:25:40.950887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:25:40.950887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:25:40.950887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:25:40.950887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:25:40.950887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:40.950887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 533/1071] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:25:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:40.956078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:40.956194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12196d6d-ba96-49a9-9b1f-36ccce905fc0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:40.979387 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:41.037655 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c0e66-5d8f-4e27-8f98-8d7d71785b2c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:41.071489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12196d6d-ba96-49a9-9b1f-36ccce905fc0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:41.076137 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde97c4-4174-4861-9243-64e09592b65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:41.076771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde97c4-4174-4861-9243-64e09592b65f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:41.077050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde97c4-4174-4861-9243-64e09592b65f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:41.077317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde97c4-4174-4861-9243-64e09592b65f None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:41.077970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde97c4-4174-4861-9243-64e09592b65f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:41.078271 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde97c4-4174-4861-9243-64e09592b65f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:41.079660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde97c4-4174-4861-9243-64e09592b65f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:41.098003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 539/1072] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:41.099291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde97c4-4174-4861-9243-64e09592b65f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:41.118325 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7984e-c1f9-465c-b34e-fe43e78a427e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:41.119086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7984e-c1f9-465c-b34e-fe43e78a427e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:41.119217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7984e-c1f9-465c-b34e-fe43e78a427e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:41.119459 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7984e-c1f9-465c-b34e-fe43e78a427e None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:41.120119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7984e-c1f9-465c-b34e-fe43e78a427e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:41.120415 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7984e-c1f9-465c-b34e-fe43e78a427e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:41.122604 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7984e-c1f9-465c-b34e-fe43e78a427e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:41.136244 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 534/1073] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:25:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:41.137871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7984e-c1f9-465c-b34e-fe43e78a427e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:41.192729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:41.208836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde97c4-4174-4861-9243-64e09592b65f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:41.223632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:41.242499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7984e-c1f9-465c-b34e-fe43e78a427e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:41.243210 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947947e-0de5-4b01-b633-94f013ffb15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:41.243830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947947e-0de5-4b01-b633-94f013ffb15c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:41.244104 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947947e-0de5-4b01-b633-94f013ffb15c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:41.244372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947947e-0de5-4b01-b633-94f013ffb15c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:41.251682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947947e-0de5-4b01-b633-94f013ffb15c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:41.253136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c947947e-0de5-4b01-b633-94f013ffb15c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:41.263985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c947947e-0de5-4b01-b633-94f013ffb15c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:41.263985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:41.263985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:41.263985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:41.263985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:41.263985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:41.263985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:41.263985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:41.263985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:41.263985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:41.263985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:41.263985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:41.263985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:25:41.263985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:25:41.263985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:41.265085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:41.266009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:25:41.266009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:25:41.266009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:25:41.266009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:25:41.266009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:25:41.266009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:25:41.266009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:41.266009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:41.266009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 540/1074] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:41.266526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f921c90-65d6-4747-bee7-31fd8b96f47a None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:41.266683 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f921c90-65d6-4747-bee7-31fd8b96f47a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:41.266954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f921c90-65d6-4747-bee7-31fd8b96f47a None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:41.268170 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 541/1075] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:41.272988 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f921c90-65d6-4747-bee7-31fd8b96f47a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:41.278597 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc966af-9b4d-420b-ad0e-cb0fc13aa9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:41.279228 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc966af-9b4d-420b-ad0e-cb0fc13aa9dc None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:41.279507 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc966af-9b4d-420b-ad0e-cb0fc13aa9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:41.279779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc966af-9b4d-420b-ad0e-cb0fc13aa9dc None admin] PATH_INFO: `/v3/users/f07731609a894b59a798f66838a818ed` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:41.280965 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc966af-9b4d-420b-ad0e-cb0fc13aa9dc None admin] RBAC: Authorizing `identity:get_user(user_id=f07731609a894b59a798f66838a818ed)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:41.282365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc966af-9b4d-420b-ad0e-cb0fc13aa9dc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:41.283935 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 535/1076] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:25:41 2022] GET /identity/v3/users/f07731609a894b59a798f66838a818ed => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:41.285071 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb2e39-1bd4-4de7-b31f-2e25a15f56ef None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:41.285352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb2e39-1bd4-4de7-b31f-2e25a15f56ef None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:41.285615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeb2e39-1bd4-4de7-b31f-2e25a15f56ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:41.304859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9aeb2e39-1bd4-4de7-b31f-2e25a15f56ef None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:41.306038 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9aeb2e39-1bd4-4de7-b31f-2e25a15f56ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:41.376959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 536/1077] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:41.377810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb2e39-1bd4-4de7-b31f-2e25a15f56ef None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:41.379604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f921c90-65d6-4747-bee7-31fd8b96f47a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:41.420164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59581e-aca8-461f-b9f7-8f84b961eda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:41.420964 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59581e-aca8-461f-b9f7-8f84b961eda6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:41.421337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59581e-aca8-461f-b9f7-8f84b961eda6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:41.421705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e59581e-aca8-461f-b9f7-8f84b961eda6 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:41.422900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59581e-aca8-461f-b9f7-8f84b961eda6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:41.423306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59581e-aca8-461f-b9f7-8f84b961eda6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:41.425201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e59581e-aca8-461f-b9f7-8f84b961eda6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:41.440840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 542/1078] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:25:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:41.443554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59581e-aca8-461f-b9f7-8f84b961eda6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:41.447020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:41.465063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:41.485145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeb2e39-1bd4-4de7-b31f-2e25a15f56ef None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:41.522497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d7f29-0d13-4e4a-9b6a-94460025d9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:41.523325 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d7f29-0d13-4e4a-9b6a-94460025d9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:41.523676 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d7f29-0d13-4e4a-9b6a-94460025d9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:41.524020 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d7f29-0d13-4e4a-9b6a-94460025d9b4 None admin] PATH_INFO: `/v3/projects/1a903a4facb147cc90a96e4d437316be` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:41.525393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d7f29-0d13-4e4a-9b6a-94460025d9b4 None admin] RBAC: Authorizing `identity:get_project(project_id=1a903a4facb147cc90a96e4d437316be)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:41.527005 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212d7f29-0d13-4e4a-9b6a-94460025d9b4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:41.529389 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 537/1079] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:25:41 2022] GET /identity/v3/projects/1a903a4facb147cc90a96e4d437316be => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:41.535164 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d7f29-0d13-4e4a-9b6a-94460025d9b4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:41.553174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e59581e-aca8-461f-b9f7-8f84b961eda6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:41.586286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2956f9-96c4-4914-8885-3d68090e7e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:41.587057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2956f9-96c4-4914-8885-3d68090e7e25 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:41.587403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2956f9-96c4-4914-8885-3d68090e7e25 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:41.587783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2956f9-96c4-4914-8885-3d68090e7e25 None admin] PATH_INFO: `/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/7fbb67072ba544e39073787eb25fcf1e/roles/fd480c5e32754513a580f7d7c11deaab` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:41.590051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2956f9-96c4-4914-8885-3d68090e7e25 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c3f0aa3b746108e73737491b003e7, user_id=7fbb67072ba544e39073787eb25fcf1e, role_id=fd480c5e32754513a580f7d7c11deaab)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:41.592091 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2956f9-96c4-4914-8885-3d68090e7e25 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:41.614224 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 543/1080] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:25:41 2022] PUT /identity/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/7fbb67072ba544e39073787eb25fcf1e/roles/fd480c5e32754513a580f7d7c11deaab => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:25:41.646375 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2956f9-96c4-4914-8885-3d68090e7e25 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:41.648975 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212d7f29-0d13-4e4a-9b6a-94460025d9b4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:41.688930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af025dd7-7978-4eb2-a907-fadc0a8ad4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:41.689608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025dd7-7978-4eb2-a907-fadc0a8ad4df None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:41.689886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025dd7-7978-4eb2-a907-fadc0a8ad4df None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:41.690156 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af025dd7-7978-4eb2-a907-fadc0a8ad4df None admin] PATH_INFO: `/v3/projects/1a903a4facb147cc90a96e4d437316be/users/f07731609a894b59a798f66838a818ed/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:41.692150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af025dd7-7978-4eb2-a907-fadc0a8ad4df None admin] RBAC: Authorizing `identity:create_grant(project_id=1a903a4facb147cc90a96e4d437316be, user_id=f07731609a894b59a798f66838a818ed, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:41.693637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af025dd7-7978-4eb2-a907-fadc0a8ad4df None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:41.709326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 538/1081] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:25:41 2022] PUT /identity/v3/projects/1a903a4facb147cc90a96e4d437316be/users/f07731609a894b59a798f66838a818ed/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:25:41.731723 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:41.780390 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2956f9-96c4-4914-8885-3d68090e7e25 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:41.823394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c8dac-97fc-49af-abc4-8e4cb77680d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:41.824012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c8dac-97fc-49af-abc4-8e4cb77680d1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:41.824288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c8dac-97fc-49af-abc4-8e4cb77680d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:41.824590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c8dac-97fc-49af-abc4-8e4cb77680d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:41.899492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c8dac-97fc-49af-abc4-8e4cb77680d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:41.901103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c8dac-97fc-49af-abc4-8e4cb77680d1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:41.964357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:42.005714 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 544/1082] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:25:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:25:42.011251 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af025dd7-7978-4eb2-a907-fadc0a8ad4df None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:42.023140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:42.115449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af025dd7-7978-4eb2-a907-fadc0a8ad4df None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:42.150305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa187a-aea1-4fd5-86d3-3b89fb664fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:42.150938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa187a-aea1-4fd5-86d3-3b89fb664fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:42.151213 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa187a-aea1-4fd5-86d3-3b89fb664fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:42.151478 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa187a-aea1-4fd5-86d3-3b89fb664fb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:42.162206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa187a-aea1-4fd5-86d3-3b89fb664fb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:42.163631 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa187a-aea1-4fd5-86d3-3b89fb664fb0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-55fa187a-aea1-4fd5-86d3-3b89fb664fb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:42.178082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:42.179031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:42.179954 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:42.179954 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:42.179954 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:42.184156 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 539/1083] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:42.185535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c8dac-97fc-49af-abc4-8e4cb77680d1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:42.296801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c8dac-97fc-49af-abc4-8e4cb77680d1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:42.331488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ee7cf-00cf-4b2c-bf0a-594861de6036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:42.332095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ee7cf-00cf-4b2c-bf0a-594861de6036 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:42.332375 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ee7cf-00cf-4b2c-bf0a-594861de6036 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:42.332647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ee7cf-00cf-4b2c-bf0a-594861de6036 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:42.333309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ee7cf-00cf-4b2c-bf0a-594861de6036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:42.333615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ee7cf-00cf-4b2c-bf0a-594861de6036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:42.334971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ee7cf-00cf-4b2c-bf0a-594861de6036 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:42.347353 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 545/1084] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:43.795907 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699247e-2218-432e-9d5e-59707bbb4736 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:43.796491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699247e-2218-432e-9d5e-59707bbb4736 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:43.796591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699247e-2218-432e-9d5e-59707bbb4736 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:43.797941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 540/1085] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:43.803866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d40136-d6ea-4d9f-81bc-4149236f2a9e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:43.804505 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d40136-d6ea-4d9f-81bc-4149236f2a9e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:43.804505 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d40136-d6ea-4d9f-81bc-4149236f2a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:43.822997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-59d40136-d6ea-4d9f-81bc-4149236f2a9e None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:43.824194 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-59d40136-d6ea-4d9f-81bc-4149236f2a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:43.841885 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:43.892788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 546/1086] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:43.895824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5866d1-8826-4bbc-9d43-6f9800a3dd6a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:43.896051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5866d1-8826-4bbc-9d43-6f9800a3dd6a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:43.896327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5866d1-8826-4bbc-9d43-6f9800a3dd6a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:43.897798 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 541/1087] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:43.903296 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c4ee2-7d05-42a7-b174-14bf7e438442 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:43.903585 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c4ee2-7d05-42a7-b174-14bf7e438442 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:43.903859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c4ee2-7d05-42a7-b174-14bf7e438442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:43.921982 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8e2c4ee2-7d05-42a7-b174-14bf7e438442 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:43.923149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8e2c4ee2-7d05-42a7-b174-14bf7e438442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:43.987095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 547/1088] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:44.165733 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5866d1-8826-4bbc-9d43-6f9800a3dd6a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:44.223623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:44.254053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c4ee2-7d05-42a7-b174-14bf7e438442 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:44.266183 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5866d1-8826-4bbc-9d43-6f9800a3dd6a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:44.299506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e8ff9-a365-49ea-b348-99b1b90437c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:44.300132 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e8ff9-a365-49ea-b348-99b1b90437c0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:44.300406 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e8ff9-a365-49ea-b348-99b1b90437c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:44.300694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e8ff9-a365-49ea-b348-99b1b90437c0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:44.311308 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e8ff9-a365-49ea-b348-99b1b90437c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-567e8ff9-a365-49ea-b348-99b1b90437c0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:25:44.316177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:44.317283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:44.318751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:44.318751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:44.318751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:44.318751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:44.318751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:25:44.318751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:25:44.318751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:25:44.318751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:25:44.318751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:25:44.318751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:25:44.318751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 06:25:44.318751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:44.318751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 542/1089] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Sep 13 06:25:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:44.323119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e8ff9-a365-49ea-b348-99b1b90437c0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:44.337036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:44.353138 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c4ee2-7d05-42a7-b174-14bf7e438442 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:44.388048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43a9ee-c7ca-43e4-9f12-0834549d5e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:44.388680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43a9ee-c7ca-43e4-9f12-0834549d5e41 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:44.388970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43a9ee-c7ca-43e4-9f12-0834549d5e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:44.389245 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa43a9ee-c7ca-43e4-9f12-0834549d5e41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:44.399163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa43a9ee-c7ca-43e4-9f12-0834549d5e41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-aa43a9ee-c7ca-43e4-9f12-0834549d5e41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:25:44.403952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:44.405131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:44.406206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:44.406206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:44.406206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:44.406206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:44.406206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:25:44.406206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:25:44.406206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:25:44.406206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:25:44.406206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:25:44.406206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:25:44.406206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:25:44.406206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:44.406206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 548/1090] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:25:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:44.411055 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43a9ee-c7ca-43e4-9f12-0834549d5e41 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:44.422914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e8ff9-a365-49ea-b348-99b1b90437c0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:44.442548 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:44.456784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674ae35-164d-46e7-a85a-fb9c1965cf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:44.457389 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674ae35-164d-46e7-a85a-fb9c1965cf72 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:44.457695 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674ae35-164d-46e7-a85a-fb9c1965cf72 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:44.457942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674ae35-164d-46e7-a85a-fb9c1965cf72 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:44.458596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674ae35-164d-46e7-a85a-fb9c1965cf72 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:44.458898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674ae35-164d-46e7-a85a-fb9c1965cf72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:44.460245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674ae35-164d-46e7-a85a-fb9c1965cf72 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:44.467925 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 543/1091] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Sep 13 06:25:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:44.473623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674ae35-164d-46e7-a85a-fb9c1965cf72 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:44.512781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa43a9ee-c7ca-43e4-9f12-0834549d5e41 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:44.546853 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfe9de-ff4d-4cc1-8d9d-c12115a34a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:44.547458 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfe9de-ff4d-4cc1-8d9d-c12115a34a90 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:44.547736 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfe9de-ff4d-4cc1-8d9d-c12115a34a90 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:44.548013 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfe9de-ff4d-4cc1-8d9d-c12115a34a90 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:44.548689 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfe9de-ff4d-4cc1-8d9d-c12115a34a90 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:44.549007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfe9de-ff4d-4cc1-8d9d-c12115a34a90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:44.550365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfe9de-ff4d-4cc1-8d9d-c12115a34a90 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:44.558691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 549/1092] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:25:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:44.564635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfe9de-ff4d-4cc1-8d9d-c12115a34a90 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:44.573317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:44.573471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674ae35-164d-46e7-a85a-fb9c1965cf72 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:44.606395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcc920-9f06-4e1b-a40b-af3330764ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:44.607021 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcc920-9f06-4e1b-a40b-af3330764ea2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:44.607297 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcc920-9f06-4e1b-a40b-af3330764ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:44.607569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcc920-9f06-4e1b-a40b-af3330764ea2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:44.617957 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcc920-9f06-4e1b-a40b-af3330764ea2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:44.619379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcc920-9f06-4e1b-a40b-af3330764ea2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-8cfcc920-9f06-4e1b-a40b-af3330764ea2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:44.634285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:44.635337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:44.636265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:44.636265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:44.636265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:44.636265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 544/1093] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:44.643764 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcc920-9f06-4e1b-a40b-af3330764ea2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:44.665658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfe9de-ff4d-4cc1-8d9d-c12115a34a90 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:44.678044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:44.700798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620705b-e106-4c89-affd-e1a6fc5debf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:44.701423 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620705b-e106-4c89-affd-e1a6fc5debf2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:44.701698 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620705b-e106-4c89-affd-e1a6fc5debf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:44.701966 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620705b-e106-4c89-affd-e1a6fc5debf2 None admin] PATH_INFO: `/v3/users/f07731609a894b59a798f66838a818ed` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:44.703077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620705b-e106-4c89-affd-e1a6fc5debf2 None admin] RBAC: Authorizing `identity:get_user(user_id=f07731609a894b59a798f66838a818ed)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:44.704490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620705b-e106-4c89-affd-e1a6fc5debf2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:44.706083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 550/1094] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:25:44 2022] GET /identity/v3/users/f07731609a894b59a798f66838a818ed => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:44.711782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620705b-e106-4c89-affd-e1a6fc5debf2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:44.746877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcc920-9f06-4e1b-a40b-af3330764ea2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:44.779577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6223d-9fad-4eb8-9ccc-8259aa9f9470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:44.780178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6223d-9fad-4eb8-9ccc-8259aa9f9470 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:44.780454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6223d-9fad-4eb8-9ccc-8259aa9f9470 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:44.780751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe6223d-9fad-4eb8-9ccc-8259aa9f9470 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:44.781380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6223d-9fad-4eb8-9ccc-8259aa9f9470 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:44.781678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6223d-9fad-4eb8-9ccc-8259aa9f9470 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:44.783019 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe6223d-9fad-4eb8-9ccc-8259aa9f9470 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:44.785007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:44.796018 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 545/1095] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:44.801599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6223d-9fad-4eb8-9ccc-8259aa9f9470 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:44.813010 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620705b-e106-4c89-affd-e1a6fc5debf2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:44.845824 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e63903-da1f-4b63-a5aa-861dcaf4cc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:44.846411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e63903-da1f-4b63-a5aa-861dcaf4cc85 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:44.846684 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e63903-da1f-4b63-a5aa-861dcaf4cc85 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:44.846959 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e63903-da1f-4b63-a5aa-861dcaf4cc85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:44.894714 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:44.901651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe6223d-9fad-4eb8-9ccc-8259aa9f9470 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:44.914730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e63903-da1f-4b63-a5aa-861dcaf4cc85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:44.916178 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e63903-da1f-4b63-a5aa-861dcaf4cc85 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:44.934805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873b331-622b-421f-86b6-54c04109b0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:44.935360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873b331-622b-421f-86b6-54c04109b0aa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:44.935640 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873b331-622b-421f-86b6-54c04109b0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:44.935910 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e873b331-622b-421f-86b6-54c04109b0aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:44.942742 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873b331-622b-421f-86b6-54c04109b0aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:44.944148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e873b331-622b-421f-86b6-54c04109b0aa None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e873b331-622b-421f-86b6-54c04109b0aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:25:44.955979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:44.956974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:44.958218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:44.958218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:44.958218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:25:44.958218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:25:44.958218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:25:44.958218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:25:44.958218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:25:44.958218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:25:44.958218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 06:25:44.958218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:25:44.958218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 546/1096] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 13 06:25:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:25:44.962788 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873b331-622b-421f-86b6-54c04109b0aa None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:44.991257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:45.016722 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 551/1097] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:25:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 06:25:45.022566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e63903-da1f-4b63-a5aa-861dcaf4cc85 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:45.060775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e873b331-622b-421f-86b6-54c04109b0aa None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:45.094133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd4551-1bc9-4267-bb00-806778e62bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:45.094730 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd4551-1bc9-4267-bb00-806778e62bee None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:45.095013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd4551-1bc9-4267-bb00-806778e62bee None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:45.095289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cd4551-1bc9-4267-bb00-806778e62bee None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:45.096012 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd4551-1bc9-4267-bb00-806778e62bee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:45.096320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd4551-1bc9-4267-bb00-806778e62bee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:45.097782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cd4551-1bc9-4267-bb00-806778e62bee None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:45.114498 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 547/1098] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 13 06:25:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:45.118607 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e63903-da1f-4b63-a5aa-861dcaf4cc85 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:45.120167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd4551-1bc9-4267-bb00-806778e62bee None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:45.133955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:45.153353 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16532e4-1f08-4906-8b6d-eec4b6b8514e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:45.153974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16532e4-1f08-4906-8b6d-eec4b6b8514e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:45.154264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16532e4-1f08-4906-8b6d-eec4b6b8514e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:45.154514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16532e4-1f08-4906-8b6d-eec4b6b8514e None admin] PATH_INFO: `/v3/projects/1a903a4facb147cc90a96e4d437316be` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:45.155619 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16532e4-1f08-4906-8b6d-eec4b6b8514e None admin] RBAC: Authorizing `identity:get_project(project_id=1a903a4facb147cc90a96e4d437316be)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:45.157040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16532e4-1f08-4906-8b6d-eec4b6b8514e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:45.158640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 552/1099] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:25:45 2022] GET /identity/v3/projects/1a903a4facb147cc90a96e4d437316be => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:45.164493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16532e4-1f08-4906-8b6d-eec4b6b8514e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:45.205407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:45.220684 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cd4551-1bc9-4267-bb00-806778e62bee None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:45.261737 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16532e4-1f08-4906-8b6d-eec4b6b8514e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:45.263205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf9747-44e9-4417-97d0-3c3e239cae2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:45.263809 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf9747-44e9-4417-97d0-3c3e239cae2f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:45.264097 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf9747-44e9-4417-97d0-3c3e239cae2f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:45.264367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaf9747-44e9-4417-97d0-3c3e239cae2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:45.295060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de779d0-2a64-4509-b7bd-bc59bdd1f06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:45.295641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de779d0-2a64-4509-b7bd-bc59bdd1f06a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:45.295945 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de779d0-2a64-4509-b7bd-bc59bdd1f06a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:45.296214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de779d0-2a64-4509-b7bd-bc59bdd1f06a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:45.296952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de779d0-2a64-4509-b7bd-bc59bdd1f06a None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=1a903a4facb147cc90a96e4d437316be, user.id=f07731609a894b59a798f66838a818ed) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:45.297258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de779d0-2a64-4509-b7bd-bc59bdd1f06a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:45.298664 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de779d0-2a64-4509-b7bd-bc59bdd1f06a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:45.304572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 553/1100] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:25:45 2022] GET /identity/v3/role_assignments?user.id=f07731609a894b59a798f66838a818ed&scope.project.id=1a903a4facb147cc90a96e4d437316be&role.id=6382a06103714d068409d25cbeb48744 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:45.332002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf9747-44e9-4417-97d0-3c3e239cae2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:45.333527 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaf9747-44e9-4417-97d0-3c3e239cae2f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:45.351996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:45.441783 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 548/1101] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:25:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 06:25:45.447689 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de779d0-2a64-4509-b7bd-bc59bdd1f06a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:45.554462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de779d0-2a64-4509-b7bd-bc59bdd1f06a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:45.562037 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:45.590692 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883525e-385f-4402-8086-6418e1d59711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:45.591313 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883525e-385f-4402-8086-6418e1d59711 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:45.591591 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883525e-385f-4402-8086-6418e1d59711 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:45.591865 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9883525e-385f-4402-8086-6418e1d59711 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:45.602001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883525e-385f-4402-8086-6418e1d59711 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:45.603429 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9883525e-385f-4402-8086-6418e1d59711 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-9883525e-385f-4402-8086-6418e1d59711 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:25:45.618691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:45.619629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:25:45.620570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:25:45.620570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:25:45.620570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:45.626046 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 554/1102] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:45.626207 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf9747-44e9-4417-97d0-3c3e239cae2f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:45.723338 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaf9747-44e9-4417-97d0-3c3e239cae2f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:45.735939 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:45.756653 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d765e1-12b6-4856-98ee-04a7c22528ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:45.757272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d765e1-12b6-4856-98ee-04a7c22528ee None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:45.757549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d765e1-12b6-4856-98ee-04a7c22528ee None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:45.757819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d765e1-12b6-4856-98ee-04a7c22528ee None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:45.758454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d765e1-12b6-4856-98ee-04a7c22528ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:45.758781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d765e1-12b6-4856-98ee-04a7c22528ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:45.760147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d765e1-12b6-4856-98ee-04a7c22528ee None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:45.771621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 549/1103] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:45.777284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883525e-385f-4402-8086-6418e1d59711 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:45.882258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9883525e-385f-4402-8086-6418e1d59711 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:45.915409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f74c3d-ecd0-404b-b724-aea4d3dd3425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:45.916024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f74c3d-ecd0-404b-b724-aea4d3dd3425 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:45.916294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f74c3d-ecd0-404b-b724-aea4d3dd3425 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:45.916557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f74c3d-ecd0-404b-b724-aea4d3dd3425 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:45.922984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f74c3d-ecd0-404b-b724-aea4d3dd3425 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:45.924406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f74c3d-ecd0-404b-b724-aea4d3dd3425 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:45.935163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-08f74c3d-ecd0-404b-b724-aea4d3dd3425 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:45.935163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:25:45.935163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:25:45.935163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:25:45.935163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:25:45.935163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:25:45.935163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:25:45.935163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:25:45.935163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:25:45.935163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:25:45.935163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:25:45.935163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:25:45.935163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:25:45.935163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:25:45.935163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:25:45.941202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:25:45.942432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:25:45.942432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:25:45.942432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:25:45.942432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:25:45.942432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:25:45.942432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:25:45.942432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:25:45.942432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:25:45.942432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 555/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:25:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:25:45.943289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d765e1-12b6-4856-98ee-04a7c22528ee None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:46.044506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d765e1-12b6-4856-98ee-04a7c22528ee None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:46.078539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68683e3c-f422-45a5-bdb5-199fa02b697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:46.079141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68683e3c-f422-45a5-bdb5-199fa02b697a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:46.079419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68683e3c-f422-45a5-bdb5-199fa02b697a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:46.079686 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68683e3c-f422-45a5-bdb5-199fa02b697a None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:46.080366 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68683e3c-f422-45a5-bdb5-199fa02b697a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:46.080689 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68683e3c-f422-45a5-bdb5-199fa02b697a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:46.082099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68683e3c-f422-45a5-bdb5-199fa02b697a None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:46.093602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 550/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:25:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:46.099601 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f74c3d-ecd0-404b-b724-aea4d3dd3425 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:46.121959 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:46.204836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f74c3d-ecd0-404b-b724-aea4d3dd3425 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:46.237956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363c9c9-bd4e-4339-bf08-30310c0efeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:46.238545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363c9c9-bd4e-4339-bf08-30310c0efeba None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:46.238820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363c9c9-bd4e-4339-bf08-30310c0efeba None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:46.239087 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363c9c9-bd4e-4339-bf08-30310c0efeba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:46.239805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363c9c9-bd4e-4339-bf08-30310c0efeba None admin] RBAC: Adding query filter params (role.id=fd480c5e32754513a580f7d7c11deaab, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=7fbb67072ba544e39073787eb25fcf1e) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:46.240108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363c9c9-bd4e-4339-bf08-30310c0efeba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:46.241548 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363c9c9-bd4e-4339-bf08-30310c0efeba None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:46.247918 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 556/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:25:46 2022] GET /identity/v3/role_assignments?user.id=7fbb67072ba544e39073787eb25fcf1e&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=fd480c5e32754513a580f7d7c11deaab => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:47.470436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d2d99-9428-4759-9e15-f2ff8655f312 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:47.470995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d2d99-9428-4759-9e15-f2ff8655f312 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:47.470995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d2d99-9428-4759-9e15-f2ff8655f312 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:47.472284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 551/1107] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:47.477351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aeb4f-9703-4a46-b7b8-2e876de80ccd None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:47.477760 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aeb4f-9703-4a46-b7b8-2e876de80ccd None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:47.477896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867aeb4f-9703-4a46-b7b8-2e876de80ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:47.497004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-867aeb4f-9703-4a46-b7b8-2e876de80ccd None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:47.498188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-867aeb4f-9703-4a46-b7b8-2e876de80ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:47.561848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 557/1108] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:47.833710 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d2d99-9428-4759-9e15-f2ff8655f312 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:47.863370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:47.931210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d2d99-9428-4759-9e15-f2ff8655f312 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:47.963582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db93786f-668c-4acb-bc1d-6f9036931d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:47.964183 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93786f-668c-4acb-bc1d-6f9036931d1e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:47.964455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93786f-668c-4acb-bc1d-6f9036931d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:47.964745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db93786f-668c-4acb-bc1d-6f9036931d1e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:47.965853 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93786f-668c-4acb-bc1d-6f9036931d1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:47.967249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db93786f-668c-4acb-bc1d-6f9036931d1e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:47.968787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 552/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:25:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:47.974490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867aeb4f-9703-4a46-b7b8-2e876de80ccd None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:47.988821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:48.071859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867aeb4f-9703-4a46-b7b8-2e876de80ccd None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:48.105114 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6606e22d-1619-4377-8a66-dfea799baf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:48.106149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606e22d-1619-4377-8a66-dfea799baf29 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:48.106401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606e22d-1619-4377-8a66-dfea799baf29 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:48.106673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6606e22d-1619-4377-8a66-dfea799baf29 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:48.107312 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606e22d-1619-4377-8a66-dfea799baf29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:48.108753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6606e22d-1619-4377-8a66-dfea799baf29 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:48.129625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 558/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:25:47 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:25:50.272155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c7637-ec2f-45db-a347-862703687eff None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:50.272711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c7637-ec2f-45db-a347-862703687eff None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:50.272711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c7637-ec2f-45db-a347-862703687eff None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:50.274058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 553/1111] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:50.279787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ae1fc-80eb-4cc3-b7cd-31a09e7d7998 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:50.280213 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ae1fc-80eb-4cc3-b7cd-31a09e7d7998 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:50.280324 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603ae1fc-80eb-4cc3-b7cd-31a09e7d7998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:50.298173 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-603ae1fc-80eb-4cc3-b7cd-31a09e7d7998 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:50.299358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-603ae1fc-80eb-4cc3-b7cd-31a09e7d7998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:50.363494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:50.369714 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 559/1112] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:50.637863 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c7637-ec2f-45db-a347-862703687eff None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:50.732727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:50.736621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6c7637-ec2f-45db-a347-862703687eff None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:50.770994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bbe6e-f35b-4b42-9383-c6fae3636758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:50.772019 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bbe6e-f35b-4b42-9383-c6fae3636758 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:50.772517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bbe6e-f35b-4b42-9383-c6fae3636758 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:50.773058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6bbe6e-f35b-4b42-9383-c6fae3636758 None admin] PATH_INFO: `/v3/roles/8727ddb8ab8e4ae4bf2145352def3fb6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:50.775485 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bbe6e-f35b-4b42-9383-c6fae3636758 None admin] RBAC: Authorizing `identity:get_role(role_id=8727ddb8ab8e4ae4bf2145352def3fb6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:50.776920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6bbe6e-f35b-4b42-9383-c6fae3636758 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:50.778280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 554/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:25:50 2022] GET /identity/v3/roles/8727ddb8ab8e4ae4bf2145352def3fb6 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:50.784035 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ae1fc-80eb-4cc3-b7cd-31a09e7d7998 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:50.879561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603ae1fc-80eb-4cc3-b7cd-31a09e7d7998 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:50.912778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624555e-2854-449b-84ca-9df21fae7c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:50.913389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624555e-2854-449b-84ca-9df21fae7c51 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:50.913666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624555e-2854-449b-84ca-9df21fae7c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:50.913936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624555e-2854-449b-84ca-9df21fae7c51 None admin] PATH_INFO: `/v3/users/45158999e86a45818f78c9c7abe5fc0e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:50.926916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624555e-2854-449b-84ca-9df21fae7c51 None admin] RBAC: Authorizing `identity:get_user(user_id=45158999e86a45818f78c9c7abe5fc0e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:50.928349 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624555e-2854-449b-84ca-9df21fae7c51 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:50.929944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 560/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:25:50 2022] GET /identity/v3/users/45158999e86a45818f78c9c7abe5fc0e => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:50.936418 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bbe6e-f35b-4b42-9383-c6fae3636758 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:51.031321 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6bbe6e-f35b-4b42-9383-c6fae3636758 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:51.063934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7b577-e926-4a82-ab6d-094f6113fea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:51.064516 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7b577-e926-4a82-ab6d-094f6113fea2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:51.064826 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7b577-e926-4a82-ab6d-094f6113fea2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:51.065099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f7b577-e926-4a82-ab6d-094f6113fea2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:51.098681 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:51.132378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7b577-e926-4a82-ab6d-094f6113fea2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:51.133852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f7b577-e926-4a82-ab6d-094f6113fea2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:51.228609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 555/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:25:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:25:51.234604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624555e-2854-449b-84ca-9df21fae7c51 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:51.289478 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:51.332289 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624555e-2854-449b-84ca-9df21fae7c51 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:51.365052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af85d35-c711-47f3-ba05-37345ad530c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:51.365667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af85d35-c711-47f3-ba05-37345ad530c3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:51.365948 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af85d35-c711-47f3-ba05-37345ad530c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:51.366222 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af85d35-c711-47f3-ba05-37345ad530c3 None admin] PATH_INFO: `/v3/projects/1a903a4facb147cc90a96e4d437316be` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:51.367328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af85d35-c711-47f3-ba05-37345ad530c3 None admin] RBAC: Authorizing `identity:get_project(project_id=1a903a4facb147cc90a96e4d437316be)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:51.368778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af85d35-c711-47f3-ba05-37345ad530c3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:51.370377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 561/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:25:51 2022] GET /identity/v3/projects/1a903a4facb147cc90a96e4d437316be => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:51.377248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7b577-e926-4a82-ab6d-094f6113fea2 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:51.442944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:51.479072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f7b577-e926-4a82-ab6d-094f6113fea2 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:51.512732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64d3d5-53df-4216-8332-af8688e19918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:51.513333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64d3d5-53df-4216-8332-af8688e19918 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:51.513610 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64d3d5-53df-4216-8332-af8688e19918 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:51.513880 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64d3d5-53df-4216-8332-af8688e19918 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:51.514599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64d3d5-53df-4216-8332-af8688e19918 None admin] RBAC: Adding query filter params (role.id=8727ddb8ab8e4ae4bf2145352def3fb6, scope.project.id=1a903a4facb147cc90a96e4d437316be, user.id=45158999e86a45818f78c9c7abe5fc0e) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:51.514908 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64d3d5-53df-4216-8332-af8688e19918 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:51.516319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64d3d5-53df-4216-8332-af8688e19918 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:51.521509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 556/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:25:51 2022] GET /identity/v3/role_assignments?user.id=45158999e86a45818f78c9c7abe5fc0e&scope.project.id=1a903a4facb147cc90a96e4d437316be&role.id=8727ddb8ab8e4ae4bf2145352def3fb6 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:53.613177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e85c39-1e1e-4b43-beea-b5e14c8b548a None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:53.613712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e85c39-1e1e-4b43-beea-b5e14c8b548a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:53.613712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e85c39-1e1e-4b43-beea-b5e14c8b548a None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:53.615030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 562/1118] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:53.620183 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf5922-a99e-45df-8c5a-2b8eb6971d07 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:53.620586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf5922-a99e-45df-8c5a-2b8eb6971d07 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:53.621012 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf5922-a99e-45df-8c5a-2b8eb6971d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:53.638704 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-58bf5922-a99e-45df-8c5a-2b8eb6971d07 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:53.639905 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-58bf5922-a99e-45df-8c5a-2b8eb6971d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:53.705657 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 557/1119] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:25:53.978898 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e85c39-1e1e-4b43-beea-b5e14c8b548a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:54.077590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e85c39-1e1e-4b43-beea-b5e14c8b548a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:54.099820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:54.111220 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b35c87-e210-4576-a957-e40a4fff58d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:54.111828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b35c87-e210-4576-a957-e40a4fff58d0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:54.112103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b35c87-e210-4576-a957-e40a4fff58d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:54.112374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b35c87-e210-4576-a957-e40a4fff58d0 None admin] PATH_INFO: `/v3/roles/8727ddb8ab8e4ae4bf2145352def3fb6` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:54.113788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b35c87-e210-4576-a957-e40a4fff58d0 None admin] RBAC: Authorizing `identity:get_role(role_id=8727ddb8ab8e4ae4bf2145352def3fb6)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:54.115135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b35c87-e210-4576-a957-e40a4fff58d0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:54.116420 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 563/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:25:53 2022] GET /identity/v3/roles/8727ddb8ab8e4ae4bf2145352def3fb6 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:54.122948 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf5922-a99e-45df-8c5a-2b8eb6971d07 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:54.180160 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:54.217614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf5922-a99e-45df-8c5a-2b8eb6971d07 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:54.250662 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee5a70-d81b-455e-a926-69ce0b9e4ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:54.251242 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee5a70-d81b-455e-a926-69ce0b9e4ad1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:54.251556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee5a70-d81b-455e-a926-69ce0b9e4ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:54.251834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee5a70-d81b-455e-a926-69ce0b9e4ad1 None admin] PATH_INFO: `/v3/users/45158999e86a45818f78c9c7abe5fc0e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:54.252956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee5a70-d81b-455e-a926-69ce0b9e4ad1 None admin] RBAC: Authorizing `identity:get_user(user_id=45158999e86a45818f78c9c7abe5fc0e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:54.254537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee5a70-d81b-455e-a926-69ce0b9e4ad1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:54.256082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 558/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:25:54 2022] GET /identity/v3/users/45158999e86a45818f78c9c7abe5fc0e => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:25:54.261681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b35c87-e210-4576-a957-e40a4fff58d0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:54.357631 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b35c87-e210-4576-a957-e40a4fff58d0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:54.389393 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266449f-8f96-46d2-946f-2c08144abb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:54.389991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266449f-8f96-46d2-946f-2c08144abb09 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:54.390264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266449f-8f96-46d2-946f-2c08144abb09 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:54.390531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266449f-8f96-46d2-946f-2c08144abb09 None admin] PATH_INFO: `/v3/projects/1a903a4facb147cc90a96e4d437316be` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:54.391614 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266449f-8f96-46d2-946f-2c08144abb09 None admin] RBAC: Authorizing `identity:get_project(project_id=1a903a4facb147cc90a96e4d437316be)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:54.393033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2266449f-8f96-46d2-946f-2c08144abb09 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:54.394601 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 564/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:25:54 2022] GET /identity/v3/projects/1a903a4facb147cc90a96e4d437316be => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:54.400336 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee5a70-d81b-455e-a926-69ce0b9e4ad1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:54.495673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee5a70-d81b-455e-a926-69ce0b9e4ad1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:54.522727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:54.528958 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344ef3f-d197-4056-9c2b-eccbc53c2565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:54.529595 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344ef3f-d197-4056-9c2b-eccbc53c2565 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:54.529874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344ef3f-d197-4056-9c2b-eccbc53c2565 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:54.530146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344ef3f-d197-4056-9c2b-eccbc53c2565 None admin] PATH_INFO: `/v3/projects/1a903a4facb147cc90a96e4d437316be/users/45158999e86a45818f78c9c7abe5fc0e/roles/8727ddb8ab8e4ae4bf2145352def3fb6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:54.532242 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344ef3f-d197-4056-9c2b-eccbc53c2565 None admin] RBAC: Authorizing `identity:create_grant(project_id=1a903a4facb147cc90a96e4d437316be, user_id=45158999e86a45818f78c9c7abe5fc0e, role_id=8727ddb8ab8e4ae4bf2145352def3fb6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:54.533669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344ef3f-d197-4056-9c2b-eccbc53c2565 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:54.545886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 559/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:25:54 2022] PUT /identity/v3/projects/1a903a4facb147cc90a96e4d437316be/users/45158999e86a45818f78c9c7abe5fc0e/roles/8727ddb8ab8e4ae4bf2145352def3fb6 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:25:56.646502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981287f8-9a6a-44c8-b6f5-419f75ec95bb None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:56.646894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981287f8-9a6a-44c8-b6f5-419f75ec95bb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:56.647050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981287f8-9a6a-44c8-b6f5-419f75ec95bb None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:56.648383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 565/1124] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:25:56.653570 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb117107-5b0c-445b-b40f-e763576f31e1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:56.653969 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb117107-5b0c-445b-b40f-e763576f31e1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:56.654113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb117107-5b0c-445b-b40f-e763576f31e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:56.671640 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bb117107-5b0c-445b-b40f-e763576f31e1 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:25:56.672841 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bb117107-5b0c-445b-b40f-e763576f31e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:25:56.737064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 560/1125] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:25:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:25:56.999997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981287f8-9a6a-44c8-b6f5-419f75ec95bb None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:57.057438 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:57.097733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981287f8-9a6a-44c8-b6f5-419f75ec95bb None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:57.130662 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebdedf-2924-4662-a400-3c3972b12175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:57.131264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebdedf-2924-4662-a400-3c3972b12175 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:57.131535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebdedf-2924-4662-a400-3c3972b12175 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:57.131802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ebdedf-2924-4662-a400-3c3972b12175 None admin] PATH_INFO: `/v3/roles/8727ddb8ab8e4ae4bf2145352def3fb6` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:57.133186 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebdedf-2924-4662-a400-3c3972b12175 None admin] RBAC: Authorizing `identity:get_role(role_id=8727ddb8ab8e4ae4bf2145352def3fb6)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:57.134527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ebdedf-2924-4662-a400-3c3972b12175 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:57.135807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 566/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:25:56 2022] GET /identity/v3/roles/8727ddb8ab8e4ae4bf2145352def3fb6 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:57.142025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb117107-5b0c-445b-b40f-e763576f31e1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:57.236422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb117107-5b0c-445b-b40f-e763576f31e1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:57.255926 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:57.270760 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a501714-9d3a-4b65-b2dd-77e827b8e6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:57.271378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a501714-9d3a-4b65-b2dd-77e827b8e6d5 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:57.271658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a501714-9d3a-4b65-b2dd-77e827b8e6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:57.271933 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a501714-9d3a-4b65-b2dd-77e827b8e6d5 None admin] PATH_INFO: `/v3/users/45158999e86a45818f78c9c7abe5fc0e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:57.273102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a501714-9d3a-4b65-b2dd-77e827b8e6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=45158999e86a45818f78c9c7abe5fc0e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:57.274506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a501714-9d3a-4b65-b2dd-77e827b8e6d5 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:57.276059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 561/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:25:57 2022] GET /identity/v3/users/45158999e86a45818f78c9c7abe5fc0e => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:57.281579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebdedf-2924-4662-a400-3c3972b12175 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:57.380206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ebdedf-2924-4662-a400-3c3972b12175 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:57.405838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:57.413721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa2fbb-7c14-4f07-a64b-980e70e25f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:57.414305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa2fbb-7c14-4f07-a64b-980e70e25f40 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:57.414578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa2fbb-7c14-4f07-a64b-980e70e25f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:57.414843 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa2fbb-7c14-4f07-a64b-980e70e25f40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:57.482617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa2fbb-7c14-4f07-a64b-980e70e25f40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:57.484052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfa2fbb-7c14-4f07-a64b-980e70e25f40 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:57.576475 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 567/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:25:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:25:57.582311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a501714-9d3a-4b65-b2dd-77e827b8e6d5 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:57.677773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a501714-9d3a-4b65-b2dd-77e827b8e6d5 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:57.710277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d95580-f5ba-4c68-bb3f-716da76eb2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:57.710898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d95580-f5ba-4c68-bb3f-716da76eb2d2 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:57.711177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d95580-f5ba-4c68-bb3f-716da76eb2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:57.711445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d95580-f5ba-4c68-bb3f-716da76eb2d2 None admin] PATH_INFO: `/v3/projects/1a903a4facb147cc90a96e4d437316be` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:57.712554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d95580-f5ba-4c68-bb3f-716da76eb2d2 None admin] RBAC: Authorizing `identity:get_project(project_id=1a903a4facb147cc90a96e4d437316be)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:57.713999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d95580-f5ba-4c68-bb3f-716da76eb2d2 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:57.716156 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 562/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:25:57 2022] GET /identity/v3/projects/1a903a4facb147cc90a96e4d437316be => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:57.722177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa2fbb-7c14-4f07-a64b-980e70e25f40 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:25:57.748932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:25:57.818590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa2fbb-7c14-4f07-a64b-980e70e25f40 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:25:57.852041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98301206-ad11-4ed7-b8cf-f84ddc20447d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:25:57.852567 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98301206-ad11-4ed7-b8cf-f84ddc20447d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:57.852877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98301206-ad11-4ed7-b8cf-f84ddc20447d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:57.853149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98301206-ad11-4ed7-b8cf-f84ddc20447d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:57.853860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98301206-ad11-4ed7-b8cf-f84ddc20447d None admin] RBAC: Adding query filter params (role.id=8727ddb8ab8e4ae4bf2145352def3fb6, scope.project.id=1a903a4facb147cc90a96e4d437316be, user.id=45158999e86a45818f78c9c7abe5fc0e) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:25:57.854165 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98301206-ad11-4ed7-b8cf-f84ddc20447d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:25:57.855642 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98301206-ad11-4ed7-b8cf-f84ddc20447d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:25:57.861196 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 568/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:25:57 2022] GET /identity/v3/role_assignments?user.id=45158999e86a45818f78c9c7abe5fc0e&scope.project.id=1a903a4facb147cc90a96e4d437316be&role.id=8727ddb8ab8e4ae4bf2145352def3fb6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:25:59.997871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3ef67-58af-47bc-9cdf-cfef1527155f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:25:59.998398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3ef67-58af-47bc-9cdf-cfef1527155f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:25:59.998398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3ef67-58af-47bc-9cdf-cfef1527155f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:25:59.999758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 563/1131] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:25:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:26:00.004842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85701f-6dd3-4a51-bf60-c5792552203f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:00.005305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85701f-6dd3-4a51-bf60-c5792552203f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:00.005421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a85701f-6dd3-4a51-bf60-c5792552203f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:00.022918 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-4a85701f-6dd3-4a51-bf60-c5792552203f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:26:00.024087 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4a85701f-6dd3-4a51-bf60-c5792552203f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:26:00.087156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 569/1132] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:26:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:26:00.352285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3ef67-58af-47bc-9cdf-cfef1527155f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:00.409930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:00.452800 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3ef67-58af-47bc-9cdf-cfef1527155f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:00.486718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47956d3-9173-45e9-a4d3-0dfcc1430908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:00.487332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47956d3-9173-45e9-a4d3-0dfcc1430908 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:00.487611 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47956d3-9173-45e9-a4d3-0dfcc1430908 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:00.487883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47956d3-9173-45e9-a4d3-0dfcc1430908 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:00.489010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47956d3-9173-45e9-a4d3-0dfcc1430908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:00.490416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47956d3-9173-45e9-a4d3-0dfcc1430908 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:00.491957 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 564/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:26:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:00.498231 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85701f-6dd3-4a51-bf60-c5792552203f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:00.520871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:00.593728 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a85701f-6dd3-4a51-bf60-c5792552203f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:00.626625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14208e8b-b7df-4eba-b82d-9a27ffe8c768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:00.627162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14208e8b-b7df-4eba-b82d-9a27ffe8c768 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:00.627441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14208e8b-b7df-4eba-b82d-9a27ffe8c768 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:00.627713 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14208e8b-b7df-4eba-b82d-9a27ffe8c768 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:00.628368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14208e8b-b7df-4eba-b82d-9a27ffe8c768 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:00.629817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14208e8b-b7df-4eba-b82d-9a27ffe8c768 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:00.656538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 570/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 13 06:26:00 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:26:02.826407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ba13c-3dc2-404b-84e9-bda83e3462a7 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:02.826958 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ba13c-3dc2-404b-84e9-bda83e3462a7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:02.826958 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9ba13c-3dc2-404b-84e9-bda83e3462a7 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:02.828284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 565/1135] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:26:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:26:02.833733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a41ea-de14-4a4d-a8d3-823468f1cecf None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:02.834165 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a41ea-de14-4a4d-a8d3-823468f1cecf None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:02.834281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a41ea-de14-4a4d-a8d3-823468f1cecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:02.852349 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-185a41ea-de14-4a4d-a8d3-823468f1cecf None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:26:02.853586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-185a41ea-de14-4a4d-a8d3-823468f1cecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:26:02.919327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 571/1136] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:26:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:26:03.185488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ba13c-3dc2-404b-84e9-bda83e3462a7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:03.290567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9ba13c-3dc2-404b-84e9-bda83e3462a7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:03.313528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:03.325375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964c05e-e386-456c-9308-6f7498a7a716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:03.325995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964c05e-e386-456c-9308-6f7498a7a716 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:03.326274 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964c05e-e386-456c-9308-6f7498a7a716 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:03.326542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964c05e-e386-456c-9308-6f7498a7a716 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:03.327641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964c05e-e386-456c-9308-6f7498a7a716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:03.329084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964c05e-e386-456c-9308-6f7498a7a716 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:03.330636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 566/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:26:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:03.336367 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a41ea-de14-4a4d-a8d3-823468f1cecf None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:03.339440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:03.434804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a41ea-de14-4a4d-a8d3-823468f1cecf None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:03.469391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05608f16-ef26-4a7e-baf1-7e256ce3367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:03.469919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05608f16-ef26-4a7e-baf1-7e256ce3367b None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:03.470199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05608f16-ef26-4a7e-baf1-7e256ce3367b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:03.470473 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05608f16-ef26-4a7e-baf1-7e256ce3367b None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:03.471131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05608f16-ef26-4a7e-baf1-7e256ce3367b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:03.472543 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05608f16-ef26-4a7e-baf1-7e256ce3367b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:03.493266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 572/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:26:03 2022] POST /identity/v3/users => generated 286 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:26:05.642808 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d1208-c20f-470f-96f7-29442b11d8b3 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:05.643366 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d1208-c20f-470f-96f7-29442b11d8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:05.643366 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6d1208-c20f-470f-96f7-29442b11d8b3 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:05.644786 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 567/1139] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:26:05.649872 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6a112-7029-49fc-9590-741c6a327641 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:05.650238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6a112-7029-49fc-9590-741c6a327641 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:05.650415 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e6a112-7029-49fc-9590-741c6a327641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:05.669183 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b4e6a112-7029-49fc-9590-741c6a327641 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:26:05.670356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b4e6a112-7029-49fc-9590-741c6a327641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:26:05.724382 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:05.736051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 573/1140] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:26:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:26:06.007972 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d1208-c20f-470f-96f7-29442b11d8b3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:06.103413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6d1208-c20f-470f-96f7-29442b11d8b3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:06.136005 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112c96b-f32e-45fa-930d-414fdd116a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:06.137151 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112c96b-f32e-45fa-930d-414fdd116a53 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:06.137428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112c96b-f32e-45fa-930d-414fdd116a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:06.137696 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112c96b-f32e-45fa-930d-414fdd116a53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:06.147300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112c96b-f32e-45fa-930d-414fdd116a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e112c96b-f32e-45fa-930d-414fdd116a53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:26:06.151974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:26:06.153614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:26:06.154654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:26:06.154654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:26:06.154654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:26:06.154654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:26:06.154654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:26:06.154654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:26:06.154654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:26:06.154654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:26:06.154654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:26:06.154654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:26:06.154654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:26:06.154654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:26:06.154654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 568/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:26:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:26:06.159408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6a112-7029-49fc-9590-741c6a327641 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:06.256238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e6a112-7029-49fc-9590-741c6a327641 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:06.289237 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea4212-94ba-4c79-8e11-23afd4ec1d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:06.289770 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4212-94ba-4c79-8e11-23afd4ec1d53 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:06.290050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4212-94ba-4c79-8e11-23afd4ec1d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:06.290322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ea4212-94ba-4c79-8e11-23afd4ec1d53 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:06.290984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea4212-94ba-4c79-8e11-23afd4ec1d53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:26:06.291288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea4212-94ba-4c79-8e11-23afd4ec1d53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:06.292635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ea4212-94ba-4c79-8e11-23afd4ec1d53 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:06.300517 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 574/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:26:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:06.306461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112c96b-f32e-45fa-930d-414fdd116a53 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:06.358621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:06.404526 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112c96b-f32e-45fa-930d-414fdd116a53 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:06.437536 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2df82-d599-442a-b0be-b6dc6cc6797f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:06.438139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2df82-d599-442a-b0be-b6dc6cc6797f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:06.438415 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2df82-d599-442a-b0be-b6dc6cc6797f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:06.438682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d2df82-d599-442a-b0be-b6dc6cc6797f None admin] PATH_INFO: `/v3/users/7b4fed8b4b294097bc8140a935375485` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:06.451617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2df82-d599-442a-b0be-b6dc6cc6797f None admin] RBAC: Authorizing `identity:get_user(user_id=7b4fed8b4b294097bc8140a935375485)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:06.453090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d2df82-d599-442a-b0be-b6dc6cc6797f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:06.454650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 569/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:26:06 2022] GET /identity/v3/users/7b4fed8b4b294097bc8140a935375485 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:06.460403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea4212-94ba-4c79-8e11-23afd4ec1d53 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:06.511513 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:06.557881 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ea4212-94ba-4c79-8e11-23afd4ec1d53 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:06.590855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59396ee2-c3bf-4818-a1d5-37a20267cfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:06.591446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59396ee2-c3bf-4818-a1d5-37a20267cfc1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:06.591722 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59396ee2-c3bf-4818-a1d5-37a20267cfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:06.591992 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59396ee2-c3bf-4818-a1d5-37a20267cfc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:06.657116 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59396ee2-c3bf-4818-a1d5-37a20267cfc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:06.658577 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59396ee2-c3bf-4818-a1d5-37a20267cfc1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:06.707862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:06.754336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 575/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:26:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:26:06.760410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2df82-d599-442a-b0be-b6dc6cc6797f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:06.856124 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d2df82-d599-442a-b0be-b6dc6cc6797f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:06.872712 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:06.898570 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121381a-1178-44c7-b006-0981b1e3a0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:06.899305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121381a-1178-44c7-b006-0981b1e3a0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:06.899578 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121381a-1178-44c7-b006-0981b1e3a0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:06.899843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121381a-1178-44c7-b006-0981b1e3a0d3 None admin] PATH_INFO: `/v3/projects/9b4db16a5f824d1a832718abbdabfccf` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:06.901102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121381a-1178-44c7-b006-0981b1e3a0d3 None admin] RBAC: Authorizing `identity:get_project(project_id=9b4db16a5f824d1a832718abbdabfccf)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:06.902795 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121381a-1178-44c7-b006-0981b1e3a0d3 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:06.904593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 570/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:26:06 2022] GET /identity/v3/projects/9b4db16a5f824d1a832718abbdabfccf => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:06.910763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59396ee2-c3bf-4818-a1d5-37a20267cfc1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:07.006541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59396ee2-c3bf-4818-a1d5-37a20267cfc1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:07.038935 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388f30f-10f1-456e-a141-aa16f9964f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:07.039509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388f30f-10f1-456e-a141-aa16f9964f95 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:07.039804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388f30f-10f1-456e-a141-aa16f9964f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:07.040080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388f30f-10f1-456e-a141-aa16f9964f95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:07.040909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388f30f-10f1-456e-a141-aa16f9964f95 None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=9b4db16a5f824d1a832718abbdabfccf, user.id=7b4fed8b4b294097bc8140a935375485) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:26:07.041212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388f30f-10f1-456e-a141-aa16f9964f95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:07.042685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388f30f-10f1-456e-a141-aa16f9964f95 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:07.048319 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 576/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:26:06 2022] GET /identity/v3/role_assignments?user.id=7b4fed8b4b294097bc8140a935375485&scope.project.id=9b4db16a5f824d1a832718abbdabfccf&role.id=6382a06103714d068409d25cbeb48744 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:09.141416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa021e2-c8ed-4485-b6dd-1fd4bc571563 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:09.141951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa021e2-c8ed-4485-b6dd-1fd4bc571563 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:09.141951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa021e2-c8ed-4485-b6dd-1fd4bc571563 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:09.143285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 571/1147] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:26:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:26:09.148300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb2eea-8e78-4824-8b44-438b1880eb6f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:09.148688 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb2eea-8e78-4824-8b44-438b1880eb6f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:09.148869 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb2eea-8e78-4824-8b44-438b1880eb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:09.166415 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-49bb2eea-8e78-4824-8b44-438b1880eb6f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:26:09.167580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-49bb2eea-8e78-4824-8b44-438b1880eb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:26:09.178486 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:09.232350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 577/1148] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:26:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:26:09.501896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa021e2-c8ed-4485-b6dd-1fd4bc571563 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:09.598774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa021e2-c8ed-4485-b6dd-1fd4bc571563 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:09.631492 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640899-8a9b-4124-8e4b-2a146206f7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:09.632109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640899-8a9b-4124-8e4b-2a146206f7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:09.632390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640899-8a9b-4124-8e4b-2a146206f7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:09.632661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640899-8a9b-4124-8e4b-2a146206f7e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:09.643053 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64640899-8a9b-4124-8e4b-2a146206f7e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-64640899-8a9b-4124-8e4b-2a146206f7e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:26:09.647816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:26:09.648912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:26:09.649937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:26:09.649937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:26:09.649937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:26:09.649937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:26:09.649937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:26:09.649937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:26:09.649937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:26:09.649937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:26:09.649937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:26:09.649937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:26:09.649937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:26:09.649937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:26:09.649937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 572/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:26:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:26:09.655455 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb2eea-8e78-4824-8b44-438b1880eb6f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:09.749557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb2eea-8e78-4824-8b44-438b1880eb6f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:09.782004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fb01b-0f0b-4c0f-bdb2-aff0e282748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:09.782534 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fb01b-0f0b-4c0f-bdb2-aff0e282748a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:09.782810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fb01b-0f0b-4c0f-bdb2-aff0e282748a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:09.783080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fb01b-0f0b-4c0f-bdb2-aff0e282748a None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:09.783729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fb01b-0f0b-4c0f-bdb2-aff0e282748a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:26:09.784026 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fb01b-0f0b-4c0f-bdb2-aff0e282748a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:09.785394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fb01b-0f0b-4c0f-bdb2-aff0e282748a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:09.793119 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 578/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:26:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:09.798794 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640899-8a9b-4124-8e4b-2a146206f7e4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:09.838471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:09.896970 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640899-8a9b-4124-8e4b-2a146206f7e4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:09.929484 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7657671-9003-4bb6-8344-c2a2d1871974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:09.930098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7657671-9003-4bb6-8344-c2a2d1871974 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:09.930379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7657671-9003-4bb6-8344-c2a2d1871974 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:09.930652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7657671-9003-4bb6-8344-c2a2d1871974 None admin] PATH_INFO: `/v3/users/7b4fed8b4b294097bc8140a935375485` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:09.931764 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7657671-9003-4bb6-8344-c2a2d1871974 None admin] RBAC: Authorizing `identity:get_user(user_id=7b4fed8b4b294097bc8140a935375485)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:09.933393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7657671-9003-4bb6-8344-c2a2d1871974 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:09.935515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 573/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:26:09 2022] GET /identity/v3/users/7b4fed8b4b294097bc8140a935375485 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:09.941344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fb01b-0f0b-4c0f-bdb2-aff0e282748a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:09.952487 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:10.039166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fb01b-0f0b-4c0f-bdb2-aff0e282748a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:10.071472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc653f9-f653-4dd1-97e6-547e47aff2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:10.072081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc653f9-f653-4dd1-97e6-547e47aff2e5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:10.072357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc653f9-f653-4dd1-97e6-547e47aff2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:10.072628 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc653f9-f653-4dd1-97e6-547e47aff2e5 None admin] PATH_INFO: `/v3/projects/9b4db16a5f824d1a832718abbdabfccf` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:10.073750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc653f9-f653-4dd1-97e6-547e47aff2e5 None admin] RBAC: Authorizing `identity:get_project(project_id=9b4db16a5f824d1a832718abbdabfccf)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:10.075214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc653f9-f653-4dd1-97e6-547e47aff2e5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:10.076821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 579/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:26:09 2022] GET /identity/v3/projects/9b4db16a5f824d1a832718abbdabfccf => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:26:10.082556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7657671-9003-4bb6-8344-c2a2d1871974 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:10.179157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7657671-9003-4bb6-8344-c2a2d1871974 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:10.186693 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:10.213304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe576c0c-0bb7-4f7f-b980-a816160734a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:10.213941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe576c0c-0bb7-4f7f-b980-a816160734a0 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:10.214224 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe576c0c-0bb7-4f7f-b980-a816160734a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:10.214502 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe576c0c-0bb7-4f7f-b980-a816160734a0 None admin] PATH_INFO: `/v3/projects/9b4db16a5f824d1a832718abbdabfccf/users/7b4fed8b4b294097bc8140a935375485/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:10.216421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe576c0c-0bb7-4f7f-b980-a816160734a0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9b4db16a5f824d1a832718abbdabfccf, user_id=7b4fed8b4b294097bc8140a935375485, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:10.217861 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe576c0c-0bb7-4f7f-b980-a816160734a0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:10.230556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 574/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:26:10 2022] PUT /identity/v3/projects/9b4db16a5f824d1a832718abbdabfccf/users/7b4fed8b4b294097bc8140a935375485/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:26:12.327706 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014cfd9-aab9-4db3-a0ac-ed2225452d2e None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:12.328282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014cfd9-aab9-4db3-a0ac-ed2225452d2e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:12.328282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014cfd9-aab9-4db3-a0ac-ed2225452d2e None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:12.329587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 580/1154] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:26:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:26:12.334956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcb891-53bd-45ff-a293-d7633d2329c0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:12.335331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcb891-53bd-45ff-a293-d7633d2329c0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:12.335512 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bcb891-53bd-45ff-a293-d7633d2329c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:12.353839 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-85bcb891-53bd-45ff-a293-d7633d2329c0 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:26:12.355007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-85bcb891-53bd-45ff-a293-d7633d2329c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:26:12.420394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 575/1155] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:26:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:26:12.690508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014cfd9-aab9-4db3-a0ac-ed2225452d2e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:12.767831 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:12.791556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014cfd9-aab9-4db3-a0ac-ed2225452d2e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:12.824484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95907758-30b7-4ac4-a97b-a8179da6877f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:12.825127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95907758-30b7-4ac4-a97b-a8179da6877f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:12.825409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95907758-30b7-4ac4-a97b-a8179da6877f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:12.825679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95907758-30b7-4ac4-a97b-a8179da6877f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:12.835603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95907758-30b7-4ac4-a97b-a8179da6877f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-95907758-30b7-4ac4-a97b-a8179da6877f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:26:12.841394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:26:12.842496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:26:12.843538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:26:12.843538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:26:12.843538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:26:12.843538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:26:12.843538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:26:12.843538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:26:12.843538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:26:12.843538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:26:12.843538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:26:12.843538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:26:12.843538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:26:12.843538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:26:12.843538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 581/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:26:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:26:12.848320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcb891-53bd-45ff-a293-d7633d2329c0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:12.936192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:12.944196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bcb891-53bd-45ff-a293-d7633d2329c0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:12.982113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9dd3a-d329-4014-a054-78fbf95d4e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:12.982716 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9dd3a-d329-4014-a054-78fbf95d4e01 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:12.982996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9dd3a-d329-4014-a054-78fbf95d4e01 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:12.983263 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f9dd3a-d329-4014-a054-78fbf95d4e01 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:12.983916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9dd3a-d329-4014-a054-78fbf95d4e01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:26:12.984215 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9dd3a-d329-4014-a054-78fbf95d4e01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:12.985594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f9dd3a-d329-4014-a054-78fbf95d4e01 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:12.993541 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 576/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:26:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:12.999971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95907758-30b7-4ac4-a97b-a8179da6877f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:13.097809 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95907758-30b7-4ac4-a97b-a8179da6877f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:13.130726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f6770-5bdd-4a3a-a4a0-3de22d12fcc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:13.131332 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f6770-5bdd-4a3a-a4a0-3de22d12fcc7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:13.131610 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f6770-5bdd-4a3a-a4a0-3de22d12fcc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:13.131882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880f6770-5bdd-4a3a-a4a0-3de22d12fcc7 None admin] PATH_INFO: `/v3/users/7b4fed8b4b294097bc8140a935375485` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:13.133027 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f6770-5bdd-4a3a-a4a0-3de22d12fcc7 None admin] RBAC: Authorizing `identity:get_user(user_id=7b4fed8b4b294097bc8140a935375485)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:13.134436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880f6770-5bdd-4a3a-a4a0-3de22d12fcc7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:13.135976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 582/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:26:12 2022] GET /identity/v3/users/7b4fed8b4b294097bc8140a935375485 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:13.141793 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9dd3a-d329-4014-a054-78fbf95d4e01 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:13.236815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f9dd3a-d329-4014-a054-78fbf95d4e01 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:13.268240 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b7635-3bcd-4fa0-97f2-b97396edd14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:13.268848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b7635-3bcd-4fa0-97f2-b97396edd14f None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:13.269127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b7635-3bcd-4fa0-97f2-b97396edd14f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:13.269395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b7635-3bcd-4fa0-97f2-b97396edd14f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:13.294795 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:13.334235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b7635-3bcd-4fa0-97f2-b97396edd14f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:13.335648 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b7635-3bcd-4fa0-97f2-b97396edd14f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:13.428093 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 577/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:26:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 06:26:13.434529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f6770-5bdd-4a3a-a4a0-3de22d12fcc7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:13.438282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:13.530906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880f6770-5bdd-4a3a-a4a0-3de22d12fcc7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:13.563484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1c2f82-82d4-430e-9f0c-3c8ba7a35195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:13.564086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c2f82-82d4-430e-9f0c-3c8ba7a35195 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:13.564358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c2f82-82d4-430e-9f0c-3c8ba7a35195 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:13.564625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1c2f82-82d4-430e-9f0c-3c8ba7a35195 None admin] PATH_INFO: `/v3/projects/9b4db16a5f824d1a832718abbdabfccf` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:13.565740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c2f82-82d4-430e-9f0c-3c8ba7a35195 None admin] RBAC: Authorizing `identity:get_project(project_id=9b4db16a5f824d1a832718abbdabfccf)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:13.567150 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1c2f82-82d4-430e-9f0c-3c8ba7a35195 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:13.568761 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 583/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:26:13 2022] GET /identity/v3/projects/9b4db16a5f824d1a832718abbdabfccf => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:26:13.574932 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b7635-3bcd-4fa0-97f2-b97396edd14f None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:13.630657 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:13.673249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b7635-3bcd-4fa0-97f2-b97396edd14f None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:13.706271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae38359-beea-47c8-9b68-dc58f18d0463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:13.706863 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae38359-beea-47c8-9b68-dc58f18d0463 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:13.707141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae38359-beea-47c8-9b68-dc58f18d0463 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:13.707412 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae38359-beea-47c8-9b68-dc58f18d0463 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:13.708127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae38359-beea-47c8-9b68-dc58f18d0463 None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=9b4db16a5f824d1a832718abbdabfccf, user.id=7b4fed8b4b294097bc8140a935375485) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:26:13.708432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae38359-beea-47c8-9b68-dc58f18d0463 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:13.709863 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae38359-beea-47c8-9b68-dc58f18d0463 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:13.715365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 578/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:26:13 2022] GET /identity/v3/role_assignments?user.id=7b4fed8b4b294097bc8140a935375485&scope.project.id=9b4db16a5f824d1a832718abbdabfccf&role.id=6382a06103714d068409d25cbeb48744 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:15.852530 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa7ea3-3d98-423f-a9a2-b66d87476f0d None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:15.853131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa7ea3-3d98-423f-a9a2-b66d87476f0d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:15.853230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa7ea3-3d98-423f-a9a2-b66d87476f0d None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:15.854539 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 584/1162] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:26:15.859695 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee87563-e1c5-4dbe-9c23-1dd253d2d3df None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:15.860075 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee87563-e1c5-4dbe-9c23-1dd253d2d3df None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:15.860252 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee87563-e1c5-4dbe-9c23-1dd253d2d3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:15.878200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cee87563-e1c5-4dbe-9c23-1dd253d2d3df None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:26:15.879377 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cee87563-e1c5-4dbe-9c23-1dd253d2d3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:26:15.942838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 579/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:26:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:26:16.208404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa7ea3-3d98-423f-a9a2-b66d87476f0d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:16.278571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:16.308618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa7ea3-3d98-423f-a9a2-b66d87476f0d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:16.341595 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21232dfb-9bc3-403b-adfa-c8a218bf3668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:16.342182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21232dfb-9bc3-403b-adfa-c8a218bf3668 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:16.342463 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21232dfb-9bc3-403b-adfa-c8a218bf3668 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:16.342735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21232dfb-9bc3-403b-adfa-c8a218bf3668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:16.407280 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21232dfb-9bc3-403b-adfa-c8a218bf3668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:16.408739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21232dfb-9bc3-403b-adfa-c8a218bf3668 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:16.483547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:16.518297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 585/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:26:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:26:16.524329 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee87563-e1c5-4dbe-9c23-1dd253d2d3df None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:16.575751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:16.621502 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee87563-e1c5-4dbe-9c23-1dd253d2d3df None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:16.654095 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f3c6d-23a1-4557-b0a6-f359a1f53b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:16.654723 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f3c6d-23a1-4557-b0a6-f359a1f53b84 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:16.655003 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f3c6d-23a1-4557-b0a6-f359a1f53b84 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:16.655273 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f3c6d-23a1-4557-b0a6-f359a1f53b84 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:16.661762 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f3c6d-23a1-4557-b0a6-f359a1f53b84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:16.663187 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22f3c6d-23a1-4557-b0a6-f359a1f53b84 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e22f3c6d-23a1-4557-b0a6-f359a1f53b84 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:26:16.674829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:26:16.676072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:26:16.677172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:26:16.677172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:26:16.677172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:26:16.677172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:26:16.677172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:26:16.677172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:26:16.677172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:26:16.677172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:26:16.677172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:26:16.677172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:26:16.677172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 13 06:26:16.677172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:26:16.677172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 06:26:16.677172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:26:16.677172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 580/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 13 06:26:16 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:26:16.681876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21232dfb-9bc3-403b-adfa-c8a218bf3668 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:16.779001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21232dfb-9bc3-403b-adfa-c8a218bf3668 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:16.814283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe1618-6942-4900-8797-bebfc5012804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:16.814878 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe1618-6942-4900-8797-bebfc5012804 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:16.815156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe1618-6942-4900-8797-bebfc5012804 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:16.815428 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe1618-6942-4900-8797-bebfc5012804 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:16.816069 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe1618-6942-4900-8797-bebfc5012804 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:26:16.816369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe1618-6942-4900-8797-bebfc5012804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:16.817759 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe1618-6942-4900-8797-bebfc5012804 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:16.824900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 586/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Sep 13 06:26:16 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:18.928291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bc31c-9998-446b-8f60-a26a08adf94c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:18.928861 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bc31c-9998-446b-8f60-a26a08adf94c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:18.928861 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8bc31c-9998-446b-8f60-a26a08adf94c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:18.930201 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 581/1167] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:26:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:26:18.935929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757f2bb-5328-467b-a503-868223973f83 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:18.936343 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757f2bb-5328-467b-a503-868223973f83 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:18.936449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e757f2bb-5328-467b-a503-868223973f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:18.954784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e757f2bb-5328-467b-a503-868223973f83 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:26:18.955964 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e757f2bb-5328-467b-a503-868223973f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:26:18.983663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:19.020684 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 587/1168] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:26:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:26:19.289071 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bc31c-9998-446b-8f60-a26a08adf94c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:19.386862 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8bc31c-9998-446b-8f60-a26a08adf94c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:19.407624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:19.427790 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952fe194-7774-4377-aa15-ac1abe19acc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:19.428381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fe194-7774-4377-aa15-ac1abe19acc7 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:19.428679 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fe194-7774-4377-aa15-ac1abe19acc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:19.428962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952fe194-7774-4377-aa15-ac1abe19acc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:19.429615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fe194-7774-4377-aa15-ac1abe19acc7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:19.430956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952fe194-7774-4377-aa15-ac1abe19acc7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:19.446050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 582/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Tue Sep 13 06:26:19 2022] POST /identity/v3/domains => generated 267 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:26:21.587041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1bc18-3e89-4bb7-9b39-c904ae2404fb None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:21.587573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1bc18-3e89-4bb7-9b39-c904ae2404fb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:21.587573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1bc18-3e89-4bb7-9b39-c904ae2404fb None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:21.588928 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 588/1170] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:26:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:26:21.594200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffeeba-2d43-40e2-8041-82dc6a518b0f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:21.594645 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffeeba-2d43-40e2-8041-82dc6a518b0f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:21.594747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccffeeba-2d43-40e2-8041-82dc6a518b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:21.612394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ccffeeba-2d43-40e2-8041-82dc6a518b0f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:26:21.613614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ccffeeba-2d43-40e2-8041-82dc6a518b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:26:21.678841 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 583/1171] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:26:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:26:21.951539 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1bc18-3e89-4bb7-9b39-c904ae2404fb None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:22.051088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1bc18-3e89-4bb7-9b39-c904ae2404fb None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:22.084344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d43818d-0187-4365-acb2-4197f5a60b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:22.084983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43818d-0187-4365-acb2-4197f5a60b21 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:22.085259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43818d-0187-4365-acb2-4197f5a60b21 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:22.085528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d43818d-0187-4365-acb2-4197f5a60b21 None admin] PATH_INFO: `/v3/domains/09b16eb6bdac4875ae47e7f407daf864` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:22.096618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43818d-0187-4365-acb2-4197f5a60b21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=09b16eb6bdac4875ae47e7f407daf864)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:22.098068 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d43818d-0187-4365-acb2-4197f5a60b21 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:22.099618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 589/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Tue Sep 13 06:26:21 2022] GET /identity/v3/domains/09b16eb6bdac4875ae47e7f407daf864 => generated 267 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:22.106108 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffeeba-2d43-40e2-8041-82dc6a518b0f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:22.201253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccffeeba-2d43-40e2-8041-82dc6a518b0f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:22.202776 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:22.235318 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe24cf4-ab55-4c1a-acb2-c291eb82b150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:22.235912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe24cf4-ab55-4c1a-acb2-c291eb82b150 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:22.236190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe24cf4-ab55-4c1a-acb2-c291eb82b150 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:22.236458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe24cf4-ab55-4c1a-acb2-c291eb82b150 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:22.237144 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe24cf4-ab55-4c1a-acb2-c291eb82b150 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:22.238549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe24cf4-ab55-4c1a-acb2-c291eb82b150 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:22.264448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 584/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 13 06:26:22 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:26:24.411583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed74a9-d431-4cb8-8acb-cd2de389c9cf None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:24.412146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed74a9-d431-4cb8-8acb-cd2de389c9cf None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:24.412146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed74a9-d431-4cb8-8acb-cd2de389c9cf None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:24.413479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 590/1174] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:26:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:26:24.418934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442b47b-dd8d-4621-ab67-343562d8b1b8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:24.419342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442b47b-dd8d-4621-ab67-343562d8b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:24.419486 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442b47b-dd8d-4621-ab67-343562d8b1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:24.437856 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f442b47b-dd8d-4621-ab67-343562d8b1b8 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:26:24.439041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f442b47b-dd8d-4621-ab67-343562d8b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:26:24.502738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 585/1175] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:26:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:26:24.769790 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed74a9-d431-4cb8-8acb-cd2de389c9cf None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:24.797001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:24.868807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed74a9-d431-4cb8-8acb-cd2de389c9cf None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:24.901365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46136b47-6104-4516-a6ca-320431d2df75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:24.901999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46136b47-6104-4516-a6ca-320431d2df75 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:24.902271 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46136b47-6104-4516-a6ca-320431d2df75 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:24.902536 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46136b47-6104-4516-a6ca-320431d2df75 None admin] PATH_INFO: `/v3/domains/09b16eb6bdac4875ae47e7f407daf864` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:24.903635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46136b47-6104-4516-a6ca-320431d2df75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=09b16eb6bdac4875ae47e7f407daf864)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:24.905052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46136b47-6104-4516-a6ca-320431d2df75 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:24.906565 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 591/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Tue Sep 13 06:26:24 2022] GET /identity/v3/domains/09b16eb6bdac4875ae47e7f407daf864 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:26:24.912182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442b47b-dd8d-4621-ab67-343562d8b1b8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:24.991354 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:25.007816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442b47b-dd8d-4621-ab67-343562d8b1b8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:25.040494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63d00de-cdea-4d5e-aa41-5d1582ee6750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:25.041034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d00de-cdea-4d5e-aa41-5d1582ee6750 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:25.041309 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d00de-cdea-4d5e-aa41-5d1582ee6750 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:25.041577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63d00de-cdea-4d5e-aa41-5d1582ee6750 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:25.042208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d00de-cdea-4d5e-aa41-5d1582ee6750 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:25.043649 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63d00de-cdea-4d5e-aa41-5d1582ee6750 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:25.065075 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 586/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:26:24 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:26:27.208178 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6512d53-d828-460c-afe6-8b9fcb5f4846 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:27.208763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6512d53-d828-460c-afe6-8b9fcb5f4846 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:27.208763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6512d53-d828-460c-afe6-8b9fcb5f4846 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:27.210055 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 592/1178] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:26:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:26:27.215877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff98320-6d6b-4b93-ae00-eaedd18e30e3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:27.216287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff98320-6d6b-4b93-ae00-eaedd18e30e3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:27.216430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff98320-6d6b-4b93-ae00-eaedd18e30e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:27.234164 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-eff98320-6d6b-4b93-ae00-eaedd18e30e3 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:26:27.235349 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-eff98320-6d6b-4b93-ae00-eaedd18e30e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:26:27.301878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 587/1179] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:26:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:26:27.565974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6512d53-d828-460c-afe6-8b9fcb5f4846 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:27.658742 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:27.666588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6512d53-d828-460c-afe6-8b9fcb5f4846 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:27.699705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ea3aa-3d49-447d-a61a-fb8fb76f4055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:27.700313 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ea3aa-3d49-447d-a61a-fb8fb76f4055 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:27.700587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ea3aa-3d49-447d-a61a-fb8fb76f4055 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:27.700884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225ea3aa-3d49-447d-a61a-fb8fb76f4055 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:27.710996 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225ea3aa-3d49-447d-a61a-fb8fb76f4055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-225ea3aa-3d49-447d-a61a-fb8fb76f4055 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:26:27.715678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:26:27.716797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:26:27.717670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:26:27.717670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:26:27.717670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:26:27.717670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:26:27.717670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:26:27.717670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:26:27.717670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:26:27.717670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:26:27.717670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:26:27.717670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:26:27.717670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:26:27.717670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:26:27.717670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 593/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:26:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:26:27.722925 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff98320-6d6b-4b93-ae00-eaedd18e30e3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:27.788857 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:27.820741 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff98320-6d6b-4b93-ae00-eaedd18e30e3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:27.852506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad666eb0-b0e2-4efd-b003-8bec24c3df20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:27.853205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad666eb0-b0e2-4efd-b003-8bec24c3df20 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:27.853486 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad666eb0-b0e2-4efd-b003-8bec24c3df20 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:27.853758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad666eb0-b0e2-4efd-b003-8bec24c3df20 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:27.854419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad666eb0-b0e2-4efd-b003-8bec24c3df20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:26:27.855270 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad666eb0-b0e2-4efd-b003-8bec24c3df20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:27.856587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad666eb0-b0e2-4efd-b003-8bec24c3df20 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:27.864303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 588/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:26:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:27.870155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ea3aa-3d49-447d-a61a-fb8fb76f4055 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:27.966139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225ea3aa-3d49-447d-a61a-fb8fb76f4055 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:27.999278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8913f-7311-427c-b883-45ee4f4f8e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:27.999877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8913f-7311-427c-b883-45ee4f4f8e1d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:28.000153 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8913f-7311-427c-b883-45ee4f4f8e1d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:28.000423 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd8913f-7311-427c-b883-45ee4f4f8e1d None admin] PATH_INFO: `/v3/users/54e0bb09aa1b420591197365fbf541fd` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:28.013747 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8913f-7311-427c-b883-45ee4f4f8e1d None admin] RBAC: Authorizing `identity:get_user(user_id=54e0bb09aa1b420591197365fbf541fd)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:28.015175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd8913f-7311-427c-b883-45ee4f4f8e1d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:28.016779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 594/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:26:27 2022] GET /identity/v3/users/54e0bb09aa1b420591197365fbf541fd => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:28.022206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad666eb0-b0e2-4efd-b003-8bec24c3df20 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:28.117950 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad666eb0-b0e2-4efd-b003-8bec24c3df20 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:28.145364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:28.150914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41747b-90b5-4493-b56b-1ac0523d674d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:28.151507 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41747b-90b5-4493-b56b-1ac0523d674d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:28.152299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41747b-90b5-4493-b56b-1ac0523d674d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:28.152571 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41747b-90b5-4493-b56b-1ac0523d674d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:28.216050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41747b-90b5-4493-b56b-1ac0523d674d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:28.217495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41747b-90b5-4493-b56b-1ac0523d674d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:28.310920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 589/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:26:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:26:28.316834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8913f-7311-427c-b883-45ee4f4f8e1d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:28.331693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:28.414367 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd8913f-7311-427c-b883-45ee4f4f8e1d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:28.448262 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28eb13-e441-4e9e-8f3c-b1946ae808be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:28.448905 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28eb13-e441-4e9e-8f3c-b1946ae808be None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:28.449181 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28eb13-e441-4e9e-8f3c-b1946ae808be None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:28.449447 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28eb13-e441-4e9e-8f3c-b1946ae808be None admin] PATH_INFO: `/v3/projects/d0ea2e765466412591f23f6ee8545e40` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:28.450537 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28eb13-e441-4e9e-8f3c-b1946ae808be None admin] RBAC: Authorizing `identity:get_project(project_id=d0ea2e765466412591f23f6ee8545e40)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:28.451942 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28eb13-e441-4e9e-8f3c-b1946ae808be None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:28.453565 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 595/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:26:28 2022] GET /identity/v3/projects/d0ea2e765466412591f23f6ee8545e40 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:28.459735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41747b-90b5-4493-b56b-1ac0523d674d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:28.491537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:28.562373 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41747b-90b5-4493-b56b-1ac0523d674d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:28.596165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d6e395-0a35-4bb7-9ee3-5e008ccb4c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:28.596793 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e395-0a35-4bb7-9ee3-5e008ccb4c73 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:28.597071 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e395-0a35-4bb7-9ee3-5e008ccb4c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:28.597340 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d6e395-0a35-4bb7-9ee3-5e008ccb4c73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:28.598060 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6e395-0a35-4bb7-9ee3-5e008ccb4c73 None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=d0ea2e765466412591f23f6ee8545e40, user.id=54e0bb09aa1b420591197365fbf541fd) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:26:28.598365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6e395-0a35-4bb7-9ee3-5e008ccb4c73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:28.599797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d6e395-0a35-4bb7-9ee3-5e008ccb4c73 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:28.605560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 590/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:26:28 2022] GET /identity/v3/role_assignments?user.id=54e0bb09aa1b420591197365fbf541fd&scope.project.id=d0ea2e765466412591f23f6ee8545e40&role.id=6382a06103714d068409d25cbeb48744 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:30.707378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dd55e-de0c-4751-ae0c-47815d80077b None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:30.707855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dd55e-de0c-4751-ae0c-47815d80077b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:30.707946 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dd55e-de0c-4751-ae0c-47815d80077b None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:30.709269 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 596/1186] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:26:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:26:30.714926 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79e526-73fb-4e40-b283-b4d601aecee9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:30.715326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79e526-73fb-4e40-b283-b4d601aecee9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:30.715470 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79e526-73fb-4e40-b283-b4d601aecee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:30.733836 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0e79e526-73fb-4e40-b283-b4d601aecee9 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:26:30.735015 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0e79e526-73fb-4e40-b283-b4d601aecee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:26:30.798189 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 591/1187] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:26:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:26:31.067037 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dd55e-de0c-4751-ae0c-47815d80077b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:31.146301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:31.165677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dd55e-de0c-4751-ae0c-47815d80077b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:31.198138 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087111fe-a55a-4149-b0a5-724996af9a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:31.199286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087111fe-a55a-4149-b0a5-724996af9a0b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:31.199563 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087111fe-a55a-4149-b0a5-724996af9a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:31.199832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087111fe-a55a-4149-b0a5-724996af9a0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:31.209605 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087111fe-a55a-4149-b0a5-724996af9a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-087111fe-a55a-4149-b0a5-724996af9a0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:26:31.214334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:26:31.215509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:26:31.216398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:26:31.216398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:26:31.216398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:26:31.216398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:26:31.216398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:26:31.216398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:26:31.216398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:26:31.216398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:26:31.216398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:26:31.216398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:26:31.216398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:26:31.216398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:26:31.216398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 597/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:26:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:26:31.221342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79e526-73fb-4e40-b283-b4d601aecee9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:31.247633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:31.318537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e79e526-73fb-4e40-b283-b4d601aecee9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:31.350801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2d507-6dd8-4bef-b85b-7f1bf6bf09bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:31.351396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2d507-6dd8-4bef-b85b-7f1bf6bf09bd None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:31.351673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2d507-6dd8-4bef-b85b-7f1bf6bf09bd None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:31.351942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b2d507-6dd8-4bef-b85b-7f1bf6bf09bd None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:31.352594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2d507-6dd8-4bef-b85b-7f1bf6bf09bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:26:31.352923 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2d507-6dd8-4bef-b85b-7f1bf6bf09bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:31.354271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b2d507-6dd8-4bef-b85b-7f1bf6bf09bd None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:31.361992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 592/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:26:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:31.367917 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087111fe-a55a-4149-b0a5-724996af9a0b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:31.465424 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087111fe-a55a-4149-b0a5-724996af9a0b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:31.498697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697aa764-f0db-4f95-8532-e952a0cffdd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:31.499301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa764-f0db-4f95-8532-e952a0cffdd1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:31.499577 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa764-f0db-4f95-8532-e952a0cffdd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:31.499848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697aa764-f0db-4f95-8532-e952a0cffdd1 None admin] PATH_INFO: `/v3/users/54e0bb09aa1b420591197365fbf541fd` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:31.500973 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697aa764-f0db-4f95-8532-e952a0cffdd1 None admin] RBAC: Authorizing `identity:get_user(user_id=54e0bb09aa1b420591197365fbf541fd)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:31.502391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697aa764-f0db-4f95-8532-e952a0cffdd1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:31.503924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 598/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:26:31 2022] GET /identity/v3/users/54e0bb09aa1b420591197365fbf541fd => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:31.509476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2d507-6dd8-4bef-b85b-7f1bf6bf09bd None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:31.597385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:31.609806 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b2d507-6dd8-4bef-b85b-7f1bf6bf09bd None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:31.642398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ec2c5c-1ae6-4068-8d96-95317bc6dee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:31.643021 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec2c5c-1ae6-4068-8d96-95317bc6dee0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:31.643298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec2c5c-1ae6-4068-8d96-95317bc6dee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:31.643569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ec2c5c-1ae6-4068-8d96-95317bc6dee0 None admin] PATH_INFO: `/v3/projects/d0ea2e765466412591f23f6ee8545e40` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:31.644926 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec2c5c-1ae6-4068-8d96-95317bc6dee0 None admin] RBAC: Authorizing `identity:get_project(project_id=d0ea2e765466412591f23f6ee8545e40)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:31.646094 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ec2c5c-1ae6-4068-8d96-95317bc6dee0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:31.647709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 593/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:26:31 2022] GET /identity/v3/projects/d0ea2e765466412591f23f6ee8545e40 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:31.653619 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697aa764-f0db-4f95-8532-e952a0cffdd1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:31.664721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:31.750527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697aa764-f0db-4f95-8532-e952a0cffdd1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:31.782759 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2112cf6-78b4-4a30-abf8-0b1e0f6b5dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:31.783393 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2112cf6-78b4-4a30-abf8-0b1e0f6b5dfd None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:31.783667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2112cf6-78b4-4a30-abf8-0b1e0f6b5dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:31.783931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2112cf6-78b4-4a30-abf8-0b1e0f6b5dfd None admin] PATH_INFO: `/v3/projects/d0ea2e765466412591f23f6ee8545e40/users/54e0bb09aa1b420591197365fbf541fd/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:31.785837 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2112cf6-78b4-4a30-abf8-0b1e0f6b5dfd None admin] RBAC: Authorizing `identity:create_grant(project_id=d0ea2e765466412591f23f6ee8545e40, user_id=54e0bb09aa1b420591197365fbf541fd, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:31.787245 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2112cf6-78b4-4a30-abf8-0b1e0f6b5dfd None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:31.799514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 599/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:26:31 2022] PUT /identity/v3/projects/d0ea2e765466412591f23f6ee8545e40/users/54e0bb09aa1b420591197365fbf541fd/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:26:33.901855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3c8fd-e67b-439c-a733-2c15f4eda37c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:33.902422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3c8fd-e67b-439c-a733-2c15f4eda37c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:33.902422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3c8fd-e67b-439c-a733-2c15f4eda37c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:33.903654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 594/1193] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:26:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:26:33.908998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399a73a-93cc-490f-a05a-8a7f2860c81d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:33.909437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399a73a-93cc-490f-a05a-8a7f2860c81d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:33.909532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e399a73a-93cc-490f-a05a-8a7f2860c81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:33.927638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e399a73a-93cc-490f-a05a-8a7f2860c81d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:26:33.928862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e399a73a-93cc-490f-a05a-8a7f2860c81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:26:33.987472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:33.993610 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 600/1194] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:26:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:26:34.264326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3c8fd-e67b-439c-a733-2c15f4eda37c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:34.361265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3c8fd-e67b-439c-a733-2c15f4eda37c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:34.393706 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9812d-44a1-4c56-8e4a-d472caccaec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:34.394312 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9812d-44a1-4c56-8e4a-d472caccaec0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:34.394587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9812d-44a1-4c56-8e4a-d472caccaec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:34.394860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9812d-44a1-4c56-8e4a-d472caccaec0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:34.405001 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9812d-44a1-4c56-8e4a-d472caccaec0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-f8c9812d-44a1-4c56-8e4a-d472caccaec0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:26:34.409671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:26:34.410781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:26:34.411685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:26:34.411685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:26:34.411685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:26:34.411685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:26:34.411685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:26:34.411685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:26:34.411685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:26:34.411685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:26:34.411685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:26:34.411685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:26:34.411685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:26:34.411685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:26:34.411685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 595/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:26:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:26:34.416801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399a73a-93cc-490f-a05a-8a7f2860c81d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:34.517486 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e399a73a-93cc-490f-a05a-8a7f2860c81d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:34.550215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01995979-1058-49dc-a888-300f821869d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:34.550811 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01995979-1058-49dc-a888-300f821869d3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:34.551090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01995979-1058-49dc-a888-300f821869d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:34.551363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01995979-1058-49dc-a888-300f821869d3 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:34.552023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01995979-1058-49dc-a888-300f821869d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:26:34.552327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01995979-1058-49dc-a888-300f821869d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:34.553716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01995979-1058-49dc-a888-300f821869d3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:34.562084 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 601/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:26:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:26:34.568018 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9812d-44a1-4c56-8e4a-d472caccaec0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:34.585779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:34.666100 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9812d-44a1-4c56-8e4a-d472caccaec0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:34.698705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73199167-d44f-4068-b5d5-e0db43055844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:34.699318 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73199167-d44f-4068-b5d5-e0db43055844 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:34.699597 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73199167-d44f-4068-b5d5-e0db43055844 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:34.699869 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73199167-d44f-4068-b5d5-e0db43055844 None admin] PATH_INFO: `/v3/users/54e0bb09aa1b420591197365fbf541fd` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:34.700999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73199167-d44f-4068-b5d5-e0db43055844 None admin] RBAC: Authorizing `identity:get_user(user_id=54e0bb09aa1b420591197365fbf541fd)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:34.702400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73199167-d44f-4068-b5d5-e0db43055844 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:34.703947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 596/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 13 06:26:34 2022] GET /identity/v3/users/54e0bb09aa1b420591197365fbf541fd => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:34.709757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01995979-1058-49dc-a888-300f821869d3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:34.768092 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:34.808741 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01995979-1058-49dc-a888-300f821869d3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:34.842043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf573a36-6164-4178-b75d-d193b99c266f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:34.842635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf573a36-6164-4178-b75d-d193b99c266f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:34.842916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf573a36-6164-4178-b75d-d193b99c266f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:34.843186 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf573a36-6164-4178-b75d-d193b99c266f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:34.908828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf573a36-6164-4178-b75d-d193b99c266f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:34.910253 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf573a36-6164-4178-b75d-d193b99c266f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:34.964724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:35.005059 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 602/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:26:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:26:35.011051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73199167-d44f-4068-b5d5-e0db43055844 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:35.092443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:35.108215 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73199167-d44f-4068-b5d5-e0db43055844 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:35.140419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a562391-c62c-48ee-b2c2-5d01f3d7638c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:35.141045 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a562391-c62c-48ee-b2c2-5d01f3d7638c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:35.141322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a562391-c62c-48ee-b2c2-5d01f3d7638c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:35.141592 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a562391-c62c-48ee-b2c2-5d01f3d7638c None admin] PATH_INFO: `/v3/projects/d0ea2e765466412591f23f6ee8545e40` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:35.142680 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a562391-c62c-48ee-b2c2-5d01f3d7638c None admin] RBAC: Authorizing `identity:get_project(project_id=d0ea2e765466412591f23f6ee8545e40)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:35.144070 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a562391-c62c-48ee-b2c2-5d01f3d7638c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:35.145683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 597/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 13 06:26:35 2022] GET /identity/v3/projects/d0ea2e765466412591f23f6ee8545e40 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:35.152348 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf573a36-6164-4178-b75d-d193b99c266f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:26:35.247859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf573a36-6164-4178-b75d-d193b99c266f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:26:35.280742 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926f34c1-a736-4fd2-b352-1b900ab40485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:26:35.281330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f34c1-a736-4fd2-b352-1b900ab40485 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:26:35.281611 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f34c1-a736-4fd2-b352-1b900ab40485 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:26:35.281885 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926f34c1-a736-4fd2-b352-1b900ab40485 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:26:35.282600 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f34c1-a736-4fd2-b352-1b900ab40485 None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=d0ea2e765466412591f23f6ee8545e40, user.id=54e0bb09aa1b420591197365fbf541fd) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:26:35.282911 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f34c1-a736-4fd2-b352-1b900ab40485 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:26:35.284317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926f34c1-a736-4fd2-b352-1b900ab40485 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:26:35.289900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 603/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:26:35 2022] GET /identity/v3/role_assignments?user.id=54e0bb09aa1b420591197365fbf541fd&scope.project.id=d0ea2e765466412591f23f6ee8545e40&role.id=6382a06103714d068409d25cbeb48744 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:26:45.136375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=24 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:26:45.287491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=88 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:30.451275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61437059-7238-47f2-83d5-80882568ec0e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:30.451903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61437059-7238-47f2-83d5-80882568ec0e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:30.451903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61437059-7238-47f2-83d5-80882568ec0e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:30.453259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 598/1201] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:27:30.458969 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec0ddf-9a60-4554-9206-b278f4252d74 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:30.459455 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec0ddf-9a60-4554-9206-b278f4252d74 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:30.459583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec0ddf-9a60-4554-9206-b278f4252d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:30.484708 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-22ec0ddf-9a60-4554-9206-b278f4252d74 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:27:30.484708 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-22ec0ddf-9a60-4554-9206-b278f4252d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:27:30.580870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 604/1202] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:27:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:27:30.873172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61437059-7238-47f2-83d5-80882568ec0e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:31.010970 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61437059-7238-47f2-83d5-80882568ec0e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:31.054399 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfca2c-a802-48cd-9bea-546daa367fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:31.055025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfca2c-a802-48cd-9bea-546daa367fed None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:31.055330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfca2c-a802-48cd-9bea-546daa367fed None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:31.055609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcfca2c-a802-48cd-9bea-546daa367fed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:31.073226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfca2c-a802-48cd-9bea-546daa367fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:31.074661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcfca2c-a802-48cd-9bea-546daa367fed None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-dbcfca2c-a802-48cd-9bea-546daa367fed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:27:31.093167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:31.094393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:27:31.096870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:27:31.096870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:31.096870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:31.096870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 599/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:27:31.101826 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec0ddf-9a60-4554-9206-b278f4252d74 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:31.240351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec0ddf-9a60-4554-9206-b278f4252d74 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:31.279244 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:31.287874 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f05a6c-c4d5-4faa-9251-2de45480699b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:31.289078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f05a6c-c4d5-4faa-9251-2de45480699b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:31.289839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f05a6c-c4d5-4faa-9251-2de45480699b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:31.290405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f05a6c-c4d5-4faa-9251-2de45480699b None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:31.292146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f05a6c-c4d5-4faa-9251-2de45480699b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:31.292816 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f05a6c-c4d5-4faa-9251-2de45480699b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:31.294852 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f05a6c-c4d5-4faa-9251-2de45480699b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:31.310657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 605/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:31.316747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfca2c-a802-48cd-9bea-546daa367fed None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:31.394068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:31.455544 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcfca2c-a802-48cd-9bea-546daa367fed None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:31.501827 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c164947-ae0f-43d8-8ff3-d114bb829491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:31.502835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c164947-ae0f-43d8-8ff3-d114bb829491 None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:31.503272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c164947-ae0f-43d8-8ff3-d114bb829491 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:31.503698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c164947-ae0f-43d8-8ff3-d114bb829491 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:31.504493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c164947-ae0f-43d8-8ff3-d114bb829491 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:31.506229 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c164947-ae0f-43d8-8ff3-d114bb829491 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:31.534279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 600/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 13 06:27:31 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:27:33.968319 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6e2a4-2de0-4bdf-bddd-83f7881f8688 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:33.968909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6e2a4-2de0-4bdf-bddd-83f7881f8688 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:33.968909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6e2a4-2de0-4bdf-bddd-83f7881f8688 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:33.970477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 606/1206] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:27:33.976051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ea042-f332-4904-8964-e9960b159074 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:33.976501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ea042-f332-4904-8964-e9960b159074 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:33.976592 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0ea042-f332-4904-8964-e9960b159074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:33.997856 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2a0ea042-f332-4904-8964-e9960b159074 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:27:33.999037 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2a0ea042-f332-4904-8964-e9960b159074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:27:34.075503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 601/1207] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:27:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:27:34.350838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6e2a4-2de0-4bdf-bddd-83f7881f8688 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:34.470026 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6e2a4-2de0-4bdf-bddd-83f7881f8688 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:34.509500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2ce1e-46fe-4496-88d9-9428c96e72cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:34.510106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2ce1e-46fe-4496-88d9-9428c96e72cd None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:34.510444 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2ce1e-46fe-4496-88d9-9428c96e72cd None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:34.510671 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2ce1e-46fe-4496-88d9-9428c96e72cd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:34.521721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2ce1e-46fe-4496-88d9-9428c96e72cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-62a2ce1e-46fe-4496-88d9-9428c96e72cd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:27:34.528040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:34.534172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:34.535248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:34.535248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:34.535248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:34.535248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:34.535248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:27:34.535248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:27:34.535248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:27:34.535248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:27:34.535248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:27:34.535248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:27:34.535248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:27:34.535248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:27:34.535248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 607/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:27:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:34.536147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ea042-f332-4904-8964-e9960b159074 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:34.577781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:34.644983 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0ea042-f332-4904-8964-e9960b159074 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:34.683807 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c5ddc-9451-4125-8382-71eb5fdf795e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:34.684421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c5ddc-9451-4125-8382-71eb5fdf795e None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:34.684733 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c5ddc-9451-4125-8382-71eb5fdf795e None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:34.686276 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c5ddc-9451-4125-8382-71eb5fdf795e None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:34.686276 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c5ddc-9451-4125-8382-71eb5fdf795e None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:34.686276 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c5ddc-9451-4125-8382-71eb5fdf795e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:34.687308 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966c5ddc-9451-4125-8382-71eb5fdf795e None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:34.695963 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 602/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:27:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:34.702717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2ce1e-46fe-4496-88d9-9428c96e72cd None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:34.769318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:34.830263 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2ce1e-46fe-4496-88d9-9428c96e72cd None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:34.867618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3db35-8275-46a4-9b85-36528d82d91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:34.868519 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3db35-8275-46a4-9b85-36528d82d91e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:34.869541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3db35-8275-46a4-9b85-36528d82d91e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:34.869969 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c3db35-8275-46a4-9b85-36528d82d91e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:34.883645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3db35-8275-46a4-9b85-36528d82d91e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:34.885386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c3db35-8275-46a4-9b85-36528d82d91e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-a8c3db35-8275-46a4-9b85-36528d82d91e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:27:34.902227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:34.903351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:27:34.904265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:27:34.904265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:34.904265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:27:34.904265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 608/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:34.909458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c5ddc-9451-4125-8382-71eb5fdf795e None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:35.028508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:35.031515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c5ddc-9451-4125-8382-71eb5fdf795e None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:35.068389 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3032a5-d4fe-484d-b450-754b82d5dc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:35.069370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3032a5-d4fe-484d-b450-754b82d5dc92 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:35.069898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3032a5-d4fe-484d-b450-754b82d5dc92 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:35.070371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3032a5-d4fe-484d-b450-754b82d5dc92 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:35.071268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3032a5-d4fe-484d-b450-754b82d5dc92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:35.071834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3032a5-d4fe-484d-b450-754b82d5dc92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:35.073504 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3032a5-d4fe-484d-b450-754b82d5dc92 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:35.089447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 603/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:35.095027 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3db35-8275-46a4-9b85-36528d82d91e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:35.212637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c3db35-8275-46a4-9b85-36528d82d91e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:35.214655 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:35.254081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3c3dd-2d54-4410-8055-0b09094d37ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:35.256246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3c3dd-2d54-4410-8055-0b09094d37ec None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:35.256246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3c3dd-2d54-4410-8055-0b09094d37ec None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:35.256246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3c3dd-2d54-4410-8055-0b09094d37ec None admin] PATH_INFO: `/v3/users/placement` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:35.263907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3c3dd-2d54-4410-8055-0b09094d37ec None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:35.265592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3c3dd-2d54-4410-8055-0b09094d37ec None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-05d3c3dd-2d54-4410-8055-0b09094d37ec None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:27:35.279166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:35.280314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:35.282200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:35.282200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:35.282200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:27:35.282200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:27:35.282200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:27:35.282200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:27:35.282200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:27:35.282200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:27:35.282200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:27:35.282200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:27:35.282200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 609/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:27:35.286554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3032a5-d4fe-484d-b450-754b82d5dc92 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:35.428684 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3032a5-d4fe-484d-b450-754b82d5dc92 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:35.465890 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7ab7-713f-4fc6-b1ce-aea912f3e3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:35.466351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7ab7-713f-4fc6-b1ce-aea912f3e3fc None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:35.466656 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7ab7-713f-4fc6-b1ce-aea912f3e3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:35.466896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14d7ab7-713f-4fc6-b1ce-aea912f3e3fc None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:35.467661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d7ab7-713f-4fc6-b1ce-aea912f3e3fc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:35.467965 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d7ab7-713f-4fc6-b1ce-aea912f3e3fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:35.469403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14d7ab7-713f-4fc6-b1ce-aea912f3e3fc None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:35.486619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 604/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Sep 13 06:27:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:35.492529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3c3dd-2d54-4410-8055-0b09094d37ec None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:35.608060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3c3dd-2d54-4410-8055-0b09094d37ec None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:35.653202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34689015-ea30-4677-9d3e-83162141f688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:35.653846 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34689015-ea30-4677-9d3e-83162141f688 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:35.654107 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34689015-ea30-4677-9d3e-83162141f688 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:35.655810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34689015-ea30-4677-9d3e-83162141f688 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:35.691840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:35.742069 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34689015-ea30-4677-9d3e-83162141f688 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:35.743444 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34689015-ea30-4677-9d3e-83162141f688 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:35.860716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 610/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:27:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 06:27:35.866508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7ab7-713f-4fc6-b1ce-aea912f3e3fc None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:35.887084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:35.978960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14d7ab7-713f-4fc6-b1ce-aea912f3e3fc None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:36.020831 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eb78d-af06-4c4b-8ed3-a5525d58a01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:36.021488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb78d-af06-4c4b-8ed3-a5525d58a01c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:36.021853 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb78d-af06-4c4b-8ed3-a5525d58a01c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:36.022155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8eb78d-af06-4c4b-8ed3-a5525d58a01c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:36.034983 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eb78d-af06-4c4b-8ed3-a5525d58a01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:36.036650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8eb78d-af06-4c4b-8ed3-a5525d58a01c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-6f8eb78d-af06-4c4b-8ed3-a5525d58a01c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:27:36.059317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:36.061194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:27:36.062837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:27:36.062837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:36.062837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:36.062837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 605/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:36.067093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34689015-ea30-4677-9d3e-83162141f688 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:36.143794 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:36.191586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34689015-ea30-4677-9d3e-83162141f688 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:36.230369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bff7c-fe63-4fd1-8762-97ea0f1f1e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:36.230980 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bff7c-fe63-4fd1-8762-97ea0f1f1e87 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:36.231319 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bff7c-fe63-4fd1-8762-97ea0f1f1e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:36.231557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47bff7c-fe63-4fd1-8762-97ea0f1f1e87 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:36.232206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bff7c-fe63-4fd1-8762-97ea0f1f1e87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:36.232512 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bff7c-fe63-4fd1-8762-97ea0f1f1e87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:36.233920 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47bff7c-fe63-4fd1-8762-97ea0f1f1e87 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:36.246678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 611/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:36.252475 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eb78d-af06-4c4b-8ed3-a5525d58a01c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:36.328498 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:36.368930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8eb78d-af06-4c4b-8ed3-a5525d58a01c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:36.405069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca57874-4101-4088-9f0d-fdca9afcd403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:36.405702 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca57874-4101-4088-9f0d-fdca9afcd403 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:36.405982 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca57874-4101-4088-9f0d-fdca9afcd403 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:36.406257 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca57874-4101-4088-9f0d-fdca9afcd403 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:36.413407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca57874-4101-4088-9f0d-fdca9afcd403 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:36.414844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca57874-4101-4088-9f0d-fdca9afcd403 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:36.426253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-dca57874-4101-4088-9f0d-fdca9afcd403 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:27:36.426253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:36.426253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:36.426253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:36.426253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:36.426253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:36.426253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:36.426253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:36.426253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:36.426253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:36.426253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:36.426253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:36.426253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:27:36.426253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:27:36.426253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:36.427520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:36.428613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:27:36.428613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:27:36.428613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:27:36.428613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:27:36.428613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:27:36.428613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:27:36.428613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:27:36.428613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:36.428613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 606/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:27:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:36.433405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bff7c-fe63-4fd1-8762-97ea0f1f1e87 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:36.542464 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47bff7c-fe63-4fd1-8762-97ea0f1f1e87 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:36.565980 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:36.579090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf1609f-dd9e-481b-90bb-340b7d7b8978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:36.579640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1609f-dd9e-481b-90bb-340b7d7b8978 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:36.579931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1609f-dd9e-481b-90bb-340b7d7b8978 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:36.580204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf1609f-dd9e-481b-90bb-340b7d7b8978 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:36.581011 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1609f-dd9e-481b-90bb-340b7d7b8978 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:36.581320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1609f-dd9e-481b-90bb-340b7d7b8978 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:36.582863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf1609f-dd9e-481b-90bb-340b7d7b8978 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:36.596016 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 612/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:27:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:27:36.602010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca57874-4101-4088-9f0d-fdca9afcd403 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:36.710278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca57874-4101-4088-9f0d-fdca9afcd403 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:36.748334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:36.758754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf670aa-2d3e-445f-8434-41f028d682b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:36.759435 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf670aa-2d3e-445f-8434-41f028d682b7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:36.759742 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf670aa-2d3e-445f-8434-41f028d682b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:36.759908 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf670aa-2d3e-445f-8434-41f028d682b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:36.760636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf670aa-2d3e-445f-8434-41f028d682b7 None admin] RBAC: Adding query filter params (role.id=dc60d33cb0c649b3b903d99258a19c98, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=b84a23931b60457e865f056352a396d0) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:36.760978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf670aa-2d3e-445f-8434-41f028d682b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:36.765958 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf670aa-2d3e-445f-8434-41f028d682b7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:36.772023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 607/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:27:36 2022] GET /identity/v3/role_assignments?user.id=b84a23931b60457e865f056352a396d0&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=dc60d33cb0c649b3b903d99258a19c98 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:39.089262 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d42395-aad7-406a-900d-5a871784aaf6 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:39.089840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d42395-aad7-406a-900d-5a871784aaf6 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:39.089992 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d42395-aad7-406a-900d-5a871784aaf6 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:39.091486 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 613/1220] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:27:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:27:39.096658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da052df-c637-44cc-b340-07a56d6dd71b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:39.097101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da052df-c637-44cc-b340-07a56d6dd71b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:39.097320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da052df-c637-44cc-b340-07a56d6dd71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:39.117167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9da052df-c637-44cc-b340-07a56d6dd71b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:27:39.120340 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9da052df-c637-44cc-b340-07a56d6dd71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:27:39.199216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 608/1221] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:27:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:27:39.471314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d42395-aad7-406a-900d-5a871784aaf6 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:39.590779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d42395-aad7-406a-900d-5a871784aaf6 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:39.638796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89e45b-7fb8-42b6-9cc8-62543f4909ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:39.639448 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89e45b-7fb8-42b6-9cc8-62543f4909ae None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:39.639703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89e45b-7fb8-42b6-9cc8-62543f4909ae None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:39.639997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac89e45b-7fb8-42b6-9cc8-62543f4909ae None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:39.651956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac89e45b-7fb8-42b6-9cc8-62543f4909ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-ac89e45b-7fb8-42b6-9cc8-62543f4909ae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:27:39.657077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:39.658053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:39.658961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:39.658961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:39.658961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:39.658961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:39.658961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:27:39.658961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:27:39.658961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:27:39.658961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:27:39.658961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:27:39.658961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:27:39.658961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:27:39.658961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:27:39.658961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 614/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:27:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:39.664432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da052df-c637-44cc-b340-07a56d6dd71b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:39.772985 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da052df-c637-44cc-b340-07a56d6dd71b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:39.796921 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:39.808947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c6b47-fdb1-4c50-9e15-5dc90e3a374c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:39.809559 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c6b47-fdb1-4c50-9e15-5dc90e3a374c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:39.809840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c6b47-fdb1-4c50-9e15-5dc90e3a374c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:39.810115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c6b47-fdb1-4c50-9e15-5dc90e3a374c None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:39.810781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c6b47-fdb1-4c50-9e15-5dc90e3a374c None admin] RBAC: Adding query filter params (name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:39.811083 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c6b47-fdb1-4c50-9e15-5dc90e3a374c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:39.812444 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c6b47-fdb1-4c50-9e15-5dc90e3a374c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:39.820624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 609/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:27:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:39.826945 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89e45b-7fb8-42b6-9cc8-62543f4909ae None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:39.874597 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:39.936709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac89e45b-7fb8-42b6-9cc8-62543f4909ae None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:39.975964 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343a3d-3795-41f3-b7b5-fb820fe2ff83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:39.976634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343a3d-3795-41f3-b7b5-fb820fe2ff83 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:39.976977 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343a3d-3795-41f3-b7b5-fb820fe2ff83 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:39.977283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343a3d-3795-41f3-b7b5-fb820fe2ff83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:39.988052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3343a3d-3795-41f3-b7b5-fb820fe2ff83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:39.989528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3343a3d-3795-41f3-b7b5-fb820fe2ff83 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-e3343a3d-3795-41f3-b7b5-fb820fe2ff83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:27:40.007721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:40.009836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:27:40.011039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:27:40.011039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:40.011039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:27:40.011039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 615/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:40.015776 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c6b47-fdb1-4c50-9e15-5dc90e3a374c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:40.138348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c6b47-fdb1-4c50-9e15-5dc90e3a374c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:40.174949 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfe5b2-ed45-4ab5-aa73-6f4db5d709f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:40.175557 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfe5b2-ed45-4ab5-aa73-6f4db5d709f6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:40.175837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfe5b2-ed45-4ab5-aa73-6f4db5d709f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:40.176110 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfe5b2-ed45-4ab5-aa73-6f4db5d709f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:40.176779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfe5b2-ed45-4ab5-aa73-6f4db5d709f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:40.177086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfe5b2-ed45-4ab5-aa73-6f4db5d709f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:40.178442 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcfe5b2-ed45-4ab5-aa73-6f4db5d709f6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:40.191471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 610/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:40.197427 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343a3d-3795-41f3-b7b5-fb820fe2ff83 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:40.304472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:40.312566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343a3d-3795-41f3-b7b5-fb820fe2ff83 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:40.351250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1ece4-a11a-471b-a9c8-43377bbf392e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:40.351970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1ece4-a11a-471b-a9c8-43377bbf392e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:40.352427 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1ece4-a11a-471b-a9c8-43377bbf392e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:40.352682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d1ece4-a11a-471b-a9c8-43377bbf392e None admin] PATH_INFO: `/v3/users/placement` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:40.364166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1ece4-a11a-471b-a9c8-43377bbf392e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:40.364166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d1ece4-a11a-471b-a9c8-43377bbf392e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-59d1ece4-a11a-471b-a9c8-43377bbf392e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:27:40.376757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:40.377923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:40.379437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:40.379437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:40.379437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:27:40.379437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:27:40.379437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:27:40.379437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:27:40.379437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:27:40.379437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:27:40.379437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:27:40.379437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:27:40.379437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 616/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:40.383903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfe5b2-ed45-4ab5-aa73-6f4db5d709f6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:40.434233 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:40.506303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfe5b2-ed45-4ab5-aa73-6f4db5d709f6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:40.546069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d0359-da25-4e07-ae31-7dd9cb8eca04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:40.546787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d0359-da25-4e07-ae31-7dd9cb8eca04 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:40.547141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d0359-da25-4e07-ae31-7dd9cb8eca04 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:40.547483 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971d0359-da25-4e07-ae31-7dd9cb8eca04 None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:40.548315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d0359-da25-4e07-ae31-7dd9cb8eca04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:40.548718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d0359-da25-4e07-ae31-7dd9cb8eca04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:40.550138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971d0359-da25-4e07-ae31-7dd9cb8eca04 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:40.568416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 611/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Sep 13 06:27:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:27:40.574667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1ece4-a11a-471b-a9c8-43377bbf392e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:40.705060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d1ece4-a11a-471b-a9c8-43377bbf392e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:40.749350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a2568-9103-499f-b3d8-755e93414c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:40.749985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a2568-9103-499f-b3d8-755e93414c2b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:40.750256 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a2568-9103-499f-b3d8-755e93414c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:40.750603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5a2568-9103-499f-b3d8-755e93414c2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:40.762179 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a2568-9103-499f-b3d8-755e93414c2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:40.763804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5a2568-9103-499f-b3d8-755e93414c2b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-1f5a2568-9103-499f-b3d8-755e93414c2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:27:40.779442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:40.780976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:27:40.782030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:27:40.782030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:40.782030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:27:40.782030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 617/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:40.786436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d0359-da25-4e07-ae31-7dd9cb8eca04 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:40.891743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971d0359-da25-4e07-ae31-7dd9cb8eca04 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:40.894349 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:40.936122 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af812c3-cd3d-406e-ac1b-5abfd4c1a193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:40.936770 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af812c3-cd3d-406e-ac1b-5abfd4c1a193 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:40.937056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af812c3-cd3d-406e-ac1b-5abfd4c1a193 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:40.937328 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af812c3-cd3d-406e-ac1b-5abfd4c1a193 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:40.937966 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af812c3-cd3d-406e-ac1b-5abfd4c1a193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:40.938268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af812c3-cd3d-406e-ac1b-5abfd4c1a193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:40.939680 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af812c3-cd3d-406e-ac1b-5abfd4c1a193 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:40.952631 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 612/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:27:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:27:40.958563 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a2568-9103-499f-b3d8-755e93414c2b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:40.970605 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:41.068816 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5a2568-9103-499f-b3d8-755e93414c2b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:41.107984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91524c-dc1c-4dd9-a6a7-39f2605af3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:41.108609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91524c-dc1c-4dd9-a6a7-39f2605af3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:41.108928 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91524c-dc1c-4dd9-a6a7-39f2605af3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:41.109200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91524c-dc1c-4dd9-a6a7-39f2605af3b6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:41.115871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91524c-dc1c-4dd9-a6a7-39f2605af3b6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:41.117445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e91524c-dc1c-4dd9-a6a7-39f2605af3b6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:41.130090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-0e91524c-dc1c-4dd9-a6a7-39f2605af3b6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:27:41.130090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:41.130090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:41.130090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:41.130090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:41.130090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:41.130090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:41.130090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:41.130090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:41.130090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:41.130090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:41.130090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:41.130090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:27:41.130090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:27:41.130090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:41.131215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:41.132143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:27:41.132143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:27:41.132143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:27:41.132143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:27:41.132143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:27:41.132143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:27:41.132143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:27:41.132143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:27:41.132143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 618/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:27:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:41.137930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af812c3-cd3d-406e-ac1b-5abfd4c1a193 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:41.249378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af812c3-cd3d-406e-ac1b-5abfd4c1a193 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:41.283847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4909cca6-3033-4b1c-ab5b-791c0cdc4c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:41.284503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909cca6-3033-4b1c-ab5b-791c0cdc4c10 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:41.284821 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909cca6-3033-4b1c-ab5b-791c0cdc4c10 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:41.285125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4909cca6-3033-4b1c-ab5b-791c0cdc4c10 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:41.285812 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909cca6-3033-4b1c-ab5b-791c0cdc4c10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:41.286114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909cca6-3033-4b1c-ab5b-791c0cdc4c10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:41.287535 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4909cca6-3033-4b1c-ab5b-791c0cdc4c10 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:41.299904 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 613/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:27:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:41.306443 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91524c-dc1c-4dd9-a6a7-39f2605af3b6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:41.383176 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:41.418846 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91524c-dc1c-4dd9-a6a7-39f2605af3b6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:41.456219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd095654-7caa-4084-b274-c6511bcec5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:41.457472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd095654-7caa-4084-b274-c6511bcec5c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:41.457472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd095654-7caa-4084-b274-c6511bcec5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:41.457472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd095654-7caa-4084-b274-c6511bcec5c1 None admin] PATH_INFO: `/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/b84a23931b60457e865f056352a396d0/roles/dc60d33cb0c649b3b903d99258a19c98` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:41.474494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd095654-7caa-4084-b274-c6511bcec5c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c3f0aa3b746108e73737491b003e7, user_id=b84a23931b60457e865f056352a396d0, role_id=dc60d33cb0c649b3b903d99258a19c98)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:41.476059 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd095654-7caa-4084-b274-c6511bcec5c1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:41.490018 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 619/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:27:41 2022] PUT /identity/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/b84a23931b60457e865f056352a396d0/roles/dc60d33cb0c649b3b903d99258a19c98 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:27:43.705723 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af37d2a-5219-4d32-ba81-107f234ba409 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:43.706286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af37d2a-5219-4d32-ba81-107f234ba409 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:43.706286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af37d2a-5219-4d32-ba81-107f234ba409 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:43.707601 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 614/1233] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:27:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:27:43.712817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d3cf-36b1-4190-b823-d8fc57ad5e65 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:43.713264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d3cf-36b1-4190-b823-d8fc57ad5e65 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:43.713354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa4d3cf-36b1-4190-b823-d8fc57ad5e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:43.731454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8fa4d3cf-36b1-4190-b823-d8fc57ad5e65 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:27:43.732682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8fa4d3cf-36b1-4190-b823-d8fc57ad5e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:27:43.812867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 620/1234] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:27:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:27:44.090315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af37d2a-5219-4d32-ba81-107f234ba409 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:44.117904 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:44.201748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af37d2a-5219-4d32-ba81-107f234ba409 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:44.236305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8275-b9c0-4678-9907-8e98c93b8b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:44.236960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8275-b9c0-4678-9907-8e98c93b8b0a None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:44.237238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8275-b9c0-4678-9907-8e98c93b8b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:44.237508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aad8275-b9c0-4678-9907-8e98c93b8b0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:44.248414 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aad8275-b9c0-4678-9907-8e98c93b8b0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-5aad8275-b9c0-4678-9907-8e98c93b8b0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:27:44.253277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:44.254348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:44.255246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:44.255246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:44.255246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:44.255246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:44.255246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:27:44.255246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:27:44.255246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:27:44.255246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:27:44.255246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:27:44.255246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:27:44.255246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 06:27:44.255246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:44.255246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 615/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 13 06:27:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:44.261235 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4d3cf-36b1-4190-b823-d8fc57ad5e65 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:44.311707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:44.372163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa4d3cf-36b1-4190-b823-d8fc57ad5e65 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:44.408739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1da89-ced2-4ff2-b0f4-022931ab1b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:44.409347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1da89-ced2-4ff2-b0f4-022931ab1b72 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:44.409627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1da89-ced2-4ff2-b0f4-022931ab1b72 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:44.409902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b1da89-ced2-4ff2-b0f4-022931ab1b72 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:44.410571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1da89-ced2-4ff2-b0f4-022931ab1b72 None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:44.410877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1da89-ced2-4ff2-b0f4-022931ab1b72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:44.412240 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b1da89-ced2-4ff2-b0f4-022931ab1b72 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:44.420819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 621/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 13 06:27:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:44.426674 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8275-b9c0-4678-9907-8e98c93b8b0a None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:44.520401 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:44.539659 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aad8275-b9c0-4678-9907-8e98c93b8b0a None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:44.580224 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e3da5-1f0e-4176-a6ed-432915d8cbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:44.580888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e3da5-1f0e-4176-a6ed-432915d8cbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:44.581170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e3da5-1f0e-4176-a6ed-432915d8cbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:44.581446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e3da5-1f0e-4176-a6ed-432915d8cbd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:44.592329 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e3da5-1f0e-4176-a6ed-432915d8cbd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:44.593801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e3da5-1f0e-4176-a6ed-432915d8cbd7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-fc0e3da5-1f0e-4176-a6ed-432915d8cbd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:27:44.610190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:44.611208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:27:44.617166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:27:44.617166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:44.617166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:44.617166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 616/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:44.617414 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1da89-ced2-4ff2-b0f4-022931ab1b72 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:44.731907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b1da89-ced2-4ff2-b0f4-022931ab1b72 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:44.741422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:44.768642 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4531a5-9309-4ab7-b71b-d7973afc78db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:44.769272 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4531a5-9309-4ab7-b71b-d7973afc78db None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:44.769550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4531a5-9309-4ab7-b71b-d7973afc78db None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:44.769821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4531a5-9309-4ab7-b71b-d7973afc78db None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:44.770456 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4531a5-9309-4ab7-b71b-d7973afc78db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:44.770757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4531a5-9309-4ab7-b71b-d7973afc78db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:44.772151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4531a5-9309-4ab7-b71b-d7973afc78db None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:44.786624 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 622/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:44.792539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e3da5-1f0e-4176-a6ed-432915d8cbd7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:44.907016 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e3da5-1f0e-4176-a6ed-432915d8cbd7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:44.945919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c6879-a42e-4b82-a3f1-76553b0fdff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:44.947074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c6879-a42e-4b82-a3f1-76553b0fdff0 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:44.947354 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c6879-a42e-4b82-a3f1-76553b0fdff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:44.947625 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c6879-a42e-4b82-a3f1-76553b0fdff0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:44.950496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:44.956046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c6879-a42e-4b82-a3f1-76553b0fdff0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:44.957911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c6879-a42e-4b82-a3f1-76553b0fdff0 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-743c6879-a42e-4b82-a3f1-76553b0fdff0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:27:44.969749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:44.970854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:44.971844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:44.971844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:44.971844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:27:44.971844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:27:44.971844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:27:44.971844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:27:44.971844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:27:44.971844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:27:44.971844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:27:44.971844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:44.971844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 617/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:44.977196 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4531a5-9309-4ab7-b71b-d7973afc78db None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:45.098256 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4531a5-9309-4ab7-b71b-d7973afc78db None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:45.138113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10894ed9-93b5-4632-8c37-bb52eb40e227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:45.138723 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10894ed9-93b5-4632-8c37-bb52eb40e227 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:45.139016 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10894ed9-93b5-4632-8c37-bb52eb40e227 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:45.139278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10894ed9-93b5-4632-8c37-bb52eb40e227 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:45.140015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10894ed9-93b5-4632-8c37-bb52eb40e227 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:45.140316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10894ed9-93b5-4632-8c37-bb52eb40e227 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:45.141781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10894ed9-93b5-4632-8c37-bb52eb40e227 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:45.159801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 623/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Sep 13 06:27:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:45.165568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c6879-a42e-4b82-a3f1-76553b0fdff0 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:45.271383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c6879-a42e-4b82-a3f1-76553b0fdff0 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:45.307277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ca0d0-0dee-49e2-b255-7fe0530f33b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:45.307895 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ca0d0-0dee-49e2-b255-7fe0530f33b7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:45.308192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ca0d0-0dee-49e2-b255-7fe0530f33b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:45.308463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ca0d0-0dee-49e2-b255-7fe0530f33b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:45.383293 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:45.392329 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ca0d0-0dee-49e2-b255-7fe0530f33b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:45.394269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ca0d0-0dee-49e2-b255-7fe0530f33b7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:45.509625 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 618/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:27:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:27:45.517054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10894ed9-93b5-4632-8c37-bb52eb40e227 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:45.552331 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:45.636130 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10894ed9-93b5-4632-8c37-bb52eb40e227 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:45.672135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13682bc6-afad-4f30-83c5-c7bc671822ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:45.672800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13682bc6-afad-4f30-83c5-c7bc671822ef None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:45.673080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13682bc6-afad-4f30-83c5-c7bc671822ef None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:45.673357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13682bc6-afad-4f30-83c5-c7bc671822ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:45.684410 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13682bc6-afad-4f30-83c5-c7bc671822ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:45.685983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13682bc6-afad-4f30-83c5-c7bc671822ef None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-13682bc6-afad-4f30-83c5-c7bc671822ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:27:45.701221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:45.702352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:27:45.703364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:27:45.703364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:45.703364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:27:45.703364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 624/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:27:45.708138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ca0d0-0dee-49e2-b255-7fe0530f33b7 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:45.815766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:45.823379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ca0d0-0dee-49e2-b255-7fe0530f33b7 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:45.860765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc096f69-ea58-4dc8-a7d3-8066e79f7f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:45.861530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc096f69-ea58-4dc8-a7d3-8066e79f7f66 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:45.861909 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc096f69-ea58-4dc8-a7d3-8066e79f7f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:45.862254 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc096f69-ea58-4dc8-a7d3-8066e79f7f66 None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:45.862997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc096f69-ea58-4dc8-a7d3-8066e79f7f66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:45.863298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc096f69-ea58-4dc8-a7d3-8066e79f7f66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:45.864644 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc096f69-ea58-4dc8-a7d3-8066e79f7f66 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:45.878929 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 619/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:45.885218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13682bc6-afad-4f30-83c5-c7bc671822ef None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:45.969575 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:45.992822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13682bc6-afad-4f30-83c5-c7bc671822ef None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:46.033685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f797ca-ff20-4bff-af4e-dd385bcf2487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:46.034318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f797ca-ff20-4bff-af4e-dd385bcf2487 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:46.034583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f797ca-ff20-4bff-af4e-dd385bcf2487 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:46.034930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f797ca-ff20-4bff-af4e-dd385bcf2487 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:46.042514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f797ca-ff20-4bff-af4e-dd385bcf2487 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:46.044003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f797ca-ff20-4bff-af4e-dd385bcf2487 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:46.056239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-11f797ca-ff20-4bff-af4e-dd385bcf2487 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:27:46.056239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:46.056239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:46.056239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:46.056239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:46.056239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:46.056239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:46.056239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:46.056239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:46.056239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:46.056239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:46.056239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:46.056239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:27:46.056239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:27:46.056239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:46.057538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:46.058572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:27:46.058572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:27:46.058572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:27:46.058572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:27:46.058572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:27:46.058572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:27:46.058572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:27:46.058572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:27:46.058572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 625/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:27:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:46.063546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc096f69-ea58-4dc8-a7d3-8066e79f7f66 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:46.184255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc096f69-ea58-4dc8-a7d3-8066e79f7f66 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:46.221675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e52f16-bbf5-435a-a790-a6b712665122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:46.222294 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e52f16-bbf5-435a-a790-a6b712665122 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:46.222574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e52f16-bbf5-435a-a790-a6b712665122 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:46.222849 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e52f16-bbf5-435a-a790-a6b712665122 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:46.223546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e52f16-bbf5-435a-a790-a6b712665122 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:46.223912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e52f16-bbf5-435a-a790-a6b712665122 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:46.225400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e52f16-bbf5-435a-a790-a6b712665122 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:46.237806 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 620/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:27:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:46.244646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f797ca-ff20-4bff-af4e-dd385bcf2487 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:46.356583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f797ca-ff20-4bff-af4e-dd385bcf2487 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:46.397852 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58775c-bc5d-4e45-81f9-87158331f88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:46.398707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58775c-bc5d-4e45-81f9-87158331f88e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:46.399185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58775c-bc5d-4e45-81f9-87158331f88e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:46.400153 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58775c-bc5d-4e45-81f9-87158331f88e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:46.401089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58775c-bc5d-4e45-81f9-87158331f88e None admin] RBAC: Adding query filter params (role.id=dc60d33cb0c649b3b903d99258a19c98, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=b84a23931b60457e865f056352a396d0) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:46.401443 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58775c-bc5d-4e45-81f9-87158331f88e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:46.403036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58775c-bc5d-4e45-81f9-87158331f88e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:46.428698 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 626/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:27:46 2022] GET /identity/v3/role_assignments?user.id=b84a23931b60457e865f056352a396d0&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=dc60d33cb0c649b3b903d99258a19c98 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:27:48.795851 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0352b2c-fb19-46f4-8863-63260edf27e0 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:48.796439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0352b2c-fb19-46f4-8863-63260edf27e0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:48.796439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0352b2c-fb19-46f4-8863-63260edf27e0 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:48.798351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 621/1247] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:27:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:27:48.805782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236209a3-59fb-4590-860d-558497339e47 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:48.806246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236209a3-59fb-4590-860d-558497339e47 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:48.806360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236209a3-59fb-4590-860d-558497339e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:48.813104 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:48.826626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-236209a3-59fb-4590-860d-558497339e47 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:27:48.828031 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-236209a3-59fb-4590-860d-558497339e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:27:48.906609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 627/1248] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:27:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:27:49.197187 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0352b2c-fb19-46f4-8863-63260edf27e0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:49.218123 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:49.311716 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0352b2c-fb19-46f4-8863-63260edf27e0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:49.354413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b22509-13b7-4327-87d9-f1cd7d4fc831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:49.355160 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b22509-13b7-4327-87d9-f1cd7d4fc831 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:49.355472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b22509-13b7-4327-87d9-f1cd7d4fc831 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:49.355796 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b22509-13b7-4327-87d9-f1cd7d4fc831 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:49.368184 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b22509-13b7-4327-87d9-f1cd7d4fc831 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-42b22509-13b7-4327-87d9-f1cd7d4fc831 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:27:49.373955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:49.375034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:49.375962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:49.375962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:49.375962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:49.375962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:49.375962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:27:49.375962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:27:49.375962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:27:49.375962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:27:49.375962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:27:49.375962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:27:49.375962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:27:49.375962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:49.375962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 622/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:27:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:49.381538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236209a3-59fb-4590-860d-558497339e47 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:49.493807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236209a3-59fb-4590-860d-558497339e47 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:49.526279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:49.531725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7964fcd-046c-418c-936a-b70c3b2b5bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:49.532331 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7964fcd-046c-418c-936a-b70c3b2b5bae None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:49.532609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7964fcd-046c-418c-936a-b70c3b2b5bae None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:49.532914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7964fcd-046c-418c-936a-b70c3b2b5bae None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:49.533573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7964fcd-046c-418c-936a-b70c3b2b5bae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:49.533875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7964fcd-046c-418c-936a-b70c3b2b5bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:49.535274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7964fcd-046c-418c-936a-b70c3b2b5bae None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:49.543581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 628/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:27:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:49.549554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b22509-13b7-4327-87d9-f1cd7d4fc831 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:49.636260 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:49.662279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b22509-13b7-4327-87d9-f1cd7d4fc831 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:49.699210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf164c1-8262-4f30-aab4-5cace359b845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:49.699858 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf164c1-8262-4f30-aab4-5cace359b845 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:49.700158 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf164c1-8262-4f30-aab4-5cace359b845 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:49.700417 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf164c1-8262-4f30-aab4-5cace359b845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:49.712156 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf164c1-8262-4f30-aab4-5cace359b845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:49.713655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf164c1-8262-4f30-aab4-5cace359b845 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-abf164c1-8262-4f30-aab4-5cace359b845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:27:49.729125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:49.730188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:27:49.731129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:27:49.731129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:49.731129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:49.731129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 623/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 06:27:49.736196 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7964fcd-046c-418c-936a-b70c3b2b5bae None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:49.842683 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7964fcd-046c-418c-936a-b70c3b2b5bae None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:49.882940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe6b29-00a0-4625-a7af-2e9013face6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:49.883555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe6b29-00a0-4625-a7af-2e9013face6f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:49.883856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe6b29-00a0-4625-a7af-2e9013face6f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:49.884130 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe6b29-00a0-4625-a7af-2e9013face6f None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:49.884814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe6b29-00a0-4625-a7af-2e9013face6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:49.885123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe6b29-00a0-4625-a7af-2e9013face6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:49.886504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffe6b29-00a0-4625-a7af-2e9013face6f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:49.899272 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 629/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:49.905208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf164c1-8262-4f30-aab4-5cace359b845 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:50.009419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf164c1-8262-4f30-aab4-5cace359b845 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:50.035991 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:50.045104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d475cb1-3a43-4d03-9631-ddd2da337581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:50.045739 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d475cb1-3a43-4d03-9631-ddd2da337581 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:50.046105 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d475cb1-3a43-4d03-9631-ddd2da337581 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:50.046378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d475cb1-3a43-4d03-9631-ddd2da337581 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:50.054213 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d475cb1-3a43-4d03-9631-ddd2da337581 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:50.056467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d475cb1-3a43-4d03-9631-ddd2da337581 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-4d475cb1-3a43-4d03-9631-ddd2da337581 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:27:50.067467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:50.068639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:50.069708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:50.069708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:50.069708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:27:50.069708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:27:50.069708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:27:50.069708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:27:50.069708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:27:50.069708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:27:50.069708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:27:50.069708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:50.069708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 624/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:50.074489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe6b29-00a0-4625-a7af-2e9013face6f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:50.132954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:50.180167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe6b29-00a0-4625-a7af-2e9013face6f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:50.214978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc651ad3-3c02-40f4-9523-d5916840887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:50.215573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc651ad3-3c02-40f4-9523-d5916840887f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:50.215854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc651ad3-3c02-40f4-9523-d5916840887f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:50.216120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc651ad3-3c02-40f4-9523-d5916840887f None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:50.216866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc651ad3-3c02-40f4-9523-d5916840887f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:50.217168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc651ad3-3c02-40f4-9523-d5916840887f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:50.218573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc651ad3-3c02-40f4-9523-d5916840887f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:50.235750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 630/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Sep 13 06:27:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:50.241633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d475cb1-3a43-4d03-9631-ddd2da337581 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:50.349310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d475cb1-3a43-4d03-9631-ddd2da337581 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:50.387639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4c2fc-ea7b-4216-9f26-a1bfa999b9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:50.388174 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4c2fc-ea7b-4216-9f26-a1bfa999b9d1 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:50.388454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4c2fc-ea7b-4216-9f26-a1bfa999b9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:50.388755 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4c2fc-ea7b-4216-9f26-a1bfa999b9d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:50.441424 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:50.453569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4c2fc-ea7b-4216-9f26-a1bfa999b9d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:50.454995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4c2fc-ea7b-4216-9f26-a1bfa999b9d1 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:50.549723 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 625/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:27:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:27:50.555724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc651ad3-3c02-40f4-9523-d5916840887f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:50.652491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc651ad3-3c02-40f4-9523-d5916840887f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:50.665145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:50.685493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485b252-426b-4e75-99da-912b006fbefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:50.686103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485b252-426b-4e75-99da-912b006fbefd None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:50.686378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485b252-426b-4e75-99da-912b006fbefd None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:50.686646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485b252-426b-4e75-99da-912b006fbefd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:50.696801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485b252-426b-4e75-99da-912b006fbefd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:50.698227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485b252-426b-4e75-99da-912b006fbefd None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-1485b252-426b-4e75-99da-912b006fbefd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:27:50.712893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:50.714021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:27:50.714927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:27:50.714927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:50.714927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:27:50.714927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 631/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:50.719758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4c2fc-ea7b-4216-9f26-a1bfa999b9d1 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:50.801914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:50.813657 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4c2fc-ea7b-4216-9f26-a1bfa999b9d1 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:50.847063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fed10-8e28-4d7e-9966-d2ae946ec67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:50.847651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fed10-8e28-4d7e-9966-d2ae946ec67c None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:50.847926 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fed10-8e28-4d7e-9966-d2ae946ec67c None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:50.848189 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fed10-8e28-4d7e-9966-d2ae946ec67c None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:50.848849 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fed10-8e28-4d7e-9966-d2ae946ec67c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:50.849144 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fed10-8e28-4d7e-9966-d2ae946ec67c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:50.850512 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7fed10-8e28-4d7e-9966-d2ae946ec67c None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:50.861597 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 626/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:50.867409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485b252-426b-4e75-99da-912b006fbefd None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:50.965077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485b252-426b-4e75-99da-912b006fbefd None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:50.998945 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4a5c-582e-4511-a7af-67eb19d98acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:50.999552 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4a5c-582e-4511-a7af-67eb19d98acf None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:50.999830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4a5c-582e-4511-a7af-67eb19d98acf None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:51.000102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5a4a5c-582e-4511-a7af-67eb19d98acf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:51.006530 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a4a5c-582e-4511-a7af-67eb19d98acf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:51.007957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5a4a5c-582e-4511-a7af-67eb19d98acf None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:51.019364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-eb5a4a5c-582e-4511-a7af-67eb19d98acf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:27:51.019364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:51.019364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:51.019364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:51.019364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:51.019364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:51.019364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:51.019364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:51.019364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:51.019364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:51.019364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:51.019364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:51.019364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:27:51.019364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:27:51.019364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:51.020380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:51.021685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:27:51.021685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:27:51.021685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:27:51.021685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:27:51.021685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:27:51.021685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:27:51.021685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:27:51.021685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:27:51.021685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 632/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:27:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:51.026179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fed10-8e28-4d7e-9966-d2ae946ec67c None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:51.120933 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fed10-8e28-4d7e-9966-d2ae946ec67c None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:51.153155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6883fd5-4387-4b49-91e4-cb53a5f424a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:51.153740 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6883fd5-4387-4b49-91e4-cb53a5f424a7 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:51.154020 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6883fd5-4387-4b49-91e4-cb53a5f424a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:51.154286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6883fd5-4387-4b49-91e4-cb53a5f424a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:51.154959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6883fd5-4387-4b49-91e4-cb53a5f424a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:51.155258 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6883fd5-4387-4b49-91e4-cb53a5f424a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:51.156655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6883fd5-4387-4b49-91e4-cb53a5f424a7 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:51.167995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 627/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:27:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:51.173836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4a5c-582e-4511-a7af-67eb19d98acf None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:51.199312 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:51.271007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5a4a5c-582e-4511-a7af-67eb19d98acf None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:51.303222 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e7a02c-dd5a-41f6-8ef1-b4669a9ae7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:51.303803 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7a02c-dd5a-41f6-8ef1-b4669a9ae7cc None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:51.304083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7a02c-dd5a-41f6-8ef1-b4669a9ae7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:51.304354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e7a02c-dd5a-41f6-8ef1-b4669a9ae7cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:51.305100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7a02c-dd5a-41f6-8ef1-b4669a9ae7cc None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=b84a23931b60457e865f056352a396d0) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:51.305408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7a02c-dd5a-41f6-8ef1-b4669a9ae7cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:51.307328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e7a02c-dd5a-41f6-8ef1-b4669a9ae7cc None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:51.312463 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 633/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:27:51 2022] GET /identity/v3/role_assignments?user.id=b84a23931b60457e865f056352a396d0&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=6382a06103714d068409d25cbeb48744 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:53.427898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532e0f7-abcf-4d07-ba5a-e7b8f7c77f5a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:53.428466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532e0f7-abcf-4d07-ba5a-e7b8f7c77f5a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:53.428466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7532e0f7-abcf-4d07-ba5a-e7b8f7c77f5a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:53.429838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 628/1261] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:27:53.434919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435fbae-81b4-4f5b-b386-e763bb161206 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:53.435346 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435fbae-81b4-4f5b-b386-e763bb161206 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:53.435454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435fbae-81b4-4f5b-b386-e763bb161206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:53.453331 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f435fbae-81b4-4f5b-b386-e763bb161206 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:27:53.454511 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f435fbae-81b4-4f5b-b386-e763bb161206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:27:53.519357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 634/1262] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:27:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:27:53.788855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532e0f7-abcf-4d07-ba5a-e7b8f7c77f5a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:53.799545 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:53.886870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7532e0f7-abcf-4d07-ba5a-e7b8f7c77f5a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:53.919168 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531eb8c7-e184-4b84-976f-cbebaee61baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:53.919773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531eb8c7-e184-4b84-976f-cbebaee61baa None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:53.920051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531eb8c7-e184-4b84-976f-cbebaee61baa None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:53.920321 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531eb8c7-e184-4b84-976f-cbebaee61baa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:53.930018 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531eb8c7-e184-4b84-976f-cbebaee61baa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-531eb8c7-e184-4b84-976f-cbebaee61baa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:27:53.935286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:53.936379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:53.937479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:53.937479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:53.937479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:53.937479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:53.937479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:27:53.937479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:27:53.937479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:27:53.937479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:27:53.937479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:27:53.937479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:27:53.937479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:27:53.937479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:53.937479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 629/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:27:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:53.942480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435fbae-81b4-4f5b-b386-e763bb161206 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:53.960194 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:54.045564 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435fbae-81b4-4f5b-b386-e763bb161206 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:54.080261 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d1901-c555-48a9-84bd-7bf26adb2aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:54.080883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d1901-c555-48a9-84bd-7bf26adb2aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:54.081162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d1901-c555-48a9-84bd-7bf26adb2aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:54.081432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d1901-c555-48a9-84bd-7bf26adb2aa1 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:54.082085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d1901-c555-48a9-84bd-7bf26adb2aa1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:54.082387 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d1901-c555-48a9-84bd-7bf26adb2aa1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:54.083733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5d1901-c555-48a9-84bd-7bf26adb2aa1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:54.091996 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 635/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:27:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:54.097848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531eb8c7-e184-4b84-976f-cbebaee61baa None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:54.162704 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:54.195499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531eb8c7-e184-4b84-976f-cbebaee61baa None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:54.227825 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed919d-bb9a-4a1f-b654-501f9b26a539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:54.228426 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed919d-bb9a-4a1f-b654-501f9b26a539 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:54.228728 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed919d-bb9a-4a1f-b654-501f9b26a539 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:54.229005 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed919d-bb9a-4a1f-b654-501f9b26a539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:54.238565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed919d-bb9a-4a1f-b654-501f9b26a539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:54.239975 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed919d-bb9a-4a1f-b654-501f9b26a539 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-99ed919d-bb9a-4a1f-b654-501f9b26a539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:27:54.254709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:54.255801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:27:54.256946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:27:54.256946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:54.256946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:54.256946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 630/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:54.263635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d1901-c555-48a9-84bd-7bf26adb2aa1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:54.346281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:54.370360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5d1901-c555-48a9-84bd-7bf26adb2aa1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:54.407840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c879f-c768-4057-bd3c-7adb1c7800f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:54.408439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c879f-c768-4057-bd3c-7adb1c7800f2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:54.408758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c879f-c768-4057-bd3c-7adb1c7800f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:54.409031 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c879f-c768-4057-bd3c-7adb1c7800f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:54.409668 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c879f-c768-4057-bd3c-7adb1c7800f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:54.409978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c879f-c768-4057-bd3c-7adb1c7800f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:54.411323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c879f-c768-4057-bd3c-7adb1c7800f2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:54.423289 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 636/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:54.429131 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed919d-bb9a-4a1f-b654-501f9b26a539 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:54.525547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed919d-bb9a-4a1f-b654-501f9b26a539 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:54.544530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:54.558934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb35aab-3736-4130-91fa-53f09ca6c593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:54.559551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35aab-3736-4130-91fa-53f09ca6c593 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:54.559831 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35aab-3736-4130-91fa-53f09ca6c593 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:54.560104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35aab-3736-4130-91fa-53f09ca6c593 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:54.568238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb35aab-3736-4130-91fa-53f09ca6c593 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:54.569688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb35aab-3736-4130-91fa-53f09ca6c593 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-3fb35aab-3736-4130-91fa-53f09ca6c593 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:27:54.580593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:54.581737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:54.582828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:54.582828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:54.582828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:27:54.582828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:27:54.582828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:27:54.582828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:27:54.582828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:27:54.582828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:27:54.582828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:27:54.582828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:54.582828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 631/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:54.587514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c879f-c768-4057-bd3c-7adb1c7800f2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:54.684903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c879f-c768-4057-bd3c-7adb1c7800f2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:54.717918 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34034ce-5003-433f-8888-c67c23e115af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:54.718508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34034ce-5003-433f-8888-c67c23e115af None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:54.718785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34034ce-5003-433f-8888-c67c23e115af None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:54.719053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34034ce-5003-433f-8888-c67c23e115af None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:54.719758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34034ce-5003-433f-8888-c67c23e115af None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:54.720060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34034ce-5003-433f-8888-c67c23e115af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:54.721480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34034ce-5003-433f-8888-c67c23e115af None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:54.730257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:54.738905 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 637/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Sep 13 06:27:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:54.745194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb35aab-3736-4130-91fa-53f09ca6c593 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:54.842142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb35aab-3736-4130-91fa-53f09ca6c593 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:54.874563 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673b6c5-d78d-4158-b5db-8221ab9d1cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:54.875177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673b6c5-d78d-4158-b5db-8221ab9d1cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:54.875456 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673b6c5-d78d-4158-b5db-8221ab9d1cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:54.875729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e673b6c5-d78d-4158-b5db-8221ab9d1cb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:54.885814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673b6c5-d78d-4158-b5db-8221ab9d1cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:54.887227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e673b6c5-d78d-4158-b5db-8221ab9d1cb6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-e673b6c5-d78d-4158-b5db-8221ab9d1cb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:27:54.901310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:54.902428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:27:54.903346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:27:54.903346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:54.903346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:54.903346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 632/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:54.908301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34034ce-5003-433f-8888-c67c23e115af None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:55.003977 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34034ce-5003-433f-8888-c67c23e115af None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:55.036679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e234b-28f0-416d-b460-283d177a77a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:55.037273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e234b-28f0-416d-b460-283d177a77a0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:55.037550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e234b-28f0-416d-b460-283d177a77a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:55.037823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e234b-28f0-416d-b460-283d177a77a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:55.038454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e234b-28f0-416d-b460-283d177a77a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:55.038762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e234b-28f0-416d-b460-283d177a77a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:55.040655 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e234b-28f0-416d-b460-283d177a77a0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:55.051896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 638/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:55.057750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673b6c5-d78d-4158-b5db-8221ab9d1cb6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:55.088376 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:55.156073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e673b6c5-d78d-4158-b5db-8221ab9d1cb6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:55.188106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b8229-455f-48e2-aab3-e21e53479ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:55.188739 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b8229-455f-48e2-aab3-e21e53479ad6 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:55.189020 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b8229-455f-48e2-aab3-e21e53479ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:55.189292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b8229-455f-48e2-aab3-e21e53479ad6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:55.195678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b8229-455f-48e2-aab3-e21e53479ad6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:55.197632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b8229-455f-48e2-aab3-e21e53479ad6 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:55.208495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-312b8229-455f-48e2-aab3-e21e53479ad6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:27:55.208495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:55.208495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:55.208495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:55.208495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:55.208495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:55.208495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:55.208495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:55.208495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:55.208495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:55.208495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:55.208495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:55.208495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:27:55.208495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:27:55.208495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:55.209560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:55.210487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:27:55.210487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:27:55.210487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:27:55.210487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:27:55.210487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:27:55.210487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:27:55.210487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:27:55.210487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:55.210487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 633/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:27:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:55.216026 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e234b-28f0-416d-b460-283d177a77a0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:55.272786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:55.314347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e234b-28f0-416d-b460-283d177a77a0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:55.352048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cd2f32-d7a7-40da-bf7f-8cb1fc1b665f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:55.352717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd2f32-d7a7-40da-bf7f-8cb1fc1b665f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:55.352973 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd2f32-d7a7-40da-bf7f-8cb1fc1b665f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:55.353249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cd2f32-d7a7-40da-bf7f-8cb1fc1b665f None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:55.353947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd2f32-d7a7-40da-bf7f-8cb1fc1b665f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:55.354278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd2f32-d7a7-40da-bf7f-8cb1fc1b665f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:55.355706 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cd2f32-d7a7-40da-bf7f-8cb1fc1b665f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:55.367479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 639/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:27:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:27:55.373743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b8229-455f-48e2-aab3-e21e53479ad6 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:55.461217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:55.470356 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b8229-455f-48e2-aab3-e21e53479ad6 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:55.503597 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a408a2-b4ce-4f52-9f5c-9b72970e9614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:55.504240 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a408a2-b4ce-4f52-9f5c-9b72970e9614 None admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:55.504516 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a408a2-b4ce-4f52-9f5c-9b72970e9614 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:55.504821 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a408a2-b4ce-4f52-9f5c-9b72970e9614 None admin] PATH_INFO: `/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/b84a23931b60457e865f056352a396d0/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:55.506718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a408a2-b4ce-4f52-9f5c-9b72970e9614 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce1c3f0aa3b746108e73737491b003e7, user_id=b84a23931b60457e865f056352a396d0, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:55.508131 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a408a2-b4ce-4f52-9f5c-9b72970e9614 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:55.521441 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 634/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 13 06:27:55 2022] PUT /identity/v3/projects/ce1c3f0aa3b746108e73737491b003e7/users/b84a23931b60457e865f056352a396d0/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:27:57.619603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd18544-c287-4d40-838d-491664664507 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:57.620168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd18544-c287-4d40-838d-491664664507 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:57.620168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd18544-c287-4d40-838d-491664664507 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:57.621759 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 640/1274] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:27:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:27:57.627130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7c4d5-bdfe-4d33-9ec7-783ad84bbf7d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:57.627554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7c4d5-bdfe-4d33-9ec7-783ad84bbf7d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:57.627663 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7c4d5-bdfe-4d33-9ec7-783ad84bbf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:57.645594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-63d7c4d5-bdfe-4d33-9ec7-783ad84bbf7d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:27:57.647244 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-63d7c4d5-bdfe-4d33-9ec7-783ad84bbf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:27:57.712034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 635/1275] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:27:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:27:57.977854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd18544-c287-4d40-838d-491664664507 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:58.077679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd18544-c287-4d40-838d-491664664507 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:58.094679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:58.112486 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319889-a9f4-41f3-83a1-2493f162389f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:58.113142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319889-a9f4-41f3-83a1-2493f162389f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:58.113423 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319889-a9f4-41f3-83a1-2493f162389f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:58.113696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c319889-a9f4-41f3-83a1-2493f162389f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:58.124494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c319889-a9f4-41f3-83a1-2493f162389f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2c319889-a9f4-41f3-83a1-2493f162389f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 06:27:58.129255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:58.130362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:58.131602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:58.131602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:58.131602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:58.131602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:58.131602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 06:27:58.131602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 06:27:58.131602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 06:27:58.131602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 06:27:58.131602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 06:27:58.131602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 06:27:58.131602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 06:27:58.131602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:27:58.131602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 641/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 13 06:27:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:58.136388 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7c4d5-bdfe-4d33-9ec7-783ad84bbf7d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:58.221984 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:58.243887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7c4d5-bdfe-4d33-9ec7-783ad84bbf7d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:58.279558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336c07b-c953-45ad-b3a5-abcac05ac496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:58.280192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336c07b-c953-45ad-b3a5-abcac05ac496 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:58.280475 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336c07b-c953-45ad-b3a5-abcac05ac496 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:58.284539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6336c07b-c953-45ad-b3a5-abcac05ac496 None admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:58.285306 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336c07b-c953-45ad-b3a5-abcac05ac496 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:58.285621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336c07b-c953-45ad-b3a5-abcac05ac496 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:58.286991 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6336c07b-c953-45ad-b3a5-abcac05ac496 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:58.295598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 636/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 13 06:27:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:58.301509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319889-a9f4-41f3-83a1-2493f162389f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:58.420363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c319889-a9f4-41f3-83a1-2493f162389f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:58.453960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b202ac-e9b1-4b1d-97ef-73aeefa91e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:58.454576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b202ac-e9b1-4b1d-97ef-73aeefa91e2c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:58.454850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b202ac-e9b1-4b1d-97ef-73aeefa91e2c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:58.455119 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b202ac-e9b1-4b1d-97ef-73aeefa91e2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:58.465827 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b202ac-e9b1-4b1d-97ef-73aeefa91e2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:58.467254 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b202ac-e9b1-4b1d-97ef-73aeefa91e2c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-52b202ac-e9b1-4b1d-97ef-73aeefa91e2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:27:58.482659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:58.483783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:27:58.484784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:27:58.484784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:58.484784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:27:58.484784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 642/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:58.489586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336c07b-c953-45ad-b3a5-abcac05ac496 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:58.585298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6336c07b-c953-45ad-b3a5-abcac05ac496 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:58.618036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a80f16-24b5-43a2-8670-668ada4d256d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:58.618979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a80f16-24b5-43a2-8670-668ada4d256d None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:58.619386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a80f16-24b5-43a2-8670-668ada4d256d None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:58.619785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a80f16-24b5-43a2-8670-668ada4d256d None admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:58.620576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a80f16-24b5-43a2-8670-668ada4d256d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:58.620910 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a80f16-24b5-43a2-8670-668ada4d256d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:58.622509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a80f16-24b5-43a2-8670-668ada4d256d None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:58.634349 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 637/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:58.640051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b202ac-e9b1-4b1d-97ef-73aeefa91e2c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:58.672286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:58.742444 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b202ac-e9b1-4b1d-97ef-73aeefa91e2c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:58.777752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa756f-632b-46f3-980e-7057f87f813a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:58.778372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa756f-632b-46f3-980e-7057f87f813a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:58.778654 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa756f-632b-46f3-980e-7057f87f813a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:58.778925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa756f-632b-46f3-980e-7057f87f813a None admin] PATH_INFO: `/v3/users/placement` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:58.786286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa756f-632b-46f3-980e-7057f87f813a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:58.787709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaa756f-632b-46f3-980e-7057f87f813a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2eaa756f-632b-46f3-980e-7057f87f813a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 06:27:58.799477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:58.800587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:58.801960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:58.801960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:58.801960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 06:27:58.801960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 06:27:58.801960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 06:27:58.801960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 06:27:58.801960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 06:27:58.801960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 06:27:58.801960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 06:27:58.801960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:27:58.801960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 643/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:58.807042 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a80f16-24b5-43a2-8670-668ada4d256d None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:58.810772 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:58.904032 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a80f16-24b5-43a2-8670-668ada4d256d None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:58.937098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e152f-b886-4233-853c-6fcb66e1481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:58.937699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e152f-b886-4233-853c-6fcb66e1481b None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:58.937973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e152f-b886-4233-853c-6fcb66e1481b None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:58.938237 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e152f-b886-4233-853c-6fcb66e1481b None admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:58.938950 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e152f-b886-4233-853c-6fcb66e1481b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:58.939268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e152f-b886-4233-853c-6fcb66e1481b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:58.940641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e152f-b886-4233-853c-6fcb66e1481b None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:58.957664 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 638/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Sep 13 06:27:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:58.963434 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa756f-632b-46f3-980e-7057f87f813a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:59.049985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:59.060240 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaa756f-632b-46f3-980e-7057f87f813a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:59.091757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b55fbc-b781-435b-9ee0-ffaf8d901e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:59.092344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b55fbc-b781-435b-9ee0-ffaf8d901e41 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:59.092619 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b55fbc-b781-435b-9ee0-ffaf8d901e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:59.092917 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b55fbc-b781-435b-9ee0-ffaf8d901e41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:59.156631 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b55fbc-b781-435b-9ee0-ffaf8d901e41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:59.158026 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b55fbc-b781-435b-9ee0-ffaf8d901e41 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:59.245437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:59.256000 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 644/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 13 06:27:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 06:27:59.261952 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e152f-b886-4233-853c-6fcb66e1481b None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:59.322238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:59.363834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e152f-b886-4233-853c-6fcb66e1481b None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:59.395856 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fa8d3-1b88-46ed-bfc6-8d621f297661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:59.396467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fa8d3-1b88-46ed-bfc6-8d621f297661 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:59.396771 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fa8d3-1b88-46ed-bfc6-8d621f297661 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:59.397063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fa8d3-1b88-46ed-bfc6-8d621f297661 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:59.407195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fa8d3-1b88-46ed-bfc6-8d621f297661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:59.408579 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fa8d3-1b88-46ed-bfc6-8d621f297661 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-ca0fa8d3-1b88-46ed-bfc6-8d621f297661 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 06:27:59.423334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:59.424300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 06:27:59.425356 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 06:27:59.425356 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 06:27:59.425356 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:59.425356 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 639/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:59.430254 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b55fbc-b781-435b-9ee0-ffaf8d901e41 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:59.538106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b55fbc-b781-435b-9ee0-ffaf8d901e41 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:59.573435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4a9a3-2465-402a-9ae0-94702085fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:59.574019 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4a9a3-2465-402a-9ae0-94702085fb4f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:59.574294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4a9a3-2465-402a-9ae0-94702085fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:59.574561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4a9a3-2465-402a-9ae0-94702085fb4f None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:59.575184 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4a9a3-2465-402a-9ae0-94702085fb4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:59.575479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4a9a3-2465-402a-9ae0-94702085fb4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:59.576849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4a9a3-2465-402a-9ae0-94702085fb4f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:59.588066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 645/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 13 06:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:59.593752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fa8d3-1b88-46ed-bfc6-8d621f297661 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:59.690373 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fa8d3-1b88-46ed-bfc6-8d621f297661 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:59.703659 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:59.724093 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a899644-fbe2-4a5d-bfae-6e1d6cef5345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:59.724749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a899644-fbe2-4a5d-bfae-6e1d6cef5345 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:59.725034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a899644-fbe2-4a5d-bfae-6e1d6cef5345 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:59.725307 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a899644-fbe2-4a5d-bfae-6e1d6cef5345 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:59.731725 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a899644-fbe2-4a5d-bfae-6e1d6cef5345 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:59.733185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a899644-fbe2-4a5d-bfae-6e1d6cef5345 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:59.745013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application [None req-2a899644-fbe2-4a5d-bfae-6e1d6cef5345 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:27:59.745013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:27:59.745013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:27:59.745013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:27:59.745013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:27:59.745013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:27:59.745013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:27:59.745013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:27:59.745013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:27:59.745013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:27:59.745013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:27:59.745013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:27:59.745013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 06:27:59.745013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 06:27:59.745013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application with Lock( Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:27:59.746072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:27:59.747271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 06:27:59.747271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 06:27:59.747271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 06:27:59.747271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 06:27:59.747271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 06:27:59.747271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 06:27:59.747271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 06:27:59.747271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: ERROR keystone.server.flask.application Sep 13 06:27:59.747271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 640/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 13 06:27:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:27:59.752373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4a9a3-2465-402a-9ae0-94702085fb4f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:27:59.801417 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:27:59.850709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4a9a3-2465-402a-9ae0-94702085fb4f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:27:59.883215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12852c8b-87ad-43b7-bc39-cb4dd37590a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:27:59.884297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12852c8b-87ad-43b7-bc39-cb4dd37590a0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:27:59.884573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12852c8b-87ad-43b7-bc39-cb4dd37590a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:27:59.884879 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12852c8b-87ad-43b7-bc39-cb4dd37590a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:27:59.885562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12852c8b-87ad-43b7-bc39-cb4dd37590a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:27:59.885866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12852c8b-87ad-43b7-bc39-cb4dd37590a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:27:59.887285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12852c8b-87ad-43b7-bc39-cb4dd37590a0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:27:59.898820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 646/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 13 06:27:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:27:59.905529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a899644-fbe2-4a5d-bfae-6e1d6cef5345 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:28:00.002324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a899644-fbe2-4a5d-bfae-6e1d6cef5345 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:28:00.037111 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba685b7c-ca6f-4d72-a0eb-c9e822952f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:28:00.037703 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba685b7c-ca6f-4d72-a0eb-c9e822952f37 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:00.037981 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba685b7c-ca6f-4d72-a0eb-c9e822952f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:00.038252 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba685b7c-ca6f-4d72-a0eb-c9e822952f37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:00.038971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba685b7c-ca6f-4d72-a0eb-c9e822952f37 None admin] RBAC: Adding query filter params (role.id=6382a06103714d068409d25cbeb48744, scope.project.id=ce1c3f0aa3b746108e73737491b003e7, user.id=b84a23931b60457e865f056352a396d0) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:28:00.039279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba685b7c-ca6f-4d72-a0eb-c9e822952f37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:28:00.040746 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba685b7c-ca6f-4d72-a0eb-c9e822952f37 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:28:00.046257 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 641/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 13 06:27:59 2022] GET /identity/v3/role_assignments?user.id=b84a23931b60457e865f056352a396d0&scope.project.id=ce1c3f0aa3b746108e73737491b003e7&role.id=6382a06103714d068409d25cbeb48744 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:28:02.179991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68fcb6-df41-4c66-b19c-72c82d0d87d3 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:02.180577 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68fcb6-df41-4c66-b19c-72c82d0d87d3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:02.180577 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68fcb6-df41-4c66-b19c-72c82d0d87d3 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:02.182488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 647/1288] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:28:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:28:02.187599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdedcf6-51b8-48d5-ae2f-2643085780e5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:02.187990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdedcf6-51b8-48d5-ae2f-2643085780e5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:02.188145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdedcf6-51b8-48d5-ae2f-2643085780e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:02.205808 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5cdedcf6-51b8-48d5-ae2f-2643085780e5 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:28:02.207017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5cdedcf6-51b8-48d5-ae2f-2643085780e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:28:02.235020 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:28:02.270903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 642/1289] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:28:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:28:02.547688 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68fcb6-df41-4c66-b19c-72c82d0d87d3 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:28:02.648764 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68fcb6-df41-4c66-b19c-72c82d0d87d3 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:28:02.659242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:28:02.683394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35732437-977c-4a4e-b48d-a53fc09824e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:28:02.684014 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35732437-977c-4a4e-b48d-a53fc09824e1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:02.684290 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35732437-977c-4a4e-b48d-a53fc09824e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:02.684557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35732437-977c-4a4e-b48d-a53fc09824e1 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:02.685172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35732437-977c-4a4e-b48d-a53fc09824e1 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:28:02.686518 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35732437-977c-4a4e-b48d-a53fc09824e1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-35732437-977c-4a4e-b48d-a53fc09824e1 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:28:02.695199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:28:02.696389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:28:02.697673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:28:02.697673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:28:02.697673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:28:02.697673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:28:02.697673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:28:02.697673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:28:02.697673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:28:02.697673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:28:02.697673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:28:02.697673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:28:02.697673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:28:02.697673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:28:02.697673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:28:02.697673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:28:02.697673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 648/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 13 06:28:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:28:02.702367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdedcf6-51b8-48d5-ae2f-2643085780e5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:28:02.796682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdedcf6-51b8-48d5-ae2f-2643085780e5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:28:02.829011 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2fcb1-6580-4825-b489-b19b6f32e622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:28:02.829538 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2fcb1-6580-4825-b489-b19b6f32e622 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:02.829814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2fcb1-6580-4825-b489-b19b6f32e622 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:02.830084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2fcb1-6580-4825-b489-b19b6f32e622 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:02.830698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2fcb1-6580-4825-b489-b19b6f32e622 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:28:02.830997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2fcb1-6580-4825-b489-b19b6f32e622 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:28:02.832331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2fcb1-6580-4825-b489-b19b6f32e622 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:28:02.836963 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 643/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Sep 13 06:28:02 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:28:02.842458 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35732437-977c-4a4e-b48d-a53fc09824e1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:28:02.940335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35732437-977c-4a4e-b48d-a53fc09824e1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:28:02.972678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c52001-8a3b-4ea8-a16d-cfa89802bd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:28:02.973270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c52001-8a3b-4ea8-a16d-cfa89802bd6b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:02.973552 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c52001-8a3b-4ea8-a16d-cfa89802bd6b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:02.973823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c52001-8a3b-4ea8-a16d-cfa89802bd6b None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:02.974442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c52001-8a3b-4ea8-a16d-cfa89802bd6b None admin] RBAC: Adding query filter params (type=placement) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:28:02.974745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c52001-8a3b-4ea8-a16d-cfa89802bd6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:28:02.976088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c52001-8a3b-4ea8-a16d-cfa89802bd6b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:28:02.980931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 649/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Sep 13 06:28:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:28:05.095305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3c09c-a16e-4f62-a581-c6aa2b3bce10 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:05.095899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3c09c-a16e-4f62-a581-c6aa2b3bce10 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:05.095899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f3c09c-a16e-4f62-a581-c6aa2b3bce10 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:05.097212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 644/1293] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:28:05.102793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749021fa-e343-408f-8df6-f2a43f9ce16b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:05.103170 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749021fa-e343-408f-8df6-f2a43f9ce16b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:05.103335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749021fa-e343-408f-8df6-f2a43f9ce16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:05.121983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-749021fa-e343-408f-8df6-f2a43f9ce16b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:28:05.123166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-749021fa-e343-408f-8df6-f2a43f9ce16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:28:05.151323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:28:05.187868 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 650/1294] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:28:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 06:28:05.456234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3c09c-a16e-4f62-a581-c6aa2b3bce10 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:28:05.487305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:28:05.555462 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f3c09c-a16e-4f62-a581-c6aa2b3bce10 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:28:05.587852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad191dc2-a30f-478f-894e-60df6f08243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:28:05.588443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad191dc2-a30f-478f-894e-60df6f08243f None admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:05.588754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad191dc2-a30f-478f-894e-60df6f08243f None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:05.589029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad191dc2-a30f-478f-894e-60df6f08243f None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:05.589678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad191dc2-a30f-478f-894e-60df6f08243f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:28:05.591024 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad191dc2-a30f-478f-894e-60df6f08243f None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:28:05.605378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 645/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 13 06:28:05 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:28:07.719716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58c20-6a57-4382-9bc9-0b8816560cb8 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:07.720255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58c20-6a57-4382-9bc9-0b8816560cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:07.720255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d58c20-6a57-4382-9bc9-0b8816560cb8 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:07.721635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 651/1296] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:28:07.726843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3d67-3a30-4703-9848-04b7444c7502 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:07.727253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3d67-3a30-4703-9848-04b7444c7502 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:07.727391 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af3d67-3a30-4703-9848-04b7444c7502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:07.745667 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-23af3d67-3a30-4703-9848-04b7444c7502 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:28:07.747099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-23af3d67-3a30-4703-9848-04b7444c7502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:28:07.816835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 646/1297] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:28:07 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:28:08.083948 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d58c20-6a57-4382-9bc9-0b8816560cb8 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:28:08.182658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d58c20-6a57-4382-9bc9-0b8816560cb8 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:28:08.214848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721545e-91d8-474d-8ea8-6b0ddc360285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:28:08.215461 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721545e-91d8-474d-8ea8-6b0ddc360285 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:08.215739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721545e-91d8-474d-8ea8-6b0ddc360285 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:08.216012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721545e-91d8-474d-8ea8-6b0ddc360285 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:08.216581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721545e-91d8-474d-8ea8-6b0ddc360285 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:28:08.217961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9721545e-91d8-474d-8ea8-6b0ddc360285 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-9721545e-91d8-474d-8ea8-6b0ddc360285 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:28:08.226527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:28:08.228148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:28:08.229350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:28:08.229350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:28:08.229350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:28:08.229350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:28:08.229350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:28:08.229350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:28:08.229350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:28:08.229350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:28:08.229350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:28:08.229350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:28:08.229350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:28:08.229350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:28:08.229350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:28:08.229350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:28:08.229350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 652/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 13 06:28:08 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:28:08.234009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af3d67-3a30-4703-9848-04b7444c7502 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:28:08.252398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:28:08.332232 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af3d67-3a30-4703-9848-04b7444c7502 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:28:08.371545 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df03eb-6159-42cf-8a67-641141e99bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:28:08.372106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df03eb-6159-42cf-8a67-641141e99bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:08.372685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df03eb-6159-42cf-8a67-641141e99bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:08.373127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df03eb-6159-42cf-8a67-641141e99bd4 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:08.373986 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df03eb-6159-42cf-8a67-641141e99bd4 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:28:08.374496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df03eb-6159-42cf-8a67-641141e99bd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:28:08.376514 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df03eb-6159-42cf-8a67-641141e99bd4 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:28:08.383216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 647/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Sep 13 06:28:08 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:28:08.389510 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721545e-91d8-474d-8ea8-6b0ddc360285 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:28:08.422704 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:28:08.489375 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9721545e-91d8-474d-8ea8-6b0ddc360285 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:28:08.521791 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596db06-9fb4-49f1-a1bc-c59c351e132a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:28:08.522382 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596db06-9fb4-49f1-a1bc-c59c351e132a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:08.522660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596db06-9fb4-49f1-a1bc-c59c351e132a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:08.522932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596db06-9fb4-49f1-a1bc-c59c351e132a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:08.523619 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596db06-9fb4-49f1-a1bc-c59c351e132a None admin] RBAC: Adding query filter params (interface=public, service_id=55a4168b0fb541ae8c65d61d2ecaf94d, region_id=RegionOne) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:28:08.524452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596db06-9fb4-49f1-a1bc-c59c351e132a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:28:08.525829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596db06-9fb4-49f1-a1bc-c59c351e132a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:28:08.530663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 653/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 13 06:28:08 2022] GET /identity/v3/endpoints?service_id=55a4168b0fb541ae8c65d61d2ecaf94d&interface=public®ion_id=RegionOne => generated 194 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:28:08.536303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df03eb-6159-42cf-8a67-641141e99bd4 None admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:28:08.617960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:28:08.636804 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df03eb-6159-42cf-8a67-641141e99bd4 None admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:28:08.669957 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2e8366-9be7-477d-ac50-6bde9e34f986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:28:08.670562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e8366-9be7-477d-ac50-6bde9e34f986 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:08.670842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e8366-9be7-477d-ac50-6bde9e34f986 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:08.671116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2e8366-9be7-477d-ac50-6bde9e34f986 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:08.671717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e8366-9be7-477d-ac50-6bde9e34f986 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:28:08.673103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2e8366-9be7-477d-ac50-6bde9e34f986 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:28:08.679698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 648/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 13 06:28:08 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:28:10.801254 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fe4d0-1573-467d-91d0-75f00efc8eda None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:10.801777 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fe4d0-1573-467d-91d0-75f00efc8eda None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:10.801777 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896fe4d0-1573-467d-91d0-75f00efc8eda None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:10.803177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 654/1302] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:28:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:28:10.809033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6593459-c76e-4036-9c97-ead9bff61cb1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:10.809500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6593459-c76e-4036-9c97-ead9bff61cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:10.809594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6593459-c76e-4036-9c97-ead9bff61cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:10.827760 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e6593459-c76e-4036-9c97-ead9bff61cb1 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:28:10.828986 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e6593459-c76e-4036-9c97-ead9bff61cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:28:10.893326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 649/1303] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:28:10 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 06:28:11.160733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fe4d0-1573-467d-91d0-75f00efc8eda None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:28:11.254209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:28:11.261085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896fe4d0-1573-467d-91d0-75f00efc8eda None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:28:11.294344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ce6fe-906e-4765-9613-be5cd6e4b52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:28:11.294957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ce6fe-906e-4765-9613-be5cd6e4b52f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:11.295232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ce6fe-906e-4765-9613-be5cd6e4b52f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:11.295503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575ce6fe-906e-4765-9613-be5cd6e4b52f None admin] PATH_INFO: `/v3/services/placement` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:11.296072 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ce6fe-906e-4765-9613-be5cd6e4b52f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:28:11.297442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575ce6fe-906e-4765-9613-be5cd6e4b52f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-575ce6fe-906e-4765-9613-be5cd6e4b52f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 06:28:11.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 06:28:11.307175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 06:28:11.308216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 06:28:11.308216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 13 06:28:11.308216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 06:28:11.308216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 13 06:28:11.308216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 06:28:11.308216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 06:28:11.308216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 06:28:11.308216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 13 06:28:11.308216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 06:28:11.308216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 13 06:28:11.308216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 06:28:11.308216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 06:28:11.308216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 06:28:11.308216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 13 06:28:11.308216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 655/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 13 06:28:11 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 06:28:11.312895 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6593459-c76e-4036-9c97-ead9bff61cb1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:28:11.390228 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:28:11.412706 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6593459-c76e-4036-9c97-ead9bff61cb1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:28:11.444903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff93314-5304-4d91-b4d6-037e91cb7d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:28:11.445496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff93314-5304-4d91-b4d6-037e91cb7d24 None admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:11.445795 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff93314-5304-4d91-b4d6-037e91cb7d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:11.446067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff93314-5304-4d91-b4d6-037e91cb7d24 None admin] PATH_INFO: `/v3/services` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:11.446683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff93314-5304-4d91-b4d6-037e91cb7d24 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:28:11.446980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff93314-5304-4d91-b4d6-037e91cb7d24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:28:11.448313 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff93314-5304-4d91-b4d6-037e91cb7d24 None admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:28:11.453201 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 650/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Sep 13 06:28:11 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:28:11.459089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ce6fe-906e-4765-9613-be5cd6e4b52f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:28:11.556480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575ce6fe-906e-4765-9613-be5cd6e4b52f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:28:11.588617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83729886-29c2-46e3-ae47-e3802a0e59f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:28:11.589229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83729886-29c2-46e3-ae47-e3802a0e59f4 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:28:11.589506 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83729886-29c2-46e3-ae47-e3802a0e59f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:28:11.589775 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83729886-29c2-46e3-ae47-e3802a0e59f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:28:11.590435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83729886-29c2-46e3-ae47-e3802a0e59f4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:28:11.591780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83729886-29c2-46e3-ae47-e3802a0e59f4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:28:11.610656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 656/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:28:11 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:28:21.450379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=30 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:28:21.606925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:15.048225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ffe74-7057-4f06-a30d-51b96513167e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:15.048811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ffe74-7057-4f06-a30d-51b96513167e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:15.048811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ffe74-7057-4f06-a30d-51b96513167e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:15.053045 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 651/1307] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:29:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:29:15.055383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67577-a510-4952-83a6-bde557489427 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:15.055801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67577-a510-4952-83a6-bde557489427 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:15.055973 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc67577-a510-4952-83a6-bde557489427 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:15.153344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-fdc67577-a510-4952-83a6-bde557489427 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:29:15.154588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fdc67577-a510-4952-83a6-bde557489427 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:15.385221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 657/1308] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:29:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:29:15.681003 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b75a-161e-4cd8-a728-391b901f6fb2 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:15.681668 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b75a-161e-4cd8-a728-391b901f6fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:15.682227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa89b75a-161e-4cd8-a728-391b901f6fb2 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:15.684090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 652/1309] 10.222.0.42 () {54 vars in 965 bytes} [Tue Sep 13 06:29:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:29:15.691340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104b453-9026-4e27-8e60-85fa9eb665a3 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:15.691987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104b453-9026-4e27-8e60-85fa9eb665a3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:15.692550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104b453-9026-4e27-8e60-85fa9eb665a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:15.784631 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b104b453-9026-4e27-8e60-85fa9eb665a3 None None] MFA Rules not processed for user `a5efc921a219444bb0b45e8b4d08dcc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:29:15.785901 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b104b453-9026-4e27-8e60-85fa9eb665a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:15.812752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:15.873715 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 658/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Tue Sep 13 06:29:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:29:15.883638 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89b75a-161e-4cd8-a728-391b901f6fb2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:29:15.885772 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fa89b75a-161e-4cd8-a728-391b901f6fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:16.013328 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa89b75a-161e-4cd8-a728-391b901f6fb2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:29:16.106589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a387a206-eeb7-43c6-a83b-874950976c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:29:16.108040 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387a206-eeb7-43c6-a83b-874950976c3e service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:16.108551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387a206-eeb7-43c6-a83b-874950976c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:16.109069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a387a206-eeb7-43c6-a83b-874950976c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:16.110973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a387a206-eeb7-43c6-a83b-874950976c3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:16.187464 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:16.253417 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387a206-eeb7-43c6-a83b-874950976c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:29:16.255031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a387a206-eeb7-43c6-a83b-874950976c3e service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:29:16.291313 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 653/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:29:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:29:18.749168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b1f4f-03e4-4b64-a92d-c95b9388c3ac None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:18.749764 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b1f4f-03e4-4b64-a92d-c95b9388c3ac None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:18.749764 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b1f4f-03e4-4b64-a92d-c95b9388c3ac None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:18.751082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 659/1312] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:29:18.756625 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7b078-209c-4aef-83f7-d65303880d08 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:18.757082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7b078-209c-4aef-83f7-d65303880d08 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:18.757184 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae7b078-209c-4aef-83f7-d65303880d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:18.841681 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-eae7b078-209c-4aef-83f7-d65303880d08 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:29:18.843011 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-eae7b078-209c-4aef-83f7-d65303880d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:18.939380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 654/1313] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:29:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:29:19.242101 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc81b9-28cc-4de0-9d3f-935e9fc1cfc0 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:19.242397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc81b9-28cc-4de0-9d3f-935e9fc1cfc0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:19.242638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc81b9-28cc-4de0-9d3f-935e9fc1cfc0 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:19.243985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 660/1314] 10.222.0.42 () {54 vars in 965 bytes} [Tue Sep 13 06:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:29:19.250028 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42be93-faa9-46c3-95fd-39f7d537e083 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:19.250323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42be93-faa9-46c3-95fd-39f7d537e083 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:19.250604 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a42be93-faa9-46c3-95fd-39f7d537e083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:19.262352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:19.325962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8a42be93-faa9-46c3-95fd-39f7d537e083 None None] MFA Rules not processed for user `a5efc921a219444bb0b45e8b4d08dcc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:29:19.327200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8a42be93-faa9-46c3-95fd-39f7d537e083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:19.402490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 655/1315] 10.222.0.42 () {58 vars in 1062 bytes} [Tue Sep 13 06:29:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:29:19.411562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc81b9-28cc-4de0-9d3f-935e9fc1cfc0 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:29:19.413134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-78cc81b9-28cc-4de0-9d3f-935e9fc1cfc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:19.516014 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cc81b9-28cc-4de0-9d3f-935e9fc1cfc0 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:29:19.584675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:19.587862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245bdbbc-3fa0-431b-a35b-fde4255e6dd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:29:19.588752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bdbbc-3fa0-431b-a35b-fde4255e6dd8 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:19.589226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bdbbc-3fa0-431b-a35b-fde4255e6dd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:19.589690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245bdbbc-3fa0-431b-a35b-fde4255e6dd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:19.591329 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-245bdbbc-3fa0-431b-a35b-fde4255e6dd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:19.698101 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bdbbc-3fa0-431b-a35b-fde4255e6dd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:29:19.699535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245bdbbc-3fa0-431b-a35b-fde4255e6dd8 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:29:19.717929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 661/1316] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:29:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:29:22.397264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3c53a-89ae-4a68-941b-2cb2ff3ac2de None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:22.397800 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3c53a-89ae-4a68-941b-2cb2ff3ac2de None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:22.397800 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f3c53a-89ae-4a68-941b-2cb2ff3ac2de None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:22.399653 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 656/1317] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:29:22.404986 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd997765-2981-427a-a9fd-d5a28867daa1 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:22.405363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd997765-2981-427a-a9fd-d5a28867daa1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:22.405535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd997765-2981-427a-a9fd-d5a28867daa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:22.473600 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-dd997765-2981-427a-a9fd-d5a28867daa1 None None] MFA Rules not processed for user `b1eaabedfbf1451aa63ab57fb37bf6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:29:22.474987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-dd997765-2981-427a-a9fd-d5a28867daa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:22.527066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:22.570800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 662/1318] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:29:22 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:29:22.859922 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3c53a-89ae-4a68-941b-2cb2ff3ac2de None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:29:22.861528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-18f3c53a-89ae-4a68-941b-2cb2ff3ac2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:22.964194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f3c53a-89ae-4a68-941b-2cb2ff3ac2de None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:29:22.967000 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:23.036821 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940b1c-bed0-4595-810f-4d0f53e087ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:29:23.037420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940b1c-bed0-4595-810f-4d0f53e087ec service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:23.037696 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940b1c-bed0-4595-810f-4d0f53e087ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:23.037966 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940b1c-bed0-4595-810f-4d0f53e087ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:23.039612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6e940b1c-bed0-4595-810f-4d0f53e087ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:23.145959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e940b1c-bed0-4595-810f-4d0f53e087ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:29:23.147298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e940b1c-bed0-4595-810f-4d0f53e087ec service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:29:23.172242 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 657/1319] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:29:22 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:29:25.834444 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c31588-51ea-437f-8150-39b4d3ce9ca7 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:25.834977 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c31588-51ea-437f-8150-39b4d3ce9ca7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:25.834977 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c31588-51ea-437f-8150-39b4d3ce9ca7 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:25.837001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 663/1320] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:29:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:29:25.842053 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728c59c-d682-46c2-b664-013e990bff5c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:25.842450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728c59c-d682-46c2-b664-013e990bff5c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:25.842599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f728c59c-d682-46c2-b664-013e990bff5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:25.884243 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:25.908988 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f728c59c-d682-46c2-b664-013e990bff5c None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:29:25.910204 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f728c59c-d682-46c2-b664-013e990bff5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:26.012917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 658/1321] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:29:25 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:29:26.298205 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c31588-51ea-437f-8150-39b4d3ce9ca7 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:29:26.299749 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-04c31588-51ea-437f-8150-39b4d3ce9ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:26.403998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c31588-51ea-437f-8150-39b4d3ce9ca7 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:29:26.476506 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dba7f42-77d1-4ede-9d63-1360bb2a77da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:29:26.477200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba7f42-77d1-4ede-9d63-1360bb2a77da service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:26.477477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba7f42-77d1-4ede-9d63-1360bb2a77da service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:26.477745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dba7f42-77d1-4ede-9d63-1360bb2a77da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:26.479346 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6dba7f42-77d1-4ede-9d63-1360bb2a77da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:26.486203 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:26.593385 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba7f42-77d1-4ede-9d63-1360bb2a77da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:29:26.594740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dba7f42-77d1-4ede-9d63-1360bb2a77da service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:29:26.612640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 664/1322] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:29:26 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:29:29.403802 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac9a86-7623-4b05-9c70-c6913c20c084 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:29.404348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac9a86-7623-4b05-9c70-c6913c20c084 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:29.404348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac9a86-7623-4b05-9c70-c6913c20c084 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:29.405709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 659/1323] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:29:29.410800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3d412-5f6d-466b-adfa-6a9ba662c46d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:29.411232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3d412-5f6d-466b-adfa-6a9ba662c46d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:29.411358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd3d412-5f6d-466b-adfa-6a9ba662c46d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:29.483888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-4cd3d412-5f6d-466b-adfa-6a9ba662c46d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:29:29.485488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4cd3d412-5f6d-466b-adfa-6a9ba662c46d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:29.554830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:29.604864 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 665/1324] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:29:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:29:29.877918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac9a86-7623-4b05-9c70-c6913c20c084 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:29:29.879400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-efac9a86-7623-4b05-9c70-c6913c20c084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:29.983174 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac9a86-7623-4b05-9c70-c6913c20c084 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:29:29.996524 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:30.057029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25763c84-4a25-4e73-ba40-c2bf0d0bd59f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:29:30.057629 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25763c84-4a25-4e73-ba40-c2bf0d0bd59f service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:30.057904 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25763c84-4a25-4e73-ba40-c2bf0d0bd59f service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:30.058171 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25763c84-4a25-4e73-ba40-c2bf0d0bd59f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:30.059744 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-25763c84-4a25-4e73-ba40-c2bf0d0bd59f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:30.166297 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25763c84-4a25-4e73-ba40-c2bf0d0bd59f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:29:30.167865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25763c84-4a25-4e73-ba40-c2bf0d0bd59f service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:29:30.186024 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 660/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:29:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:29:32.365299 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5cfe1-dea8-451a-80be-48d542dfec4c None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:32.365896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5cfe1-dea8-451a-80be-48d542dfec4c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:32.365896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5cfe1-dea8-451a-80be-48d542dfec4c None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:32.367427 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 666/1326] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:29:32.373365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eb05e-8122-4bfc-810f-85a85392ba6a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:32.373868 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eb05e-8122-4bfc-810f-85a85392ba6a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:32.373984 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2eb05e-8122-4bfc-810f-85a85392ba6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:32.422700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:32.440886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9f2eb05e-8122-4bfc-810f-85a85392ba6a None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:29:32.442101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9f2eb05e-8122-4bfc-810f-85a85392ba6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:32.543726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 661/1327] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:29:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:29:32.826186 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5cfe1-dea8-451a-80be-48d542dfec4c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:29:32.827804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-baf5cfe1-dea8-451a-80be-48d542dfec4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:32.931663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5cfe1-dea8-451a-80be-48d542dfec4c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:29:33.008641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1722d2-66fe-4aee-9c0a-defe0cb6f8ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:29:33.009280 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1722d2-66fe-4aee-9c0a-defe0cb6f8ae service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:33.009582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1722d2-66fe-4aee-9c0a-defe0cb6f8ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:33.009837 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1722d2-66fe-4aee-9c0a-defe0cb6f8ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:33.011446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8b1722d2-66fe-4aee-9c0a-defe0cb6f8ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:33.029449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:33.125104 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1722d2-66fe-4aee-9c0a-defe0cb6f8ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:29:33.126453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1722d2-66fe-4aee-9c0a-defe0cb6f8ae service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:29:33.144207 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 667/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:29:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:29:35.344792 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66ad23-0c8f-4280-bfdc-4772d9dec186 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:35.345353 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66ad23-0c8f-4280-bfdc-4772d9dec186 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:35.345353 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc66ad23-0c8f-4280-bfdc-4772d9dec186 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:35.346666 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 662/1329] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:29:35.352301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f2c72-8d4c-496a-b377-73eb5e2eb110 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:35.352767 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f2c72-8d4c-496a-b377-73eb5e2eb110 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:35.352911 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35f2c72-8d4c-496a-b377-73eb5e2eb110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:35.420342 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e35f2c72-8d4c-496a-b377-73eb5e2eb110 None None] MFA Rules not processed for user `b1eaabedfbf1451aa63ab57fb37bf6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:29:35.421593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e35f2c72-8d4c-496a-b377-73eb5e2eb110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:35.487654 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:35.521389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 668/1330] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:29:35 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:29:35.800608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66ad23-0c8f-4280-bfdc-4772d9dec186 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:29:35.802226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-dc66ad23-0c8f-4280-bfdc-4772d9dec186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:35.910573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc66ad23-0c8f-4280-bfdc-4772d9dec186 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:29:35.931298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:35.984997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701005d1-a341-4fe5-8eee-ebcb6a92dc93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:29:35.985599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701005d1-a341-4fe5-8eee-ebcb6a92dc93 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:35.985873 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701005d1-a341-4fe5-8eee-ebcb6a92dc93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:35.986140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701005d1-a341-4fe5-8eee-ebcb6a92dc93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:35.987731 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-701005d1-a341-4fe5-8eee-ebcb6a92dc93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:36.097328 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701005d1-a341-4fe5-8eee-ebcb6a92dc93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:29:36.098689 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701005d1-a341-4fe5-8eee-ebcb6a92dc93 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:29:36.116636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 663/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:29:35 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:29:38.696943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900bd6f-ddcc-47d5-b3b1-8f91797eabc1 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:38.697423 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900bd6f-ddcc-47d5-b3b1-8f91797eabc1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:38.697516 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7900bd6f-ddcc-47d5-b3b1-8f91797eabc1 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:38.698820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 669/1332] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:29:38.704171 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efd9d0-8f1d-4a30-bfc7-6c9943562112 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:38.704619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efd9d0-8f1d-4a30-bfc7-6c9943562112 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:38.704744 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7efd9d0-8f1d-4a30-bfc7-6c9943562112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:38.767528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:38.770329 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f7efd9d0-8f1d-4a30-bfc7-6c9943562112 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:29:38.772130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f7efd9d0-8f1d-4a30-bfc7-6c9943562112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:38.865606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 664/1333] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:29:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:29:39.150502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900bd6f-ddcc-47d5-b3b1-8f91797eabc1 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:29:39.152051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-7900bd6f-ddcc-47d5-b3b1-8f91797eabc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:39.254758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7900bd6f-ddcc-47d5-b3b1-8f91797eabc1 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:29:39.327408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524a126d-1182-4fa1-97a5-b278a2c2b8a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:29:39.328005 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a126d-1182-4fa1-97a5-b278a2c2b8a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:39.328285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a126d-1182-4fa1-97a5-b278a2c2b8a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:39.328552 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524a126d-1182-4fa1-97a5-b278a2c2b8a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:39.330211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-524a126d-1182-4fa1-97a5-b278a2c2b8a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:39.357263 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:39.438293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a126d-1182-4fa1-97a5-b278a2c2b8a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:29:39.439719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524a126d-1182-4fa1-97a5-b278a2c2b8a4 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:29:39.457177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 670/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:29:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:29:41.622233 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0328403-2e46-4444-aad6-7f11853ac2a9 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:41.622816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0328403-2e46-4444-aad6-7f11853ac2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:41.622816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0328403-2e46-4444-aad6-7f11853ac2a9 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:41.624117 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 665/1335] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:29:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:29:41.629449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97347f-8c1f-49d1-ac2f-9d7046bc0453 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:41.629899 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97347f-8c1f-49d1-ac2f-9d7046bc0453 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:41.630011 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c97347f-8c1f-49d1-ac2f-9d7046bc0453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:41.695373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0c97347f-8c1f-49d1-ac2f-9d7046bc0453 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:29:41.696562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0c97347f-8c1f-49d1-ac2f-9d7046bc0453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:41.770594 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:41.791875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 671/1336] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:29:42.074971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0328403-2e46-4444-aad6-7f11853ac2a9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:29:42.076502 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c0328403-2e46-4444-aad6-7f11853ac2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:42.181628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0328403-2e46-4444-aad6-7f11853ac2a9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:29:42.209677 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:42.254981 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ff0ec-c04e-46a8-a2a8-1afd42452b3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:29:42.255577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ff0ec-c04e-46a8-a2a8-1afd42452b3a service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:42.255852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ff0ec-c04e-46a8-a2a8-1afd42452b3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:42.256115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ff0ec-c04e-46a8-a2a8-1afd42452b3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:42.257737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1f7ff0ec-c04e-46a8-a2a8-1afd42452b3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:42.364545 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ff0ec-c04e-46a8-a2a8-1afd42452b3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:29:42.366489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ff0ec-c04e-46a8-a2a8-1afd42452b3a service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:29:42.384864 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 666/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:29:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:29:44.964738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f32f9-1af5-4487-aab0-3295ebc7854a None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:44.965300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f32f9-1af5-4487-aab0-3295ebc7854a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:44.965300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f32f9-1af5-4487-aab0-3295ebc7854a None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:44.966617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 672/1338] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:29:44.971857 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ebda5-f5ef-4d23-829a-90b803a5f5b3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:44.972266 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ebda5-f5ef-4d23-829a-90b803a5f5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:44.972414 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ebda5-f5ef-4d23-829a-90b803a5f5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:45.037173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-dc1ebda5-f5ef-4d23-829a-90b803a5f5b3 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:29:45.038899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-dc1ebda5-f5ef-4d23-829a-90b803a5f5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:45.047009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:45.134416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 667/1339] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:29:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:29:45.420187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f32f9-1af5-4487-aab0-3295ebc7854a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:29:45.421758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4b6f32f9-1af5-4487-aab0-3295ebc7854a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:45.523878 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f32f9-1af5-4487-aab0-3295ebc7854a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:29:45.596608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6e5479-b83e-4ae4-a411-770b8af836de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:29:45.597226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e5479-b83e-4ae4-a411-770b8af836de service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:45.597507 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e5479-b83e-4ae4-a411-770b8af836de service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:45.597774 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6e5479-b83e-4ae4-a411-770b8af836de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:45.599362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9e6e5479-b83e-4ae4-a411-770b8af836de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:45.635358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:45.708708 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e5479-b83e-4ae4-a411-770b8af836de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:29:45.710103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6e5479-b83e-4ae4-a411-770b8af836de service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:29:45.728555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 673/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:29:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:29:49.837007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87031e1a-64f7-48c0-ac62-e2641476e7ba None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:49.837626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87031e1a-64f7-48c0-ac62-e2641476e7ba None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:49.837626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87031e1a-64f7-48c0-ac62-e2641476e7ba None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:49.838890 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 668/1341] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:29:49.844211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a5eb2-5e25-431f-93aa-641a97f1a2d3 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:49.844655 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a5eb2-5e25-431f-93aa-641a97f1a2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:49.844792 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60a5eb2-5e25-431f-93aa-641a97f1a2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:49.911089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f60a5eb2-5e25-431f-93aa-641a97f1a2d3 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:29:49.912322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f60a5eb2-5e25-431f-93aa-641a97f1a2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:49.997884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:50.009303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 674/1342] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:29:50.298014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87031e1a-64f7-48c0-ac62-e2641476e7ba None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:29:50.299634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-87031e1a-64f7-48c0-ac62-e2641476e7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:50.407263 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87031e1a-64f7-48c0-ac62-e2641476e7ba None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:29:50.447157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:50.484737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6da544-50c7-47af-b1fe-1ed7daa4f991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:29:50.485339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6da544-50c7-47af-b1fe-1ed7daa4f991 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:50.485617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6da544-50c7-47af-b1fe-1ed7daa4f991 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:50.485886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6da544-50c7-47af-b1fe-1ed7daa4f991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:50.487478 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3f6da544-50c7-47af-b1fe-1ed7daa4f991 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:50.600942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6da544-50c7-47af-b1fe-1ed7daa4f991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:29:50.602298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6da544-50c7-47af-b1fe-1ed7daa4f991 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:29:50.621503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 669/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:29:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:29:53.352692 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c8e2b-e776-4e63-9fb9-8498f7bc8980 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:53.353257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c8e2b-e776-4e63-9fb9-8498f7bc8980 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:53.353257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47c8e2b-e776-4e63-9fb9-8498f7bc8980 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:53.354456 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 675/1344] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:29:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:29:53.359774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db5095-e0b8-4a89-a6ec-50f60bfb3cd4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:53.360210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db5095-e0b8-4a89-a6ec-50f60bfb3cd4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:53.360456 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db5095-e0b8-4a89-a6ec-50f60bfb3cd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:53.426589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-86db5095-e0b8-4a89-a6ec-50f60bfb3cd4 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:29:53.427790 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-86db5095-e0b8-4a89-a6ec-50f60bfb3cd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:53.445996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:53.523127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 670/1345] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:29:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:29:53.805117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c8e2b-e776-4e63-9fb9-8498f7bc8980 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:29:53.806675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f47c8e2b-e776-4e63-9fb9-8498f7bc8980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:53.919972 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47c8e2b-e776-4e63-9fb9-8498f7bc8980 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:29:54.004752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9f5a9-0a1e-41ae-97e4-647e638e6f04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:29:54.005487 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9f5a9-0a1e-41ae-97e4-647e638e6f04 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:54.005637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9f5a9-0a1e-41ae-97e4-647e638e6f04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:54.005906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9f5a9-0a1e-41ae-97e4-647e638e6f04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:54.007504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9ad9f5a9-0a1e-41ae-97e4-647e638e6f04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:54.050204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:54.118306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9f5a9-0a1e-41ae-97e4-647e638e6f04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:29:54.119743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9f5a9-0a1e-41ae-97e4-647e638e6f04 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:29:54.138694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 676/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:29:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:29:58.226318 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571b721-ac0d-455b-a7d1-f85df107936e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:58.226803 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571b721-ac0d-455b-a7d1-f85df107936e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:58.226927 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571b721-ac0d-455b-a7d1-f85df107936e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:58.228209 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 671/1347] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:29:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:29:58.233571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de05899-757d-4c66-981f-aadfa979259a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:58.233975 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de05899-757d-4c66-981f-aadfa979259a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:58.234114 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de05899-757d-4c66-981f-aadfa979259a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:58.304553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-5de05899-757d-4c66-981f-aadfa979259a None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:29:58.305848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5de05899-757d-4c66-981f-aadfa979259a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:58.414063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:58.419470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 677/1348] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:29:58.702228 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571b721-ac0d-455b-a7d1-f85df107936e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:29:58.703772 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3571b721-ac0d-455b-a7d1-f85df107936e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:58.806949 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571b721-ac0d-455b-a7d1-f85df107936e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:29:58.855369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:29:58.888934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b9827-dce0-4c0d-a653-59719610aa4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:29:58.889582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b9827-dce0-4c0d-a653-59719610aa4e service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:29:58.889865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b9827-dce0-4c0d-a653-59719610aa4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:29:58.890143 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b9827-dce0-4c0d-a653-59719610aa4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:29:58.891775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-162b9827-dce0-4c0d-a653-59719610aa4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:29:59.004184 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b9827-dce0-4c0d-a653-59719610aa4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:29:59.005659 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b9827-dce0-4c0d-a653-59719610aa4e service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:29:59.030137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 672/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:30:04.034586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79673ee2-bd1d-4ef4-9018-3a8166670244 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:04.035043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79673ee2-bd1d-4ef4-9018-3a8166670244 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:04.035235 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79673ee2-bd1d-4ef4-9018-3a8166670244 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:04.036498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 678/1350] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 13 06:30:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:04.042432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcee8f-ee58-49b8-97f6-1676b518011c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:04.042432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcee8f-ee58-49b8-97f6-1676b518011c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:04.042852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bcee8f-ee58-49b8-97f6-1676b518011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:04.180344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c3bcee8f-ee58-49b8-97f6-1676b518011c None None] MFA Rules not processed for user `b84a23931b60457e865f056352a396d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:04.181842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c3bcee8f-ee58-49b8-97f6-1676b518011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:04.201659 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:04.308865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 673/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 13 06:30:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:08.356458 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aefb9-e89e-45ba-ba29-c45979521205 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:08.357541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aefb9-e89e-45ba-ba29-c45979521205 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:08.358035 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4aefb9-e89e-45ba-ba29-c45979521205 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:08.359526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 679/1352] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 13 06:30:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:08.364559 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a964f5-3b5f-4e1d-b1cf-a33a416b94fd None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:08.365008 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a964f5-3b5f-4e1d-b1cf-a33a416b94fd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:08.365176 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a964f5-3b5f-4e1d-b1cf-a33a416b94fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:08.456754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-96a964f5-3b5f-4e1d-b1cf-a33a416b94fd None None] MFA Rules not processed for user `b84a23931b60457e865f056352a396d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:08.459778 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-96a964f5-3b5f-4e1d-b1cf-a33a416b94fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:08.547118 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:08.586491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 674/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 13 06:30:08 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:10.110279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca55674-bb05-410e-87a2-9bbe1f7d0359 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:10.110819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca55674-bb05-410e-87a2-9bbe1f7d0359 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:10.110819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca55674-bb05-410e-87a2-9bbe1f7d0359 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:10.112404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 680/1354] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 13 06:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:30:10.117993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2aee3-ffaa-4e84-9998-31e3b8ccbd36 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:10.118381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2aee3-ffaa-4e84-9998-31e3b8ccbd36 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:10.118542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2aee3-ffaa-4e84-9998-31e3b8ccbd36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:10.197691 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5ae2aee3-ffaa-4e84-9998-31e3b8ccbd36 None None] MFA Rules not processed for user `b84a23931b60457e865f056352a396d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:10.198947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5ae2aee3-ffaa-4e84-9998-31e3b8ccbd36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:10.307419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 675/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 13 06:30:10 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:30:13.778997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb01ed-aeed-43df-9142-31ace1954081 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:13.779502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb01ed-aeed-43df-9142-31ace1954081 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:13.779502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afb01ed-aeed-43df-9142-31ace1954081 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:13.785181 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 681/1356] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:30:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:13.786425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca99d1-f097-4edd-a4cf-3405dbcf10bb None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:13.787424 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca99d1-f097-4edd-a4cf-3405dbcf10bb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:13.787866 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca99d1-f097-4edd-a4cf-3405dbcf10bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:13.825535 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:13.860615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-92ca99d1-f097-4edd-a4cf-3405dbcf10bb None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:13.861939 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-92ca99d1-f097-4edd-a4cf-3405dbcf10bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:13.967956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 676/1357] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:30:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:14.274007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc87a-3231-4dc1-b22b-d4bb7efb97ce None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:14.274293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc87a-3231-4dc1-b22b-d4bb7efb97ce None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:14.274566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ffc87a-3231-4dc1-b22b-d4bb7efb97ce None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:14.275878 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 682/1358] 10.222.0.42 () {54 vars in 962 bytes} [Tue Sep 13 06:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:30:14.284357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f8fa-cb84-461c-9afe-4dbaf299df01 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:14.284818 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f8fa-cb84-461c-9afe-4dbaf299df01 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:14.285496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f9f8fa-cb84-461c-9afe-4dbaf299df01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:14.382603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-72f9f8fa-cb84-461c-9afe-4dbaf299df01 None None] MFA Rules not processed for user `7fbb67072ba544e39073787eb25fcf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:14.383983 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-72f9f8fa-cb84-461c-9afe-4dbaf299df01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:14.433504 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:14.503820 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 677/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Sep 13 06:30:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:14.513420 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffc87a-3231-4dc1-b22b-d4bb7efb97ce None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:30:14.514975 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a8ffc87a-3231-4dc1-b22b-d4bb7efb97ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:14.680480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ffc87a-3231-4dc1-b22b-d4bb7efb97ce None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:30:14.763620 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:14.807832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cfc4bb-5a98-403a-afda-a1c4f7336a84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:30:14.808637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfc4bb-5a98-403a-afda-a1c4f7336a84 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:14.809064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfc4bb-5a98-403a-afda-a1c4f7336a84 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:14.809440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cfc4bb-5a98-403a-afda-a1c4f7336a84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:14.811310 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-50cfc4bb-5a98-403a-afda-a1c4f7336a84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:14.918462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfc4bb-5a98-403a-afda-a1c4f7336a84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:30:14.920228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cfc4bb-5a98-403a-afda-a1c4f7336a84 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:30:14.940051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 683/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:30:17.310452 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64144913-fee7-43bd-91f3-07957842f3ca None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:17.310878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64144913-fee7-43bd-91f3-07957842f3ca None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:17.311203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64144913-fee7-43bd-91f3-07957842f3ca None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:17.312379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 678/1361] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:17.317795 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eed82-c385-4b64-8a31-5aeabe74c548 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:17.318231 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eed82-c385-4b64-8a31-5aeabe74c548 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:17.318344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eed82-c385-4b64-8a31-5aeabe74c548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:17.394709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0a6eed82-c385-4b64-8a31-5aeabe74c548 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:17.395903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0a6eed82-c385-4b64-8a31-5aeabe74c548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:17.440990 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:17.506302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 684/1362] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:17.791562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64144913-fee7-43bd-91f3-07957842f3ca None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:30:17.793118 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-64144913-fee7-43bd-91f3-07957842f3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:17.970405 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64144913-fee7-43bd-91f3-07957842f3ca None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:30:17.986529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:18.107731 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f373c49-0d09-4cae-8945-e30281f050b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:30:18.108341 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f373c49-0d09-4cae-8945-e30281f050b3 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:18.108620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f373c49-0d09-4cae-8945-e30281f050b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:18.108925 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f373c49-0d09-4cae-8945-e30281f050b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:18.110555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7f373c49-0d09-4cae-8945-e30281f050b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:18.202455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f373c49-0d09-4cae-8945-e30281f050b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:30:18.204178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f373c49-0d09-4cae-8945-e30281f050b3 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:30:18.223390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 679/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:30:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:30:20.734311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bfdfb-3700-4fa1-a04d-2d1db5290f9d None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:20.734930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bfdfb-3700-4fa1-a04d-2d1db5290f9d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:20.734930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1bfdfb-3700-4fa1-a04d-2d1db5290f9d None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:20.736189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 685/1364] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:20.742388 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cccec-72d1-4333-b0f7-e4ea58e20316 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:20.742842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cccec-72d1-4333-b0f7-e4ea58e20316 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:20.743131 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cccec-72d1-4333-b0f7-e4ea58e20316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:20.760946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:20.820352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-db0cccec-72d1-4333-b0f7-e4ea58e20316 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:20.821803 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-db0cccec-72d1-4333-b0f7-e4ea58e20316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:20.936713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 680/1365] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:21.231044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43decb-cf97-4783-92fe-cd6270297668 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:21.231609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43decb-cf97-4783-92fe-cd6270297668 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:21.232224 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43decb-cf97-4783-92fe-cd6270297668 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:21.233974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 686/1366] 10.222.0.42 () {54 vars in 962 bytes} [Tue Sep 13 06:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:21.239582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e5728-17b6-4964-8b56-feed4842ade3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:21.240444 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e5728-17b6-4964-8b56-feed4842ade3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:21.240748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e5728-17b6-4964-8b56-feed4842ade3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:21.322919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-760e5728-17b6-4964-8b56-feed4842ade3 None None] MFA Rules not processed for user `7fbb67072ba544e39073787eb25fcf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:21.324136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-760e5728-17b6-4964-8b56-feed4842ade3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:21.362379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:21.449922 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 681/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Sep 13 06:30:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:21.458967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43decb-cf97-4783-92fe-cd6270297668 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:30:21.461229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3d43decb-cf97-4783-92fe-cd6270297668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:21.628358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43decb-cf97-4783-92fe-cd6270297668 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:30:21.650733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:21.749669 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ec9c1-2655-499a-8cfd-07b06f0d8987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:30:21.750353 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ec9c1-2655-499a-8cfd-07b06f0d8987 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:21.750630 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ec9c1-2655-499a-8cfd-07b06f0d8987 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:21.751045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ec9c1-2655-499a-8cfd-07b06f0d8987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:21.752690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-631ec9c1-2655-499a-8cfd-07b06f0d8987 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:21.855426 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ec9c1-2655-499a-8cfd-07b06f0d8987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:30:21.857076 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631ec9c1-2655-499a-8cfd-07b06f0d8987 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:30:21.876286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 687/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:30:21.897704 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7db04-16a9-4138-bbed-4bed355dd8c1 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:21.898225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7db04-16a9-4138-bbed-4bed355dd8c1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:21.898336 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff7db04-16a9-4138-bbed-4bed355dd8c1 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:21.899655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 682/1369] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:30:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:21.904931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78225145-e820-4182-892d-d7b1f6b5d3a3 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:21.905221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78225145-e820-4182-892d-d7b1f6b5d3a3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:21.905498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78225145-e820-4182-892d-d7b1f6b5d3a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:21.945912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:21.989309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-78225145-e820-4182-892d-d7b1f6b5d3a3 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:21.991297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-78225145-e820-4182-892d-d7b1f6b5d3a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:22.111505 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 688/1370] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:22.452882 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa81b7-d2ee-49d0-98ba-72fce56e73f7 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:22.453173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa81b7-d2ee-49d0-98ba-72fce56e73f7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:22.453450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa81b7-d2ee-49d0-98ba-72fce56e73f7 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:22.455046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 683/1371] 10.222.0.42 () {54 vars in 964 bytes} [Tue Sep 13 06:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:22.460377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e8202-2852-4314-a332-876c4db06a24 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:22.464377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e8202-2852-4314-a332-876c4db06a24 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:22.464377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e8202-2852-4314-a332-876c4db06a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:22.543464 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2b7e8202-2852-4314-a332-876c4db06a24 None None] MFA Rules not processed for user `8789ed5fef2148e69e9e444d7cfe1e19`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:22.544729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2b7e8202-2852-4314-a332-876c4db06a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:22.593396 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:22.625906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 689/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Tue Sep 13 06:30:22 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:22.634137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa81b7-d2ee-49d0-98ba-72fce56e73f7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:30:22.635718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a6aa81b7-d2ee-49d0-98ba-72fce56e73f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:22.749912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa81b7-d2ee-49d0-98ba-72fce56e73f7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:30:22.796518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:22.835418 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b16427-6ba2-42b9-aef5-d177b73c5c3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:30:22.836034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b16427-6ba2-42b9-aef5-d177b73c5c3b service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:22.836406 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b16427-6ba2-42b9-aef5-d177b73c5c3b service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:22.836611 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b16427-6ba2-42b9-aef5-d177b73c5c3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:22.838253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-26b16427-6ba2-42b9-aef5-d177b73c5c3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:22.974884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b16427-6ba2-42b9-aef5-d177b73c5c3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:30:22.976615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b16427-6ba2-42b9-aef5-d177b73c5c3b service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:30:23.000286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 684/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:30:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:30:24.121917 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6347cd-199a-4949-a7f2-8c1db9cc3066 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:24.122542 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6347cd-199a-4949-a7f2-8c1db9cc3066 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:24.122849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6347cd-199a-4949-a7f2-8c1db9cc3066 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:24.124223 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 690/1374] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:30:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:24.129631 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907d0a-0fea-4e81-8d1b-9d273a3d4fc9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:24.130077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907d0a-0fea-4e81-8d1b-9d273a3d4fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:24.130724 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c907d0a-0fea-4e81-8d1b-9d273a3d4fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:24.197618 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2c907d0a-0fea-4e81-8d1b-9d273a3d4fc9 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:24.198828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2c907d0a-0fea-4e81-8d1b-9d273a3d4fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:24.220530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:24.300012 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 685/1375] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:24.590119 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6347cd-199a-4949-a7f2-8c1db9cc3066 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:30:24.591673 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8f6347cd-199a-4949-a7f2-8c1db9cc3066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:24.746347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6347cd-199a-4949-a7f2-8c1db9cc3066 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:30:24.800501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:24.865707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c694e1ed-7736-403d-a535-2e0599590f8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:30:24.866321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694e1ed-7736-403d-a535-2e0599590f8c service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:24.866603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694e1ed-7736-403d-a535-2e0599590f8c service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:24.866870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c694e1ed-7736-403d-a535-2e0599590f8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:24.868477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c694e1ed-7736-403d-a535-2e0599590f8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:24.964551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694e1ed-7736-403d-a535-2e0599590f8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:30:24.966294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c694e1ed-7736-403d-a535-2e0599590f8c service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:30:24.986440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 691/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:30:27.227297 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704362d6-fe0c-4d1b-bd36-f5e2ff6e3b07 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:27.227887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704362d6-fe0c-4d1b-bd36-f5e2ff6e3b07 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:27.227887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704362d6-fe0c-4d1b-bd36-f5e2ff6e3b07 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:27.229383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 686/1377] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:27.234588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4823f7-1935-42fb-aa50-fc6a465e03a2 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:27.235059 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4823f7-1935-42fb-aa50-fc6a465e03a2 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:27.235145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4823f7-1935-42fb-aa50-fc6a465e03a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:27.307797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-aa4823f7-1935-42fb-aa50-fc6a465e03a2 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:27.309127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-aa4823f7-1935-42fb-aa50-fc6a465e03a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:27.324229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:27.428005 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 692/1378] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:30:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:27.714687 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704362d6-fe0c-4d1b-bd36-f5e2ff6e3b07 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:30:27.716322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-704362d6-fe0c-4d1b-bd36-f5e2ff6e3b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:27.869443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704362d6-fe0c-4d1b-bd36-f5e2ff6e3b07 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:30:27.873958 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:27.988990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02e71a-cf6b-42fa-ba08-7b89bcd1397a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:30:27.990298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02e71a-cf6b-42fa-ba08-7b89bcd1397a service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:27.990710 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02e71a-cf6b-42fa-ba08-7b89bcd1397a service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:27.991046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02e71a-cf6b-42fa-ba08-7b89bcd1397a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:27.992787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1b02e71a-cf6b-42fa-ba08-7b89bcd1397a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:28.086646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02e71a-cf6b-42fa-ba08-7b89bcd1397a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:30:28.088436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02e71a-cf6b-42fa-ba08-7b89bcd1397a service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:30:28.107837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 687/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:30:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:30:30.324743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd9f6c-bbd1-4b04-a708-0acbc3e19f86 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:30.325295 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd9f6c-bbd1-4b04-a708-0acbc3e19f86 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:30.325721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd9f6c-bbd1-4b04-a708-0acbc3e19f86 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:30.327734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 693/1380] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:30:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:30.333448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddaa48-5406-45a7-8381-283dd1a46648 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:30.333895 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddaa48-5406-45a7-8381-283dd1a46648 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:30.333999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eddaa48-5406-45a7-8381-283dd1a46648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:30.349949 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:30.411146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4eddaa48-5406-45a7-8381-283dd1a46648 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:30.412449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4eddaa48-5406-45a7-8381-283dd1a46648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:30.544889 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 688/1381] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:30:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:30.844153 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd9f6c-bbd1-4b04-a708-0acbc3e19f86 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:30:30.845696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f7dd9f6c-bbd1-4b04-a708-0acbc3e19f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:30.990958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:31.002470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd9f6c-bbd1-4b04-a708-0acbc3e19f86 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:30:31.142891 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bf27ab-5e82-4fd2-bf5a-263b3c492749 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:30:31.143561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf27ab-5e82-4fd2-bf5a-263b3c492749 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:31.143894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf27ab-5e82-4fd2-bf5a-263b3c492749 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:31.144235 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bf27ab-5e82-4fd2-bf5a-263b3c492749 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:31.146925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f0bf27ab-5e82-4fd2-bf5a-263b3c492749 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:31.245276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf27ab-5e82-4fd2-bf5a-263b3c492749 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:30:31.247216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bf27ab-5e82-4fd2-bf5a-263b3c492749 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:30:31.258500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:31.268694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 694/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:30:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:30:33.555358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a49b1-cafd-4493-85e4-4c7bbfbb869f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:33.555873 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a49b1-cafd-4493-85e4-4c7bbfbb869f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:33.555873 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a49b1-cafd-4493-85e4-4c7bbfbb869f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:33.557247 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 689/1383] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:30:33.562693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a7d34-6779-490b-9c4c-04412c9a82a7 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:33.563122 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a7d34-6779-490b-9c4c-04412c9a82a7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:33.563268 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a7d34-6779-490b-9c4c-04412c9a82a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:33.632219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ef9a7d34-6779-490b-9c4c-04412c9a82a7 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:33.633477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ef9a7d34-6779-490b-9c4c-04412c9a82a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:33.746726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 695/1384] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:30:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:30:34.041734 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a49b1-cafd-4493-85e4-4c7bbfbb869f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:30:34.043305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-509a49b1-cafd-4493-85e4-4c7bbfbb869f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:34.133761 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:34.203328 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a49b1-cafd-4493-85e4-4c7bbfbb869f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:30:34.333604 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8effe3-acd5-4ef6-9b76-eea40e271ff4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:30:34.334158 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8effe3-acd5-4ef6-9b76-eea40e271ff4 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:34.334459 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8effe3-acd5-4ef6-9b76-eea40e271ff4 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:34.334746 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8effe3-acd5-4ef6-9b76-eea40e271ff4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:34.336699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9c8effe3-acd5-4ef6-9b76-eea40e271ff4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:34.398295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:34.439387 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8effe3-acd5-4ef6-9b76-eea40e271ff4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:30:34.441026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8effe3-acd5-4ef6-9b76-eea40e271ff4 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:30:34.458923 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 690/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:30:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:30:36.647915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f6c1e-52fa-45f8-8029-0173d603a358 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:36.648513 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f6c1e-52fa-45f8-8029-0173d603a358 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:36.648513 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f6c1e-52fa-45f8-8029-0173d603a358 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:36.649837 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 696/1386] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:36.655394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d737b-5c24-4e56-bd27-c9a660424fff None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:36.655860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d737b-5c24-4e56-bd27-c9a660424fff None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:36.656070 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d737b-5c24-4e56-bd27-c9a660424fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:36.729332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-eb9d737b-5c24-4e56-bd27-c9a660424fff None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:36.731251 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-eb9d737b-5c24-4e56-bd27-c9a660424fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:36.855540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 691/1387] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:30:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:37.151341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f6c1e-52fa-45f8-8029-0173d603a358 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:30:37.152943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-898f6c1e-52fa-45f8-8029-0173d603a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:37.233805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:37.304653 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898f6c1e-52fa-45f8-8029-0173d603a358 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:30:37.419566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad6545a-307e-48e5-843c-e22c6e2cc2b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:30:37.420177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6545a-307e-48e5-843c-e22c6e2cc2b9 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:37.420452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6545a-307e-48e5-843c-e22c6e2cc2b9 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:37.420758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad6545a-307e-48e5-843c-e22c6e2cc2b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:37.422380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-cad6545a-307e-48e5-843c-e22c6e2cc2b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:37.464604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:37.518380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6545a-307e-48e5-843c-e22c6e2cc2b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:30:37.520079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad6545a-307e-48e5-843c-e22c6e2cc2b9 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:30:37.539200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 697/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:30:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:30:39.703709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81d59b-e1b4-4d52-bb67-d7c4d80d79a3 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:39.704303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81d59b-e1b4-4d52-bb67-d7c4d80d79a3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:39.704303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d81d59b-e1b4-4d52-bb67-d7c4d80d79a3 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:39.705697 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 692/1389] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:39.711390 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d65ed5-25ba-477b-a400-21cbde36f464 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:39.711823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d65ed5-25ba-477b-a400-21cbde36f464 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:39.712076 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d65ed5-25ba-477b-a400-21cbde36f464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:39.735316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3229f-086b-4c74-8b25-560d055c5b83 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:39.735607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3229f-086b-4c74-8b25-560d055c5b83 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:39.735887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3229f-086b-4c74-8b25-560d055c5b83 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:39.737280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 693/1390] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:30:39.743281 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03686a-d238-4c53-9a86-ef3ba84924cf None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:39.743570 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03686a-d238-4c53-9a86-ef3ba84924cf None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:39.743905 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b03686a-d238-4c53-9a86-ef3ba84924cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:39.780522 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:39.783699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-23d65ed5-25ba-477b-a400-21cbde36f464 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:39.785064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-23d65ed5-25ba-477b-a400-21cbde36f464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:39.813302 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9b03686a-d238-4c53-9a86-ef3ba84924cf None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:39.814516 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9b03686a-d238-4c53-9a86-ef3ba84924cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:39.891944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 698/1391] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:39.922285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 694/1392] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:30:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:30:40.190224 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faa266-ce55-49b6-b0b2-8ebe3f85d298 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:40.190516 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faa266-ce55-49b6-b0b2-8ebe3f85d298 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:40.190794 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faa266-ce55-49b6-b0b2-8ebe3f85d298 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:40.192152 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 699/1393] 10.222.0.42 () {54 vars in 966 bytes} [Tue Sep 13 06:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:40.197699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f3d2e-9725-4d36-8db0-00fe0bff7605 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:40.198151 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f3d2e-9725-4d36-8db0-00fe0bff7605 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:40.198430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f3d2e-9725-4d36-8db0-00fe0bff7605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:40.208640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faa266-ce55-49b6-b0b2-8ebe3f85d298 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:30:40.210750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-44faa266-ce55-49b6-b0b2-8ebe3f85d298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:40.225305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:40.281092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-039f3d2e-9725-4d36-8db0-00fe0bff7605 None None] MFA Rules not processed for user `ddc0c92f881e40c9abe067d3a6d4251b`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:40.282305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-039f3d2e-9725-4d36-8db0-00fe0bff7605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:40.329179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:40.358561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 695/1394] 10.222.0.42 () {58 vars in 1063 bytes} [Tue Sep 13 06:30:40 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:40.367278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faa266-ce55-49b6-b0b2-8ebe3f85d298 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:30:40.367485 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f3d2e-9725-4d36-8db0-00fe0bff7605 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:30:40.375333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f3d2e-9725-4d36-8db0-00fe0bff7605 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:30:40.451461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e4fda-689e-4d3e-b3f2-1daf32190e32 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc0c92f881e40c9abe067d3a6d4251b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:30:40.451976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e4fda-689e-4d3e-b3f2-1daf32190e32 service glance] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:40.452254 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e4fda-689e-4d3e-b3f2-1daf32190e32 service glance] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:40.452519 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e4fda-689e-4d3e-b3f2-1daf32190e32 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:40.454238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:40.454380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-538e4fda-689e-4d3e-b3f2-1daf32190e32 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:40.482078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b26b56c-bd47-4dbd-a432-7e5931ba51a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:30:40.482683 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26b56c-bd47-4dbd-a432-7e5931ba51a6 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:40.482961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26b56c-bd47-4dbd-a432-7e5931ba51a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:40.483233 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26b56c-bd47-4dbd-a432-7e5931ba51a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:40.484870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6b26b56c-bd47-4dbd-a432-7e5931ba51a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:40.563895 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e4fda-689e-4d3e-b3f2-1daf32190e32 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:30:40.565363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e4fda-689e-4d3e-b3f2-1daf32190e32 service glance] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:30:40.575509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26b56c-bd47-4dbd-a432-7e5931ba51a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:30:40.577129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b26b56c-bd47-4dbd-a432-7e5931ba51a6 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:30:40.579670 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:40.585490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 696/1395] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:30:40.599380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 700/1396] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:30:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:30:41.331818 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93185d06-be86-4404-9589-1ab543a3ee4a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:41.332348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93185d06-be86-4404-9589-1ab543a3ee4a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:41.332443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93185d06-be86-4404-9589-1ab543a3ee4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:41.407713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-93185d06-be86-4404-9589-1ab543a3ee4a None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:41.409039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-93185d06-be86-4404-9589-1ab543a3ee4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:41.496870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 697/1397] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 13 06:30:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:41.541587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc5ef-a3c0-4e6f-90d9-5891cd088551 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:41.542099 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc5ef-a3c0-4e6f-90d9-5891cd088551 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:41.542209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dc5ef-a3c0-4e6f-90d9-5891cd088551 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:41.543469 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 701/1398] 10.222.0.42 () {54 vars in 943 bytes} [Tue Sep 13 06:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:41.549820 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77035f45-66c8-4c28-81e0-c8c43a0cfff8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:41.550106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77035f45-66c8-4c28-81e0-c8c43a0cfff8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:41.550380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77035f45-66c8-4c28-81e0-c8c43a0cfff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:41.624837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-77035f45-66c8-4c28-81e0-c8c43a0cfff8 None None] MFA Rules not processed for user `de05d038c2124f43a3acc70f4fb5b44e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:41.625979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-77035f45-66c8-4c28-81e0-c8c43a0cfff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:41.656216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:41.733215 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 698/1399] 10.222.0.42 () {58 vars in 1040 bytes} [Tue Sep 13 06:30:41 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:41.743055 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc5ef-a3c0-4e6f-90d9-5891cd088551 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:30:41.744615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-bc0dc5ef-a3c0-4e6f-90d9-5891cd088551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:41.841856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:41.884632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dc5ef-a3c0-4e6f-90d9-5891cd088551 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:30:41.991875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecccf09-c640-48a1-8e59-8c02027e6695 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:30:41.992478 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecccf09-c640-48a1-8e59-8c02027e6695 service swift] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:41.992803 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecccf09-c640-48a1-8e59-8c02027e6695 service swift] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:41.993065 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecccf09-c640-48a1-8e59-8c02027e6695 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:41.994688 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fecccf09-c640-48a1-8e59-8c02027e6695 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:42.076244 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecccf09-c640-48a1-8e59-8c02027e6695 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:30:42.077855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecccf09-c640-48a1-8e59-8c02027e6695 service swift] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:30:42.081330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:42.087467 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 702/1400] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:30:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 06:30:42.815135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568acb54-4639-4786-8d16-836c036da102 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:42.815713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568acb54-4639-4786-8d16-836c036da102 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:42.815713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568acb54-4639-4786-8d16-836c036da102 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:42.820709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 699/1401] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:42.825564 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38c3d8-be7f-49ba-af4b-a66b636bfa60 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:42.826007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38c3d8-be7f-49ba-af4b-a66b636bfa60 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:42.826296 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e38c3d8-be7f-49ba-af4b-a66b636bfa60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:42.904745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9e38c3d8-be7f-49ba-af4b-a66b636bfa60 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:42.906102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9e38c3d8-be7f-49ba-af4b-a66b636bfa60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:43.015765 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 703/1402] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:30:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:30:43.307682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568acb54-4639-4786-8d16-836c036da102 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:30:43.309221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-568acb54-4639-4786-8d16-836c036da102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:43.463599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568acb54-4639-4786-8d16-836c036da102 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:30:43.466491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:43.586084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea26c0-daca-4859-b13b-2ca7d2c4444a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:30:43.586576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea26c0-daca-4859-b13b-2ca7d2c4444a service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:43.586856 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea26c0-daca-4859-b13b-2ca7d2c4444a service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:43.587128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea26c0-daca-4859-b13b-2ca7d2c4444a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:43.588738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6eea26c0-daca-4859-b13b-2ca7d2c4444a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:43.694909 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea26c0-daca-4859-b13b-2ca7d2c4444a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:30:43.696822 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea26c0-daca-4859-b13b-2ca7d2c4444a service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:30:43.728227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 700/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:30:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:30:45.946036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d1f56-546d-4a8a-a444-3b169e7f9015 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:45.946626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d1f56-546d-4a8a-a444-3b169e7f9015 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:45.946626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d1f56-546d-4a8a-a444-3b169e7f9015 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:45.948990 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 704/1404] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:30:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:45.952933 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c1ad1-e80d-44f6-bc31-dcc621a78299 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:45.953354 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c1ad1-e80d-44f6-bc31-dcc621a78299 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:45.953456 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c1ad1-e80d-44f6-bc31-dcc621a78299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:45.963661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:46.035983 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-751c1ad1-e80d-44f6-bc31-dcc621a78299 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:46.037227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-751c1ad1-e80d-44f6-bc31-dcc621a78299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:46.151770 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 701/1405] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:30:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:46.447548 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d1f56-546d-4a8a-a444-3b169e7f9015 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:30:46.449119 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0a9d1f56-546d-4a8a-a444-3b169e7f9015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:46.534352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:46.615197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d1f56-546d-4a8a-a444-3b169e7f9015 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:30:46.744617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dc1206-32fd-4169-8a60-c295dd91043a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:30:46.745167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc1206-32fd-4169-8a60-c295dd91043a service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:46.745446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc1206-32fd-4169-8a60-c295dd91043a service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:46.745713 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dc1206-32fd-4169-8a60-c295dd91043a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:46.747639 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a9dc1206-32fd-4169-8a60-c295dd91043a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:46.793765 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:46.852285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc1206-32fd-4169-8a60-c295dd91043a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:30:46.854376 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dc1206-32fd-4169-8a60-c295dd91043a service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:30:46.873831 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 705/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:30:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:30:49.087173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b7685-fbde-45e5-af79-8a3dda4dd2af None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:49.087732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b7685-fbde-45e5-af79-8a3dda4dd2af None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:49.087732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b7685-fbde-45e5-af79-8a3dda4dd2af None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:49.089262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 702/1407] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:30:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:30:49.094772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bc216-d7d0-425a-982d-73369a04947c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:49.095211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bc216-d7d0-425a-982d-73369a04947c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:49.095319 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955bc216-d7d0-425a-982d-73369a04947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:49.168813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-955bc216-d7d0-425a-982d-73369a04947c None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:30:49.170045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-955bc216-d7d0-425a-982d-73369a04947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:49.282534 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 706/1408] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:30:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:30:49.573649 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b7685-fbde-45e5-af79-8a3dda4dd2af None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:30:49.575245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-723b7685-fbde-45e5-af79-8a3dda4dd2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:49.668109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:49.737504 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b7685-fbde-45e5-af79-8a3dda4dd2af None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:30:49.867652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d785d-6035-48fe-a14b-2a305bc7089c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:30:49.868277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d785d-6035-48fe-a14b-2a305bc7089c service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:30:49.868615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d785d-6035-48fe-a14b-2a305bc7089c service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:30:49.868986 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d785d-6035-48fe-a14b-2a305bc7089c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:30:49.870590 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d89d785d-6035-48fe-a14b-2a305bc7089c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:30:49.928420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:49.974603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d785d-6035-48fe-a14b-2a305bc7089c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:30:49.976196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d785d-6035-48fe-a14b-2a305bc7089c service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:30:49.995145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 703/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:30:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:30:59.280389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=93 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:30:59.992408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=24 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:05.105340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efb5d2-01a3-4a38-9209-9ad04c9cee5c None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:05.105934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efb5d2-01a3-4a38-9209-9ad04c9cee5c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:05.105934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efb5d2-01a3-4a38-9209-9ad04c9cee5c None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:05.107222 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 707/1410] 10.222.0.42 () {54 vars in 918 bytes} [Tue Sep 13 06:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 06:31:05.112461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8bdc8-7354-4f66-896a-a33fbf394e4d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:05.112919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8bdc8-7354-4f66-896a-a33fbf394e4d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:05.113067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a8bdc8-7354-4f66-896a-a33fbf394e4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:05.190352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a1a8bdc8-7354-4f66-896a-a33fbf394e4d None None] MFA Rules not processed for user `b84a23931b60457e865f056352a396d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:05.191497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a1a8bdc8-7354-4f66-896a-a33fbf394e4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:05.295584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 704/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Sep 13 06:31:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:05.310112 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d3125-d4df-4fb8-9d88-528d2076bdb0 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:05.310507 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d3125-d4df-4fb8-9d88-528d2076bdb0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:05.310781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d3125-d4df-4fb8-9d88-528d2076bdb0 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:05.312094 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 708/1412] 10.222.0.42 () {54 vars in 918 bytes} [Tue Sep 13 06:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:05.316707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b7177-0f2f-4915-b4e4-952274dd9251 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:05.316999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b7177-0f2f-4915-b4e4-952274dd9251 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:05.317276 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021b7177-0f2f-4915-b4e4-952274dd9251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:05.389762 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:05.393180 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-021b7177-0f2f-4915-b4e4-952274dd9251 None None] MFA Rules not processed for user `7fbb67072ba544e39073787eb25fcf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:05.395465 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-021b7177-0f2f-4915-b4e4-952274dd9251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:05.509345 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 705/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Sep 13 06:31:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:08.077324 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184d16a-8577-4ceb-a8f6-792ee17b6db7 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:08.077907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184d16a-8577-4ceb-a8f6-792ee17b6db7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:08.077907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184d16a-8577-4ceb-a8f6-792ee17b6db7 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:08.079214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 709/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:08.085178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817d7c2-bc8a-4258-bd8e-e7a283b7609d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:08.085584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817d7c2-bc8a-4258-bd8e-e7a283b7609d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:08.085742 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a817d7c2-bc8a-4258-bd8e-e7a283b7609d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:08.152576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a817d7c2-bc8a-4258-bd8e-e7a283b7609d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:08.153807 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a817d7c2-bc8a-4258-bd8e-e7a283b7609d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:08.208097 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:08.249699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 706/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:31:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:08.537588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184d16a-8577-4ceb-a8f6-792ee17b6db7 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:08.539167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8184d16a-8577-4ceb-a8f6-792ee17b6db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:08.683828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184d16a-8577-4ceb-a8f6-792ee17b6db7 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:08.756549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:08.796135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060eaac8-ea88-4ce9-8f08-476fbc8b9304 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:08.796714 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060eaac8-ea88-4ce9-8f08-476fbc8b9304 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:08.796997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060eaac8-ea88-4ce9-8f08-476fbc8b9304 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:08.797269 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060eaac8-ea88-4ce9-8f08-476fbc8b9304 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:08.798882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-060eaac8-ea88-4ce9-8f08-476fbc8b9304 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:08.888312 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060eaac8-ea88-4ce9-8f08-476fbc8b9304 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:08.889951 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060eaac8-ea88-4ce9-8f08-476fbc8b9304 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:08.908403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 710/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:10.046827 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1f105-ef1f-4782-9ae4-e6ede6a46266 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:10.047419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1f105-ef1f-4782-9ae4-e6ede6a46266 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:10.047419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b1f105-ef1f-4782-9ae4-e6ede6a46266 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:10.048729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 707/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:31:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:10.055702 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9164081-7363-4222-b922-1ca7809bb310 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:10.056163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9164081-7363-4222-b922-1ca7809bb310 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:10.056280 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9164081-7363-4222-b922-1ca7809bb310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:10.132968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a9164081-7363-4222-b922-1ca7809bb310 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:10.134251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a9164081-7363-4222-b922-1ca7809bb310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:10.160591 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:10.346852 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 711/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:31:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:10.497840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1f105-ef1f-4782-9ae4-e6ede6a46266 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:10.499364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-69b1f105-ef1f-4782-9ae4-e6ede6a46266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:10.643075 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b1f105-ef1f-4782-9ae4-e6ede6a46266 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:10.683886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:10.756466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cae33f-d85e-4f39-85d9-cb05d33ce995 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:10.757089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cae33f-d85e-4f39-85d9-cb05d33ce995 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:10.757365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cae33f-d85e-4f39-85d9-cb05d33ce995 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:10.757633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cae33f-d85e-4f39-85d9-cb05d33ce995 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:10.759214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d3cae33f-d85e-4f39-85d9-cb05d33ce995 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:10.849864 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cae33f-d85e-4f39-85d9-cb05d33ce995 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:10.851447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cae33f-d85e-4f39-85d9-cb05d33ce995 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:10.869336 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 708/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:12.018330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282690f9-a68f-48d6-9d28-1852fca719d6 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:12.018903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282690f9-a68f-48d6-9d28-1852fca719d6 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:12.018903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282690f9-a68f-48d6-9d28-1852fca719d6 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:12.020232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 712/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:12.026650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9c672-bf15-49ed-9baa-2aadb3b23ab4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:12.027064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9c672-bf15-49ed-9baa-2aadb3b23ab4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:12.027200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a9c672-bf15-49ed-9baa-2aadb3b23ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:12.083492 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:12.105663 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d9a9c672-bf15-49ed-9baa-2aadb3b23ab4 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:12.106893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d9a9c672-bf15-49ed-9baa-2aadb3b23ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:12.211580 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 709/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:31:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:12.361812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282690f9-a68f-48d6-9d28-1852fca719d6 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:12.363935 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-282690f9-a68f-48d6-9d28-1852fca719d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:12.507058 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282690f9-a68f-48d6-9d28-1852fca719d6 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:12.518760 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:12.626964 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae5a7f-8167-47bc-b411-763275249626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:12.627565 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae5a7f-8167-47bc-b411-763275249626 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:12.627842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae5a7f-8167-47bc-b411-763275249626 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:12.628111 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae5a7f-8167-47bc-b411-763275249626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:12.629774 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-66ae5a7f-8167-47bc-b411-763275249626 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:12.716639 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae5a7f-8167-47bc-b411-763275249626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:12.718316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae5a7f-8167-47bc-b411-763275249626 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:12.736351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 713/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:13.839241 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693acb7e-6937-432b-be85-16552f83787e None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:13.839752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693acb7e-6937-432b-be85-16552f83787e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:13.839848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693acb7e-6937-432b-be85-16552f83787e None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:13.841206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 710/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:13.847448 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b1c71-3df6-441c-828f-641d8efa2cab None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:13.847956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b1c71-3df6-441c-828f-641d8efa2cab None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:13.848049 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b1c71-3df6-441c-828f-641d8efa2cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:13.867867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:13.924817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d24b1c71-3df6-441c-828f-641d8efa2cab None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:13.926513 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d24b1c71-3df6-441c-828f-641d8efa2cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:14.021146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 714/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:31:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:14.171055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693acb7e-6937-432b-be85-16552f83787e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:14.172604 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-693acb7e-6937-432b-be85-16552f83787e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:14.287916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:14.323934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693acb7e-6937-432b-be85-16552f83787e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:14.437163 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c235cc-1f02-4d4c-96a9-47171243124b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:14.437694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c235cc-1f02-4d4c-96a9-47171243124b service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:14.437972 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c235cc-1f02-4d4c-96a9-47171243124b service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:14.438244 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c235cc-1f02-4d4c-96a9-47171243124b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:14.439864 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-90c235cc-1f02-4d4c-96a9-47171243124b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:14.516116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:14.530222 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c235cc-1f02-4d4c-96a9-47171243124b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:14.531814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c235cc-1f02-4d4c-96a9-47171243124b service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:14.549834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 711/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:15.654977 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd78f3-1ce5-4a95-8ab2-3a0ebf8d7b10 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:15.655452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd78f3-1ce5-4a95-8ab2-3a0ebf8d7b10 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:15.655608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd78f3-1ce5-4a95-8ab2-3a0ebf8d7b10 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:15.656984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 715/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:15.663381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c561403-917f-40b5-9c06-15b1700d5274 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:15.663815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c561403-917f-40b5-9c06-15b1700d5274 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:15.663911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c561403-917f-40b5-9c06-15b1700d5274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:15.740413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3c561403-917f-40b5-9c06-15b1700d5274 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:15.741669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3c561403-917f-40b5-9c06-15b1700d5274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:15.837176 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 712/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:15.987080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd78f3-1ce5-4a95-8ab2-3a0ebf8d7b10 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:15.989084 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-41dd78f3-1ce5-4a95-8ab2-3a0ebf8d7b10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:16.072789 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:16.133674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd78f3-1ce5-4a95-8ab2-3a0ebf8d7b10 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:16.250735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f9367b-3fc0-4882-ba3b-68264da9fd11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:16.251246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9367b-3fc0-4882-ba3b-68264da9fd11 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:16.251516 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9367b-3fc0-4882-ba3b-68264da9fd11 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:16.251782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f9367b-3fc0-4882-ba3b-68264da9fd11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:16.253426 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-44f9367b-3fc0-4882-ba3b-68264da9fd11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:16.302174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:16.342624 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9367b-3fc0-4882-ba3b-68264da9fd11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:16.344844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f9367b-3fc0-4882-ba3b-68264da9fd11 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:16.363628 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 716/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:17.416760 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332ddcc-30b3-44b7-a740-f4725f5062d0 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:17.417325 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332ddcc-30b3-44b7-a740-f4725f5062d0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:17.417325 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332ddcc-30b3-44b7-a740-f4725f5062d0 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:17.418631 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 713/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:17.424777 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bbda2-ec47-40ab-8139-88bde9d1627c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:17.425266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bbda2-ec47-40ab-8139-88bde9d1627c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:17.425484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6bbda2-ec47-40ab-8139-88bde9d1627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:17.501612 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-3d6bbda2-ec47-40ab-8139-88bde9d1627c None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:17.502853 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3d6bbda2-ec47-40ab-8139-88bde9d1627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:17.598044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 717/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:31:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:17.746940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332ddcc-30b3-44b7-a740-f4725f5062d0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:17.748441 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2332ddcc-30b3-44b7-a740-f4725f5062d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:17.797255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:17.893355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332ddcc-30b3-44b7-a740-f4725f5062d0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:18.003494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15cd61-f032-4218-b054-4027c984d382 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:18.004099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15cd61-f032-4218-b054-4027c984d382 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:18.004379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15cd61-f032-4218-b054-4027c984d382 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:18.004644 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15cd61-f032-4218-b054-4027c984d382 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:18.006273 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2d15cd61-f032-4218-b054-4027c984d382 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:18.013099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:18.095177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15cd61-f032-4218-b054-4027c984d382 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:18.096776 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d15cd61-f032-4218-b054-4027c984d382 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:18.114838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 714/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:19.164380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292f5fc-bebe-49e4-82d6-1baa9bb95671 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:19.164924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292f5fc-bebe-49e4-82d6-1baa9bb95671 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:19.164924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5292f5fc-bebe-49e4-82d6-1baa9bb95671 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:19.166342 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 718/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:19.172506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86a4d4-83b9-4fc5-a243-20c388f56ee8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:19.172948 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86a4d4-83b9-4fc5-a243-20c388f56ee8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:19.173092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86a4d4-83b9-4fc5-a243-20c388f56ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:19.249107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ef86a4d4-83b9-4fc5-a243-20c388f56ee8 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:19.250314 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ef86a4d4-83b9-4fc5-a243-20c388f56ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:19.316444 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:19.344907 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 715/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:31:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:19.494412 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292f5fc-bebe-49e4-82d6-1baa9bb95671 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:19.496143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5292f5fc-bebe-49e4-82d6-1baa9bb95671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:19.513479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:19.638804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5292f5fc-bebe-49e4-82d6-1baa9bb95671 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:19.725743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:19.751543 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81717e91-c2e5-4b95-b15c-15c16e90dced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:19.752083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81717e91-c2e5-4b95-b15c-15c16e90dced service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:19.752360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81717e91-c2e5-4b95-b15c-15c16e90dced service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:19.752627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81717e91-c2e5-4b95-b15c-15c16e90dced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:19.754810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-81717e91-c2e5-4b95-b15c-15c16e90dced service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:19.843495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81717e91-c2e5-4b95-b15c-15c16e90dced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:19.845251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81717e91-c2e5-4b95-b15c-15c16e90dced service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:19.863425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 719/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:20.910912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed51bb-97ab-4fff-8e32-437ac582346d None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:20.911463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed51bb-97ab-4fff-8e32-437ac582346d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:20.911463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed51bb-97ab-4fff-8e32-437ac582346d None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:20.913102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 716/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:20.919179 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa4097-1e7b-430e-9271-d24e56f022e7 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:20.919591 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa4097-1e7b-430e-9271-d24e56f022e7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:20.919728 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa4097-1e7b-430e-9271-d24e56f022e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:20.997737 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b8fa4097-1e7b-430e-9271-d24e56f022e7 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:20.998951 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b8fa4097-1e7b-430e-9271-d24e56f022e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:21.042167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:21.096857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 720/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:31:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:21.247418 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed51bb-97ab-4fff-8e32-437ac582346d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:21.248893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f5ed51bb-97ab-4fff-8e32-437ac582346d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:21.392441 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed51bb-97ab-4fff-8e32-437ac582346d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:21.446280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:21.504658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6963695-974b-491f-93b7-4483b9ca366e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:21.505219 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6963695-974b-491f-93b7-4483b9ca366e service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:21.505496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6963695-974b-491f-93b7-4483b9ca366e service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:21.505771 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6963695-974b-491f-93b7-4483b9ca366e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:21.507359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e6963695-974b-491f-93b7-4483b9ca366e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:21.595341 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6963695-974b-491f-93b7-4483b9ca366e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:21.597514 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6963695-974b-491f-93b7-4483b9ca366e service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:21.615418 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 717/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:22.656600 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4461a-8654-45a3-a193-6de44e353820 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:22.657105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4461a-8654-45a3-a193-6de44e353820 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:22.657199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4461a-8654-45a3-a193-6de44e353820 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:22.658550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 721/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:22.665006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd716bfe-32a2-4e26-8f80-898c8d7e02e9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:22.665433 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd716bfe-32a2-4e26-8f80-898c8d7e02e9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:22.665553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd716bfe-32a2-4e26-8f80-898c8d7e02e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:22.741270 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bd716bfe-32a2-4e26-8f80-898c8d7e02e9 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:22.742468 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bd716bfe-32a2-4e26-8f80-898c8d7e02e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:22.744483 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:22.837909 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 718/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:31:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:22.991716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4461a-8654-45a3-a193-6de44e353820 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:22.993265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b3d4461a-8654-45a3-a193-6de44e353820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:23.139776 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4461a-8654-45a3-a193-6de44e353820 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:23.166722 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:23.251237 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccefa175-4a95-48c5-8635-eef32eba6a63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:23.251838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefa175-4a95-48c5-8635-eef32eba6a63 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:23.252117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefa175-4a95-48c5-8635-eef32eba6a63 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:23.252389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccefa175-4a95-48c5-8635-eef32eba6a63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:23.254534 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ccefa175-4a95-48c5-8635-eef32eba6a63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:23.343917 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefa175-4a95-48c5-8635-eef32eba6a63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:23.345570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccefa175-4a95-48c5-8635-eef32eba6a63 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:23.363653 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 722/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:25.420870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c40a77-9890-4af9-8f76-cd3a09929d94 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:25.421430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c40a77-9890-4af9-8f76-cd3a09929d94 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:25.421430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c40a77-9890-4af9-8f76-cd3a09929d94 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:25.422745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 719/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:25.428234 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6c687-66c4-4b21-b847-6f823f2b9296 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:25.428638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6c687-66c4-4b21-b847-6f823f2b9296 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:25.428806 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa6c687-66c4-4b21-b847-6f823f2b9296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:25.470206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:25.495596 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-cfa6c687-66c4-4b21-b847-6f823f2b9296 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:25.497121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-cfa6c687-66c4-4b21-b847-6f823f2b9296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:25.594611 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 723/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:31:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:25.875705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c40a77-9890-4af9-8f76-cd3a09929d94 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:25.877312 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f6c40a77-9890-4af9-8f76-cd3a09929d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:25.981750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c40a77-9890-4af9-8f76-cd3a09929d94 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:26.013920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:26.054790 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f35ce2-2a81-46a3-a699-4ef4d6aa7b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:26.055389 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f35ce2-2a81-46a3-a699-4ef4d6aa7b70 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:26.055671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f35ce2-2a81-46a3-a699-4ef4d6aa7b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:26.055944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f35ce2-2a81-46a3-a699-4ef4d6aa7b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:26.057580 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e9f35ce2-2a81-46a3-a699-4ef4d6aa7b70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:26.164564 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f35ce2-2a81-46a3-a699-4ef4d6aa7b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:26.166017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f35ce2-2a81-46a3-a699-4ef4d6aa7b70 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:26.183307 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 720/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:28.497541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d2d7e-c800-4f3e-a078-44fc478a1c62 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:28.498110 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d2d7e-c800-4f3e-a078-44fc478a1c62 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:28.498110 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d2d7e-c800-4f3e-a078-44fc478a1c62 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:28.499479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 724/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:31:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:28.504641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311296fb-cde9-4649-88ec-5d097144e573 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:28.505074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311296fb-cde9-4649-88ec-5d097144e573 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:28.505238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311296fb-cde9-4649-88ec-5d097144e573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:28.570484 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-311296fb-cde9-4649-88ec-5d097144e573 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:28.571622 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-311296fb-cde9-4649-88ec-5d097144e573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:28.584748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:28.669285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 721/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:28.965073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d2d7e-c800-4f3e-a078-44fc478a1c62 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:28.966625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b59d2d7e-c800-4f3e-a078-44fc478a1c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:29.070535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d2d7e-c800-4f3e-a078-44fc478a1c62 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:29.083865 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:29.145628 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22198030-6afd-42bd-a64a-ccfc74523526 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:29.146218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22198030-6afd-42bd-a64a-ccfc74523526 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:29.146490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22198030-6afd-42bd-a64a-ccfc74523526 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:29.146755 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22198030-6afd-42bd-a64a-ccfc74523526 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:29.148337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-22198030-6afd-42bd-a64a-ccfc74523526 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:29.255862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22198030-6afd-42bd-a64a-ccfc74523526 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:29.257265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22198030-6afd-42bd-a64a-ccfc74523526 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:29.275623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 725/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:31.714577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85959ca1-910a-4094-8425-15c230fda9d7 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:31.715140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85959ca1-910a-4094-8425-15c230fda9d7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:31.715140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85959ca1-910a-4094-8425-15c230fda9d7 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:31.716453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 722/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:31:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:31.721669 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3bab0-ff49-4e97-83b2-ffb16fa78091 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:31.722076 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3bab0-ff49-4e97-83b2-ffb16fa78091 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:31.722219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d3bab0-ff49-4e97-83b2-ffb16fa78091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:31.770608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:31.788128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-10d3bab0-ff49-4e97-83b2-ffb16fa78091 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:31.789368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-10d3bab0-ff49-4e97-83b2-ffb16fa78091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:31.883932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 726/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:31:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:32.165808 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85959ca1-910a-4094-8425-15c230fda9d7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:32.167340 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-85959ca1-910a-4094-8425-15c230fda9d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:32.267858 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85959ca1-910a-4094-8425-15c230fda9d7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:32.307311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:32.341286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918af5b6-953a-46d5-be9b-6a31fea2950c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:32.341881 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918af5b6-953a-46d5-be9b-6a31fea2950c service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:32.342159 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918af5b6-953a-46d5-be9b-6a31fea2950c service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:32.342429 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918af5b6-953a-46d5-be9b-6a31fea2950c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:32.344241 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-918af5b6-953a-46d5-be9b-6a31fea2950c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:32.456458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918af5b6-953a-46d5-be9b-6a31fea2950c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:32.457847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918af5b6-953a-46d5-be9b-6a31fea2950c service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:32.476151 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 723/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:34.743503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24217c9-ae5f-41a5-9ab5-be7eefa3e02b None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:34.744078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24217c9-ae5f-41a5-9ab5-be7eefa3e02b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:34.744078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24217c9-ae5f-41a5-9ab5-be7eefa3e02b None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:34.745409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 727/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:34.750987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486f3ed-cddd-4932-ae9a-542d1c9f63dd None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:34.751401 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486f3ed-cddd-4932-ae9a-542d1c9f63dd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:34.751562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e486f3ed-cddd-4932-ae9a-542d1c9f63dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:34.817660 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e486f3ed-cddd-4932-ae9a-542d1c9f63dd None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:34.818867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e486f3ed-cddd-4932-ae9a-542d1c9f63dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:34.838976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:34.913464 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 724/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:31:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:31:35.201896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24217c9-ae5f-41a5-9ab5-be7eefa3e02b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:35.203440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d24217c9-ae5f-41a5-9ab5-be7eefa3e02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:35.305535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24217c9-ae5f-41a5-9ab5-be7eefa3e02b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:35.325629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:35.379843 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76be131f-b0ba-4dda-8d05-4ab6c13b688b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:35.380446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be131f-b0ba-4dda-8d05-4ab6c13b688b service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:35.380760 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be131f-b0ba-4dda-8d05-4ab6c13b688b service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:35.381040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76be131f-b0ba-4dda-8d05-4ab6c13b688b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:35.382638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-76be131f-b0ba-4dda-8d05-4ab6c13b688b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:35.490415 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be131f-b0ba-4dda-8d05-4ab6c13b688b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:35.491760 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76be131f-b0ba-4dda-8d05-4ab6c13b688b service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:35.509619 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 728/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:37.700063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538a3a3-3ea6-4f17-9781-e4ae3fdf3c3c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:37.700589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538a3a3-3ea6-4f17-9781-e4ae3fdf3c3c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:37.700589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6538a3a3-3ea6-4f17-9781-e4ae3fdf3c3c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:37.702565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 725/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:31:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:37.707799 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8f253-e98a-4fec-a1a9-1b9e657aa51f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:37.708223 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8f253-e98a-4fec-a1a9-1b9e657aa51f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:37.708349 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8f253-e98a-4fec-a1a9-1b9e657aa51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:37.771507 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:37.774592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ebf8f253-e98a-4fec-a1a9-1b9e657aa51f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:37.776363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ebf8f253-e98a-4fec-a1a9-1b9e657aa51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:37.869506 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 729/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:38.159821 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538a3a3-3ea6-4f17-9781-e4ae3fdf3c3c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:38.161374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6538a3a3-3ea6-4f17-9781-e4ae3fdf3c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:38.261773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6538a3a3-3ea6-4f17-9781-e4ae3fdf3c3c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:38.310111 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:38.334484 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a62d9-263a-44df-91f5-a05b015206d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:38.335076 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a62d9-263a-44df-91f5-a05b015206d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:38.335351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a62d9-263a-44df-91f5-a05b015206d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:38.335616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a62d9-263a-44df-91f5-a05b015206d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:38.337235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-df0a62d9-263a-44df-91f5-a05b015206d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:38.448554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a62d9-263a-44df-91f5-a05b015206d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:38.449956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a62d9-263a-44df-91f5-a05b015206d3 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:38.468555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 726/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:40.690553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a0542-4b4c-4080-9220-f3a87d638381 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:40.691049 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a0542-4b4c-4080-9220-f3a87d638381 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:40.691177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a0542-4b4c-4080-9220-f3a87d638381 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:40.692438 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 730/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:31:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:40.697698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c348c2-deb5-43ce-bc3b-5ddc6914d7ea None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:40.698104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c348c2-deb5-43ce-bc3b-5ddc6914d7ea None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:40.698247 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c348c2-deb5-43ce-bc3b-5ddc6914d7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:40.763046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-01c348c2-deb5-43ce-bc3b-5ddc6914d7ea None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:40.764250 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-01c348c2-deb5-43ce-bc3b-5ddc6914d7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:40.793426 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:40.860726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 727/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:41.143817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a0542-4b4c-4080-9220-f3a87d638381 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:41.145440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-388a0542-4b4c-4080-9220-f3a87d638381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:41.248860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a0542-4b4c-4080-9220-f3a87d638381 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:41.276556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:41.322553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe03f2d-1c21-4b81-9046-c0ab48400b35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:41.323148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe03f2d-1c21-4b81-9046-c0ab48400b35 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:41.323422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe03f2d-1c21-4b81-9046-c0ab48400b35 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:41.323690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe03f2d-1c21-4b81-9046-c0ab48400b35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:41.325362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fbe03f2d-1c21-4b81-9046-c0ab48400b35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:41.437860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe03f2d-1c21-4b81-9046-c0ab48400b35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:41.439286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe03f2d-1c21-4b81-9046-c0ab48400b35 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:41.457312 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 731/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:43.669470 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e057309-61d4-460e-911e-3940a275a7a8 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:43.669938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e057309-61d4-460e-911e-3940a275a7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:43.670054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e057309-61d4-460e-911e-3940a275a7a8 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:43.671392 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 728/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:31:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:43.677451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabcf6e-9ca6-4648-8471-87de20b87be1 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:43.677864 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabcf6e-9ca6-4648-8471-87de20b87be1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:43.677994 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baabcf6e-9ca6-4648-8471-87de20b87be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:43.742616 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-baabcf6e-9ca6-4648-8471-87de20b87be1 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:43.743822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-baabcf6e-9ca6-4648-8471-87de20b87be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:43.752228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:43.839639 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 732/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:44.121206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e057309-61d4-460e-911e-3940a275a7a8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:44.122810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5e057309-61d4-460e-911e-3940a275a7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:44.231363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e057309-61d4-460e-911e-3940a275a7a8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:44.285936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:44.303784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ee5e14-0edc-4032-804b-805945ac53ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:44.304383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee5e14-0edc-4032-804b-805945ac53ae service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:44.304660 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee5e14-0edc-4032-804b-805945ac53ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:44.304955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ee5e14-0edc-4032-804b-805945ac53ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:44.306533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-71ee5e14-0edc-4032-804b-805945ac53ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:44.423675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee5e14-0edc-4032-804b-805945ac53ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:44.425647 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ee5e14-0edc-4032-804b-805945ac53ae service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:44.444144 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 729/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:46.627921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8e3a6-2bba-42c3-9d52-78a357c1f6f7 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:46.628461 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8e3a6-2bba-42c3-9d52-78a357c1f6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:46.628461 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb8e3a6-2bba-42c3-9d52-78a357c1f6f7 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:46.629847 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 733/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:31:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:46.635161 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708a9b8-3076-48d2-b727-94afc43dd9b3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:46.635574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708a9b8-3076-48d2-b727-94afc43dd9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:46.635714 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708a9b8-3076-48d2-b727-94afc43dd9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:46.816861 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7708a9b8-3076-48d2-b727-94afc43dd9b3 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:46.818115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7708a9b8-3076-48d2-b727-94afc43dd9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:46.855238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:46.912392 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 730/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:47.195482 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8e3a6-2bba-42c3-9d52-78a357c1f6f7 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:47.198232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4bb8e3a6-2bba-42c3-9d52-78a357c1f6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:47.303089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb8e3a6-2bba-42c3-9d52-78a357c1f6f7 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:47.340054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:47.378154 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2a1b07-40f3-4d0b-8586-3e5a67d6bb9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:47.378767 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a1b07-40f3-4d0b-8586-3e5a67d6bb9d service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:47.379058 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a1b07-40f3-4d0b-8586-3e5a67d6bb9d service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:47.379328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2a1b07-40f3-4d0b-8586-3e5a67d6bb9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:47.380998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ae2a1b07-40f3-4d0b-8586-3e5a67d6bb9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:47.490583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a1b07-40f3-4d0b-8586-3e5a67d6bb9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:47.491940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2a1b07-40f3-4d0b-8586-3e5a67d6bb9d service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:47.509872 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 734/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:49.663879 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a4b57-800d-4c50-bee0-5e5247c51910 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:49.664387 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a4b57-800d-4c50-bee0-5e5247c51910 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:49.664471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63a4b57-800d-4c50-bee0-5e5247c51910 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:49.665831 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 731/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:49.671001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed720-d8f8-49e4-9c97-d38accc15e36 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:49.671451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed720-d8f8-49e4-9c97-d38accc15e36 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:49.671570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ed720-d8f8-49e4-9c97-d38accc15e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:49.737828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-503ed720-d8f8-49e4-9c97-d38accc15e36 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:49.739016 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-503ed720-d8f8-49e4-9c97-d38accc15e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:49.757266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:49.833728 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 735/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:50.116157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a4b57-800d-4c50-bee0-5e5247c51910 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:50.117735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e63a4b57-800d-4c50-bee0-5e5247c51910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:50.220600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63a4b57-800d-4c50-bee0-5e5247c51910 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:50.287919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:50.294672 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dacefaa-51e4-479c-a43e-4a99a913d9dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:50.295280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacefaa-51e4-479c-a43e-4a99a913d9dd service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:50.295556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacefaa-51e4-479c-a43e-4a99a913d9dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:50.295827 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dacefaa-51e4-479c-a43e-4a99a913d9dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:50.297463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5dacefaa-51e4-479c-a43e-4a99a913d9dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:50.409408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacefaa-51e4-479c-a43e-4a99a913d9dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:50.410837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dacefaa-51e4-479c-a43e-4a99a913d9dd service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:50.428840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 732/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:31:52.571060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb139c-cc36-4506-a231-329cf7081fb1 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:52.571628 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb139c-cc36-4506-a231-329cf7081fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:52.571628 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfb139c-cc36-4506-a231-329cf7081fb1 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:52.572970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 736/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:31:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:31:52.578208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0edc6-5537-4210-bae0-94e76488f20a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:52.578620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0edc6-5537-4210-bae0-94e76488f20a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:52.578773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0edc6-5537-4210-bae0-94e76488f20a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:52.644661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5cd0edc6-5537-4210-bae0-94e76488f20a None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:31:52.645960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5cd0edc6-5537-4210-bae0-94e76488f20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:52.694124 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:52.741161 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 733/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:31:53.022529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb139c-cc36-4506-a231-329cf7081fb1 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:31:53.024135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-acfb139c-cc36-4506-a231-329cf7081fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:53.127180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfb139c-cc36-4506-a231-329cf7081fb1 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:31:53.175935 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:31:53.201193 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75b16d-839f-42de-bf28-da7c4453486a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:31:53.201724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75b16d-839f-42de-bf28-da7c4453486a service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:31:53.202001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75b16d-839f-42de-bf28-da7c4453486a service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:31:53.202268 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75b16d-839f-42de-bf28-da7c4453486a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:31:53.203839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5f75b16d-839f-42de-bf28-da7c4453486a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:31:53.313173 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75b16d-839f-42de-bf28-da7c4453486a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:31:53.314644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f75b16d-839f-42de-bf28-da7c4453486a service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:31:53.334437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 737/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:32:02.739605 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=22 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:03.332248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=66 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:13.221330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdd54e-a3ca-4df9-9205-e6a1caf44274 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:13.221888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdd54e-a3ca-4df9-9205-e6a1caf44274 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:13.221888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdd54e-a3ca-4df9-9205-e6a1caf44274 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:13.223136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 734/1471] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:32:13.228280 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484632a-de1d-4abc-a655-8f2ead8360ce None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:13.228702 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484632a-de1d-4abc-a655-8f2ead8360ce None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:13.228872 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b484632a-de1d-4abc-a655-8f2ead8360ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:13.295053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b484632a-de1d-4abc-a655-8f2ead8360ce None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:32:13.296259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b484632a-de1d-4abc-a655-8f2ead8360ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:13.394530 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 738/1472] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:32:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:32:13.694473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dca7e3-0505-4ea0-8348-7a23cb191603 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:13.694752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dca7e3-0505-4ea0-8348-7a23cb191603 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:13.695019 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dca7e3-0505-4ea0-8348-7a23cb191603 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:13.696327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 735/1473] 10.222.0.42 () {54 vars in 966 bytes} [Tue Sep 13 06:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:32:13.701264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93fc60-ee9d-4c27-b0d1-62d7e2d044d1 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:13.701553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93fc60-ee9d-4c27-b0d1-62d7e2d044d1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:13.701828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff93fc60-ee9d-4c27-b0d1-62d7e2d044d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:13.776549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ff93fc60-ee9d-4c27-b0d1-62d7e2d044d1 None None] MFA Rules not processed for user `ddc0c92f881e40c9abe067d3a6d4251b`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:32:13.777768 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ff93fc60-ee9d-4c27-b0d1-62d7e2d044d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:13.797618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:13.852902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 739/1474] 10.222.0.42 () {58 vars in 1063 bytes} [Tue Sep 13 06:32:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:32:13.861238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dca7e3-0505-4ea0-8348-7a23cb191603 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:32:13.862775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-25dca7e3-0505-4ea0-8348-7a23cb191603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:13.967202 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dca7e3-0505-4ea0-8348-7a23cb191603 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:32:14.038637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a7041-c43a-4e7d-add0-f5cfc20c6db2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc0c92f881e40c9abe067d3a6d4251b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:32:14.039226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a7041-c43a-4e7d-add0-f5cfc20c6db2 service glance] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:14.039501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a7041-c43a-4e7d-add0-f5cfc20c6db2 service glance] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:14.039767 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a7041-c43a-4e7d-add0-f5cfc20c6db2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:14.041367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c27a7041-c43a-4e7d-add0-f5cfc20c6db2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:14.093236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:14.148488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a7041-c43a-4e7d-add0-f5cfc20c6db2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:32:14.149857 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a7041-c43a-4e7d-add0-f5cfc20c6db2 service glance] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:32:14.170742 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 736/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:32:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:32:16.399626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f0c51-59b0-414f-af63-f71e0c1b7a7e None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:16.400205 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f0c51-59b0-414f-af63-f71e0c1b7a7e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:16.400205 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900f0c51-59b0-414f-af63-f71e0c1b7a7e None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:16.401579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 740/1476] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:32:16.406761 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46a63f-2096-43cd-818f-5fbb704691fb None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:16.407194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46a63f-2096-43cd-818f-5fbb704691fb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:16.407299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46a63f-2096-43cd-818f-5fbb704691fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:16.472994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3c46a63f-2096-43cd-818f-5fbb704691fb None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:32:16.474196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3c46a63f-2096-43cd-818f-5fbb704691fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:16.569059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 737/1477] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:32:16.841354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f0c51-59b0-414f-af63-f71e0c1b7a7e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:32:16.842900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-900f0c51-59b0-414f-af63-f71e0c1b7a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:16.967362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900f0c51-59b0-414f-af63-f71e0c1b7a7e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:32:17.019989 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:17.063560 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ef0b2-ed65-4a4a-bb97-c7adfb541623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:32:17.064719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ef0b2-ed65-4a4a-bb97-c7adfb541623 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:17.065004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ef0b2-ed65-4a4a-bb97-c7adfb541623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:17.065275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ef0b2-ed65-4a4a-bb97-c7adfb541623 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:17.065910 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ef0b2-ed65-4a4a-bb97-c7adfb541623 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:32:17.067625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: WARNING py.warnings [None req-ba9ef0b2-ed65-4a4a-bb97-c7adfb541623 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:32:17.067625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: warnings.warn(msg) Sep 13 06:32:17.067625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: Sep 13 06:32:17.068799 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ef0b2-ed65-4a4a-bb97-c7adfb541623 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:32:17.088966 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 741/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 13 06:32:16 2022] GET /identity/v3/projects => generated 2553 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:32:19.267580 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73190a7-6535-4b9d-b274-abff16506722 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:19.268109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73190a7-6535-4b9d-b274-abff16506722 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:19.268109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73190a7-6535-4b9d-b274-abff16506722 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:19.269436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 738/1479] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:32:19.274710 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18841b-d0b3-4153-9744-4e978fe9db02 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:19.275120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18841b-d0b3-4153-9744-4e978fe9db02 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:19.275262 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18841b-d0b3-4153-9744-4e978fe9db02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:19.344093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9b18841b-d0b3-4153-9744-4e978fe9db02 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:32:19.345881 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9b18841b-d0b3-4153-9744-4e978fe9db02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:19.443398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 742/1480] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:32:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:32:19.738101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73190a7-6535-4b9d-b274-abff16506722 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:32:19.739741 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f73190a7-6535-4b9d-b274-abff16506722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:19.749748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:19.889332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73190a7-6535-4b9d-b274-abff16506722 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:32:19.970903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:20.005408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6269a26-39ff-4077-bf71-5be68e766496 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:32:20.006051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6269a26-39ff-4077-bf71-5be68e766496 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:20.006364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6269a26-39ff-4077-bf71-5be68e766496 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:20.006665 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6269a26-39ff-4077-bf71-5be68e766496 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:20.008382 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f6269a26-39ff-4077-bf71-5be68e766496 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:20.100322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6269a26-39ff-4077-bf71-5be68e766496 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:32:20.102096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6269a26-39ff-4077-bf71-5be68e766496 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:32:20.120299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 739/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:32:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:32:22.453500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c304c-c972-4219-991e-dba30629aaed None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:22.454108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c304c-c972-4219-991e-dba30629aaed None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:22.454108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6c304c-c972-4219-991e-dba30629aaed None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:22.455439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 743/1482] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:32:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:32:22.460690 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb08aa7-febe-4527-a514-931963363277 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:22.461133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb08aa7-febe-4527-a514-931963363277 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:22.461233 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb08aa7-febe-4527-a514-931963363277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:22.525252 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6fb08aa7-febe-4527-a514-931963363277 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:32:22.526439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6fb08aa7-febe-4527-a514-931963363277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:22.571648 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:22.623425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 740/1483] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:32:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:32:22.911976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c304c-c972-4219-991e-dba30629aaed None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:32:22.913722 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-dd6c304c-c972-4219-991e-dba30629aaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:22.937705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:23.018013 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6c304c-c972-4219-991e-dba30629aaed None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:32:23.090039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f040e2c-8507-403c-bb7c-78f7b4f5ac29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:32:23.090631 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f040e2c-8507-403c-bb7c-78f7b4f5ac29 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:23.090906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f040e2c-8507-403c-bb7c-78f7b4f5ac29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:23.091174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f040e2c-8507-403c-bb7c-78f7b4f5ac29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:23.092786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6f040e2c-8507-403c-bb7c-78f7b4f5ac29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:23.166888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:23.202388 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f040e2c-8507-403c-bb7c-78f7b4f5ac29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:32:23.203837 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f040e2c-8507-403c-bb7c-78f7b4f5ac29 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:32:23.222752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 744/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:32:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:32:25.439871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef28fe7-f985-4ad4-b5d9-69b6e063c89a None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:25.440430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef28fe7-f985-4ad4-b5d9-69b6e063c89a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:25.440430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef28fe7-f985-4ad4-b5d9-69b6e063c89a None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:25.441795 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 741/1485] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:32:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:32:25.447097 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78860a82-c654-4393-9d57-93e35e97e15d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:25.447543 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78860a82-c654-4393-9d57-93e35e97e15d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:25.447659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78860a82-c654-4393-9d57-93e35e97e15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:25.512291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-78860a82-c654-4393-9d57-93e35e97e15d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:32:25.513527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-78860a82-c654-4393-9d57-93e35e97e15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:25.610935 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 745/1486] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:32:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:32:25.907126 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef28fe7-f985-4ad4-b5d9-69b6e063c89a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:32:25.908660 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3ef28fe7-f985-4ad4-b5d9-69b6e063c89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:26.012468 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef28fe7-f985-4ad4-b5d9-69b6e063c89a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:32:26.083957 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:26.085449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5a5c0-fedd-4b59-97dd-19214e1ff783 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:32:26.086107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5a5c0-fedd-4b59-97dd-19214e1ff783 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:26.086635 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5a5c0-fedd-4b59-97dd-19214e1ff783 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:26.087116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5a5c0-fedd-4b59-97dd-19214e1ff783 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:26.088926 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a3f5a5c0-fedd-4b59-97dd-19214e1ff783 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:26.197743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5a5c0-fedd-4b59-97dd-19214e1ff783 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:32:26.199173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5a5c0-fedd-4b59-97dd-19214e1ff783 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:32:26.217309 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 742/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:32:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:32:28.561296 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907a02a-af7e-425d-910b-08e09f941b91 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:28.561910 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907a02a-af7e-425d-910b-08e09f941b91 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:28.562027 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4907a02a-af7e-425d-910b-08e09f941b91 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:28.563436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 746/1488] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:32:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:32:28.568736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4629581-01fd-486a-b7b6-70a36b4bda68 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:28.569140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4629581-01fd-486a-b7b6-70a36b4bda68 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:28.569280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4629581-01fd-486a-b7b6-70a36b4bda68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:28.634052 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c4629581-01fd-486a-b7b6-70a36b4bda68 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:32:28.635242 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c4629581-01fd-486a-b7b6-70a36b4bda68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:28.689684 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:28.733900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 743/1489] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:32:29.034596 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907a02a-af7e-425d-910b-08e09f941b91 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:32:29.036182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4907a02a-af7e-425d-910b-08e09f941b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:29.071665 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:29.142983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4907a02a-af7e-425d-910b-08e09f941b91 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:32:29.224772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2117db-33f1-4f4c-80ac-5b2cd15dd5e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:32:29.225323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2117db-33f1-4f4c-80ac-5b2cd15dd5e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:29.225584 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2117db-33f1-4f4c-80ac-5b2cd15dd5e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:29.225857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2117db-33f1-4f4c-80ac-5b2cd15dd5e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:29.227457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-bd2117db-33f1-4f4c-80ac-5b2cd15dd5e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:29.307690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:29.341323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2117db-33f1-4f4c-80ac-5b2cd15dd5e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:32:29.342773 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2117db-33f1-4f4c-80ac-5b2cd15dd5e9 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:32:29.363058 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 747/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:32:31.675866 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e1f90-3036-429d-9095-4eaff939aaa0 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:31.676396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e1f90-3036-429d-9095-4eaff939aaa0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:31.676396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e1f90-3036-429d-9095-4eaff939aaa0 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:31.677785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 744/1491] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 13 06:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:32:31.682912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f95ba-d295-41b3-9514-c5e0425c79a9 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:31.683316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f95ba-d295-41b3-9514-c5e0425c79a9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:31.683459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349f95ba-d295-41b3-9514-c5e0425c79a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:31.749803 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-349f95ba-d295-41b3-9514-c5e0425c79a9 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:32:31.751535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-349f95ba-d295-41b3-9514-c5e0425c79a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:31.844548 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 748/1492] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 13 06:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:32:32.131629 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e1f90-3036-429d-9095-4eaff939aaa0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:32:32.133203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-323e1f90-3036-429d-9095-4eaff939aaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:32.233898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e1f90-3036-429d-9095-4eaff939aaa0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:32:32.306810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ba68b-e980-4ef8-bad1-77bf28e950c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:32:32.307416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ba68b-e980-4ef8-bad1-77bf28e950c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:32:32.307694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ba68b-e980-4ef8-bad1-77bf28e950c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:32:32.307967 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ba68b-e980-4ef8-bad1-77bf28e950c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:32:32.309589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bc9ba68b-e980-4ef8-bad1-77bf28e950c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:32:32.318120 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:32.419783 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ba68b-e980-4ef8-bad1-77bf28e950c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:32:32.421244 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ba68b-e980-4ef8-bad1-77bf28e950c4 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:32:32.439163 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 745/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:32:41.843003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=82 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:32:42.436972 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=50 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:33:50.922513 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730320e7-964f-4178-922f-24f3fee12aa9 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:50.923089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730320e7-964f-4178-922f-24f3fee12aa9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:50.923089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730320e7-964f-4178-922f-24f3fee12aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:50.997815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-730320e7-964f-4178-922f-24f3fee12aa9 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:33:50.999024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-730320e7-964f-4178-922f-24f3fee12aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:51.101465 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 749/1494] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:33:51.109666 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7f7e-3f1a-4e4f-b7fc-6fe63d3314af None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:51.110169 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7f7e-3f1a-4e4f-b7fc-6fe63d3314af None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:51.110275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f7f7e-3f1a-4e4f-b7fc-6fe63d3314af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:51.184697 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-368f7f7e-3f1a-4e4f-b7fc-6fe63d3314af None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:33:51.185828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-368f7f7e-3f1a-4e4f-b7fc-6fe63d3314af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:51.280487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 746/1495] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:33:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:33:51.285251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730320e7-964f-4178-922f-24f3fee12aa9 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:33:51.287047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-730320e7-964f-4178-922f-24f3fee12aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:51.298567 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730320e7-964f-4178-922f-24f3fee12aa9 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:33:51.360831 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:33:51.397107 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237c855-84e5-4ef5-84fb-8df54ab3335f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:33:51.397701 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237c855-84e5-4ef5-84fb-8df54ab3335f admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:51.397976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237c855-84e5-4ef5-84fb-8df54ab3335f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:51.398242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237c855-84e5-4ef5-84fb-8df54ab3335f admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:51.398883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237c855-84e5-4ef5-84fb-8df54ab3335f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:33:51.399206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237c855-84e5-4ef5-84fb-8df54ab3335f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:33:51.400207 dv-cinder-856385-1-smb devstack@keystone.service[81461]: WARNING py.warnings [None req-b237c855-84e5-4ef5-84fb-8df54ab3335f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:33:51.400207 dv-cinder-856385-1-smb devstack@keystone.service[81461]: warnings.warn(msg) Sep 13 06:33:51.400207 dv-cinder-856385-1-smb devstack@keystone.service[81461]: Sep 13 06:33:51.401157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b237c855-84e5-4ef5-84fb-8df54ab3335f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:33:51.413963 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 750/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:33:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:33:51.422286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7f7e-3f1a-4e4f-b7fc-6fe63d3314af None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:33:51.431353 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f7f7e-3f1a-4e4f-b7fc-6fe63d3314af None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:33:51.491483 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:33:51.525166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975528fd-7959-4e77-a511-cee6d0b0b608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:33:51.525760 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975528fd-7959-4e77-a511-cee6d0b0b608 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:51.526032 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975528fd-7959-4e77-a511-cee6d0b0b608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:51.526295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975528fd-7959-4e77-a511-cee6d0b0b608 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:51.526921 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975528fd-7959-4e77-a511-cee6d0b0b608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:33:51.528626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-975528fd-7959-4e77-a511-cee6d0b0b608 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:33:51.528626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: warnings.warn(msg) Sep 13 06:33:51.528626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: Sep 13 06:33:51.529830 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975528fd-7959-4e77-a511-cee6d0b0b608 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:33:51.584375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 747/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:33:51 2022] POST /identity/v3/projects => generated 377 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:33:51.588606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237c855-84e5-4ef5-84fb-8df54ab3335f admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:33:51.590151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b237c855-84e5-4ef5-84fb-8df54ab3335f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:51.622496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b237c855-84e5-4ef5-84fb-8df54ab3335f admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:33:51.718528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a87f6d-9214-489c-838b-c0c63acf5e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:33:51.719129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a87f6d-9214-489c-838b-c0c63acf5e3d admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:51.719407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a87f6d-9214-489c-838b-c0c63acf5e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:51.719674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a87f6d-9214-489c-838b-c0c63acf5e3d admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:51.720295 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a87f6d-9214-489c-838b-c0c63acf5e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:33:51.721328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: WARNING py.warnings [None req-b9a87f6d-9214-489c-838b-c0c63acf5e3d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:33:51.721328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: warnings.warn(msg) Sep 13 06:33:51.721328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: Sep 13 06:33:51.722558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a87f6d-9214-489c-838b-c0c63acf5e3d admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:33:51.765884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 751/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:33:51 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:33:51.769939 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975528fd-7959-4e77-a511-cee6d0b0b608 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:33:51.772002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-975528fd-7959-4e77-a511-cee6d0b0b608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:51.831814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975528fd-7959-4e77-a511-cee6d0b0b608 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:33:51.914469 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:33:51.925940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a35984-1310-47d8-a5ec-e97207ae3514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:33:51.926542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35984-1310-47d8-a5ec-e97207ae3514 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:51.926819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35984-1310-47d8-a5ec-e97207ae3514 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:51.927090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a35984-1310-47d8-a5ec-e97207ae3514 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:51.927728 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a35984-1310-47d8-a5ec-e97207ae3514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:33:51.928752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-73a35984-1310-47d8-a5ec-e97207ae3514 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:33:51.928752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: warnings.warn(msg) Sep 13 06:33:51.928752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: Sep 13 06:33:51.929640 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a35984-1310-47d8-a5ec-e97207ae3514 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:33:51.941927 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 748/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:33:51.945930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a87f6d-9214-489c-838b-c0c63acf5e3d admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:33:51.947472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b9a87f6d-9214-489c-838b-c0c63acf5e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:51.959322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a87f6d-9214-489c-838b-c0c63acf5e3d admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:33:51.984031 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:33:52.056250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4826b21-a987-4a99-a14e-5c51b7ed90cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:33:52.056801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4826b21-a987-4a99-a14e-5c51b7ed90cc admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:52.057077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4826b21-a987-4a99-a14e-5c51b7ed90cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:52.057370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4826b21-a987-4a99-a14e-5c51b7ed90cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:52.058006 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4826b21-a987-4a99-a14e-5c51b7ed90cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:33:52.059007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: WARNING py.warnings [None req-c4826b21-a987-4a99-a14e-5c51b7ed90cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:33:52.059007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: warnings.warn(msg) Sep 13 06:33:52.059007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: Sep 13 06:33:52.059888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4826b21-a987-4a99-a14e-5c51b7ed90cc admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:33:52.072573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 752/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:33:51 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:33:52.076775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a35984-1310-47d8-a5ec-e97207ae3514 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:33:52.078299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-73a35984-1310-47d8-a5ec-e97207ae3514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:52.111470 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a35984-1310-47d8-a5ec-e97207ae3514 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:33:52.202467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f80e9a-5a01-4695-a786-9f93fc413f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:33:52.203108 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f80e9a-5a01-4695-a786-9f93fc413f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:52.203384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f80e9a-5a01-4695-a786-9f93fc413f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:52.203652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f80e9a-5a01-4695-a786-9f93fc413f5d admin admin] PATH_INFO: `/v3/projects/c6e8b54e821a4aeaa3b82705fc9c7b6a/users/844b4d8c2040478689c86a3e20d0d1ee/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:52.225815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f80e9a-5a01-4695-a786-9f93fc413f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6e8b54e821a4aeaa3b82705fc9c7b6a, user_id=844b4d8c2040478689c86a3e20d0d1ee, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:33:52.226823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-b5f80e9a-5a01-4695-a786-9f93fc413f5d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:33:52.226823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: warnings.warn(msg) Sep 13 06:33:52.226823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: Sep 13 06:33:52.228774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f80e9a-5a01-4695-a786-9f93fc413f5d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:33:52.252449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 749/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:33:52 2022] PUT /identity/v3/projects/c6e8b54e821a4aeaa3b82705fc9c7b6a/users/844b4d8c2040478689c86a3e20d0d1ee/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:33:52.265101 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a96059-4eda-443e-84fe-08c2e1229dab None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:52.265390 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a96059-4eda-443e-84fe-08c2e1229dab None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:52.265668 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a96059-4eda-443e-84fe-08c2e1229dab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:52.322812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-96a96059-4eda-443e-84fe-08c2e1229dab None None] MFA Rules not processed for user `844b4d8c2040478689c86a3e20d0d1ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:33:52.323942 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-96a96059-4eda-443e-84fe-08c2e1229dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:52.399763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 753/1502] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:33:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:33:52.412840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c26de-65b6-4203-9af5-bd4c0799d828 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:52.413131 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c26de-65b6-4203-9af5-bd4c0799d828 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:52.413404 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c26de-65b6-4203-9af5-bd4c0799d828 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:52.414736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 750/1503] 10.222.0.42 () {54 vars in 964 bytes} [Tue Sep 13 06:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:33:52.419504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8e79f-224c-4fb1-87d1-acff5ec08eab None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:52.419792 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8e79f-224c-4fb1-87d1-acff5ec08eab None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:52.420065 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8e79f-224c-4fb1-87d1-acff5ec08eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:52.452984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:33:52.501158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-57a8e79f-224c-4fb1-87d1-acff5ec08eab None None] MFA Rules not processed for user `8789ed5fef2148e69e9e444d7cfe1e19`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:33:52.502378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-57a8e79f-224c-4fb1-87d1-acff5ec08eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:52.576277 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 754/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Tue Sep 13 06:33:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:33:52.584376 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c26de-65b6-4203-9af5-bd4c0799d828 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:33:52.585920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d77c26de-65b6-4203-9af5-bd4c0799d828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:52.636096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:33:52.690387 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77c26de-65b6-4203-9af5-bd4c0799d828 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:33:52.762489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bc5f5-f5f1-49cc-9934-0d8f2d63ecb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:33:52.763088 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bc5f5-f5f1-49cc-9934-0d8f2d63ecb2 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:52.763365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bc5f5-f5f1-49cc-9934-0d8f2d63ecb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:52.763637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8bc5f5-f5f1-49cc-9934-0d8f2d63ecb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:52.765246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2d8bc5f5-f5f1-49cc-9934-0d8f2d63ecb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:52.862118 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bc5f5-f5f1-49cc-9934-0d8f2d63ecb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:33:52.863455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8bc5f5-f5f1-49cc-9934-0d8f2d63ecb2 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:33:52.867474 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:33:52.882145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 751/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:33:52 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:33:52.926244 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6de6ee-59c4-48f6-be72-d2be360343d1 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:52.926531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6de6ee-59c4-48f6-be72-d2be360343d1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:52.926805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6de6ee-59c4-48f6-be72-d2be360343d1 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:52.928682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 755/1506] 10.222.0.42 () {52 vars in 830 bytes} [Tue Sep 13 06:33:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:33:52.932220 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bc5f5-f5f1-49cc-9934-0d8f2d63ecb2 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:33:52.933455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2d8bc5f5-f5f1-49cc-9934-0d8f2d63ecb2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:53.030529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8bc5f5-f5f1-49cc-9934-0d8f2d63ecb2 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:33:53.122968 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a25da1-e288-4cce-985b-3c62ca52ada8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:33:53.123586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a25da1-e288-4cce-985b-3c62ca52ada8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:53.123784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a25da1-e288-4cce-985b-3c62ca52ada8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:53.124056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a25da1-e288-4cce-985b-3c62ca52ada8 admin admin] PATH_INFO: `/v3/users/844b4d8c2040478689c86a3e20d0d1ee` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:53.136503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a25da1-e288-4cce-985b-3c62ca52ada8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=844b4d8c2040478689c86a3e20d0d1ee)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:33:53.137534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-d2a25da1-e288-4cce-985b-3c62ca52ada8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:33:53.137534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: warnings.warn(msg) Sep 13 06:33:53.137534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: Sep 13 06:33:53.138734 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a25da1-e288-4cce-985b-3c62ca52ada8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:33:53.148217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:33:53.204628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d2a25da1-e288-4cce-985b-3c62ca52ada8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '844b4d8c2040478689c86a3e20d0d1ee'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:33:53.219007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d2a25da1-e288-4cce-985b-3c62ca52ada8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '844b4d8c2040478689c86a3e20d0d1ee'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:33:53.241943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d2a25da1-e288-4cce-985b-3c62ca52ada8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '844b4d8c2040478689c86a3e20d0d1ee'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:33:53.251221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d2a25da1-e288-4cce-985b-3c62ca52ada8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '844b4d8c2040478689c86a3e20d0d1ee'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:33:53.251682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d2a25da1-e288-4cce-985b-3c62ca52ada8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '844b4d8c2040478689c86a3e20d0d1ee'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:33:53.257992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 752/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:33:52 2022] DELETE /identity/v3/users/844b4d8c2040478689c86a3e20d0d1ee => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:33:53.262404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3be8a1-4955-4a46-ba20-14f162b43efa None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:53.262900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3be8a1-4955-4a46-ba20-14f162b43efa None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:53.262998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3be8a1-4955-4a46-ba20-14f162b43efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:53.320310 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8e3be8a1-4955-4a46-ba20-14f162b43efa None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:33:53.321567 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8e3be8a1-4955-4a46-ba20-14f162b43efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:53.398656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:33:53.411767 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 756/1508] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:33:53.421218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a25da1-e288-4cce-985b-3c62ca52ada8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:33:53.422457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d2a25da1-e288-4cce-985b-3c62ca52ada8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:53.525348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a25da1-e288-4cce-985b-3c62ca52ada8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:33:53.578544 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:33:53.599331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba385a5-1b50-4dcd-9918-c2ea9d814189 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:33:53.599941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba385a5-1b50-4dcd-9918-c2ea9d814189 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:53.600219 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba385a5-1b50-4dcd-9918-c2ea9d814189 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:53.600490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba385a5-1b50-4dcd-9918-c2ea9d814189 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:53.602128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5ba385a5-1b50-4dcd-9918-c2ea9d814189 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:53.709024 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba385a5-1b50-4dcd-9918-c2ea9d814189 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:33:53.710455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba385a5-1b50-4dcd-9918-c2ea9d814189 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:33:53.728139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 753/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:33:54.144387 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3be8a1-4955-4a46-ba20-14f162b43efa None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:33:54.145713 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8e3be8a1-4955-4a46-ba20-14f162b43efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:33:54.157771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3be8a1-4955-4a46-ba20-14f162b43efa None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:33:54.259675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:33:54.260303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:33:54.260582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:33:54.260886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a admin admin] PATH_INFO: `/v3/projects/c6e8b54e821a4aeaa3b82705fc9c7b6a` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:33:54.271645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6e8b54e821a4aeaa3b82705fc9c7b6a)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:33:54.272699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: WARNING py.warnings [None req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:33:54.272699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: warnings.warn(msg) Sep 13 06:33:54.272699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: Sep 13 06:33:54.273905 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:33:54.332451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6e8b54e821a4aeaa3b82705fc9c7b6a', 'request_id': 'req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:33:54.341814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6e8b54e821a4aeaa3b82705fc9c7b6a', 'request_id': 'req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:33:54.348469 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6e8b54e821a4aeaa3b82705fc9c7b6a', 'request_id': 'req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:33:54.378848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a admin admin] The token cache is being invalidate because project c6e8b54e821a4aeaa3b82705fc9c7b6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:33:54.379138 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:33:54.379653 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6f1c226e-8dd6-4810-a5e1-7c3bd9fa896a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:33:54.381010 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 757/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:33:54 2022] DELETE /identity/v3/projects/c6e8b54e821a4aeaa3b82705fc9c7b6a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:34:03.725726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=62 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:34:04.376865 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:35:30.946040 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7587d2-a003-4486-9eb0-5cfdb604303f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:30.946633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7587d2-a003-4486-9eb0-5cfdb604303f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:30.946633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7587d2-a003-4486-9eb0-5cfdb604303f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:30.947914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 754/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:35:30.952769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a60dab-b7c1-4517-bebe-7c7d02764ee1 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:30.953267 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a60dab-b7c1-4517-bebe-7c7d02764ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:30.953365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a60dab-b7c1-4517-bebe-7c7d02764ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:31.032495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f2a60dab-b7c1-4517-bebe-7c7d02764ee1 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:35:31.033753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f2a60dab-b7c1-4517-bebe-7c7d02764ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:35:31.136063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 758/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:35:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:35:31.291469 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7587d2-a003-4486-9eb0-5cfdb604303f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:35:31.293812 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7a7587d2-a003-4486-9eb0-5cfdb604303f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:35:31.421639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7587d2-a003-4486-9eb0-5cfdb604303f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:35:31.427618 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3d57e-5751-413b-8b20-57d94a5a2f76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:35:31.428213 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3d57e-5751-413b-8b20-57d94a5a2f76 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:31.428489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3d57e-5751-413b-8b20-57d94a5a2f76 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:31.428797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3d57e-5751-413b-8b20-57d94a5a2f76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:31.436799 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3d57e-5751-413b-8b20-57d94a5a2f76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:35:31.438354 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3d57e-5751-413b-8b20-57d94a5a2f76 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:35:31.447549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 755/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:35:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:35:32.546101 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb50a9-dded-42b7-9467-2fa8594dad8d None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:32.546671 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb50a9-dded-42b7-9467-2fa8594dad8d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:32.546671 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb50a9-dded-42b7-9467-2fa8594dad8d None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:32.548030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 759/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:35:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:35:32.555130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab525c-e5ea-4f89-b527-5bf9d3583582 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:32.555642 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab525c-e5ea-4f89-b527-5bf9d3583582 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:32.555758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab525c-e5ea-4f89-b527-5bf9d3583582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:32.576198 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-51ab525c-e5ea-4f89-b527-5bf9d3583582 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:35:32.577429 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-51ab525c-e5ea-4f89-b527-5bf9d3583582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:35:32.585919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 756/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:35:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:35:32.738468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb50a9-dded-42b7-9467-2fa8594dad8d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:35:32.753006 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb50a9-dded-42b7-9467-2fa8594dad8d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:35:32.758382 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd2c6d-d910-4181-9319-12ee6328f2c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:35:32.758971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd2c6d-d910-4181-9319-12ee6328f2c1 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:32.759252 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd2c6d-d910-4181-9319-12ee6328f2c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:32.759526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd2c6d-d910-4181-9319-12ee6328f2c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:32.767468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd2c6d-d910-4181-9319-12ee6328f2c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:35:32.769092 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd2c6d-d910-4181-9319-12ee6328f2c1 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:35:32.778427 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 760/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:35:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:35:32.993719 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2722781-1890-46f4-87cc-9ba5390a28a3 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:32.994001 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2722781-1890-46f4-87cc-9ba5390a28a3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:32.994277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2722781-1890-46f4-87cc-9ba5390a28a3 None None] PATH_INFO: `/v3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:32.995822 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 757/1517] 10.222.0.44 () {54 vars in 925 bytes} [Tue Sep 13 06:35:32 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:35:33.025105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410750-a800-4559-bf00-9c06f52421f0 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:33.025337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410750-a800-4559-bf00-9c06f52421f0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:33.025615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d410750-a800-4559-bf00-9c06f52421f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:33.083757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-1d410750-a800-4559-bf00-9c06f52421f0 None None] MFA Rules not processed for user `b84a23931b60457e865f056352a396d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:35:33.084980 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1d410750-a800-4559-bf00-9c06f52421f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:35:33.102281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:35:33.158434 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 761/1518] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Sep 13 06:35:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:35:36.748913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea493b-ff18-4a1d-afc4-34c4ee9f75c1 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:36.749385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea493b-ff18-4a1d-afc4-34c4ee9f75c1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:36.749491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ea493b-ff18-4a1d-afc4-34c4ee9f75c1 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:36.750805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 758/1519] 10.222.0.42 () {54 vars in 961 bytes} [Tue Sep 13 06:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:35:36.755736 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14334567-aecc-4f42-bae8-447ad7b37ed8 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:36.756187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14334567-aecc-4f42-bae8-447ad7b37ed8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:36.756294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14334567-aecc-4f42-bae8-447ad7b37ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:36.775839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-14334567-aecc-4f42-bae8-447ad7b37ed8 None None] MFA Rules not processed for user `b84a23931b60457e865f056352a396d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:35:36.777094 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-14334567-aecc-4f42-bae8-447ad7b37ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:35:36.787600 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 762/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Tue Sep 13 06:35:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:35:36.795788 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea493b-ff18-4a1d-afc4-34c4ee9f75c1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:35:36.809498 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ea493b-ff18-4a1d-afc4-34c4ee9f75c1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:35:36.815170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fd92c-cca4-46f9-b2c9-b3fbf37129fc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84a23931b60457e865f056352a396d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:35:36.815769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd92c-cca4-46f9-b2c9-b3fbf37129fc service placement] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:36.816049 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd92c-cca4-46f9-b2c9-b3fbf37129fc service placement] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:36.816330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fd92c-cca4-46f9-b2c9-b3fbf37129fc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:36.824751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fd92c-cca4-46f9-b2c9-b3fbf37129fc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:35:36.826310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fd92c-cca4-46f9-b2c9-b3fbf37129fc service placement] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:35:36.836386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 759/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:35:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:35:44.254386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f0408-6760-4605-b456-c62b805499c9 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:44.254893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f0408-6760-4605-b456-c62b805499c9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:44.255001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4f0408-6760-4605-b456-c62b805499c9 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:44.256293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 763/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:35:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:35:44.262546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd29ec-fb7b-4f2b-abd6-904305b8d037 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:44.262954 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd29ec-fb7b-4f2b-abd6-904305b8d037 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:44.263098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cd29ec-fb7b-4f2b-abd6-904305b8d037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:44.283289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-26cd29ec-fb7b-4f2b-abd6-904305b8d037 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:35:44.284490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-26cd29ec-fb7b-4f2b-abd6-904305b8d037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:35:44.292283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 760/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:35:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:35:44.446749 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f0408-6760-4605-b456-c62b805499c9 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:35:44.461201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4f0408-6760-4605-b456-c62b805499c9 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:35:44.466532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5eac1-787d-4117-b9d8-f68732067b8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:35:44.467061 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5eac1-787d-4117-b9d8-f68732067b8b service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:44.467333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5eac1-787d-4117-b9d8-f68732067b8b service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:44.467599 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5eac1-787d-4117-b9d8-f68732067b8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:44.475572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5eac1-787d-4117-b9d8-f68732067b8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:35:44.477182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5eac1-787d-4117-b9d8-f68732067b8b service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:35:44.486799 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 764/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:35:45.548987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa1820-d555-44a5-837b-20c6c581e709 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:45.549525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa1820-d555-44a5-837b-20c6c581e709 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:45.549525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fa1820-d555-44a5-837b-20c6c581e709 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:45.550859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 761/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 06:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:35:45.557202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3514d-e206-4f57-aa9a-6c8f94205977 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:45.557648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3514d-e206-4f57-aa9a-6c8f94205977 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:45.557767 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f3514d-e206-4f57-aa9a-6c8f94205977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:45.576859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-98f3514d-e206-4f57-aa9a-6c8f94205977 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:35:45.578064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-98f3514d-e206-4f57-aa9a-6c8f94205977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:35:45.585845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 765/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 06:35:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:35:45.738992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa1820-d555-44a5-837b-20c6c581e709 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:35:45.753320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fa1820-d555-44a5-837b-20c6c581e709 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:35:45.758875 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb944ef-6f07-460c-a7c1-e39927993948 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:35:45.759463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb944ef-6f07-460c-a7c1-e39927993948 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:45.759737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb944ef-6f07-460c-a7c1-e39927993948 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:45.760004 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb944ef-6f07-460c-a7c1-e39927993948 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:45.769635 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb944ef-6f07-460c-a7c1-e39927993948 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:35:45.771231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb944ef-6f07-460c-a7c1-e39927993948 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:35:45.781135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 762/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:35:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:35:49.850434 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed698a-d42b-4e40-be06-dfad20386a47 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:49.850971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed698a-d42b-4e40-be06-dfad20386a47 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:49.850971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed698a-d42b-4e40-be06-dfad20386a47 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:49.852305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 766/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:35:49.857547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf6626-06da-44e1-80ff-2fef5e716a78 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:49.857961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf6626-06da-44e1-80ff-2fef5e716a78 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:49.858135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ecf6626-06da-44e1-80ff-2fef5e716a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:49.878500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8ecf6626-06da-44e1-80ff-2fef5e716a78 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:35:49.879693 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8ecf6626-06da-44e1-80ff-2fef5e716a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:35:49.887408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 763/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:35:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:35:50.175725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed698a-d42b-4e40-be06-dfad20386a47 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:35:50.177413 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-82ed698a-d42b-4e40-be06-dfad20386a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:35:50.258287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed698a-d42b-4e40-be06-dfad20386a47 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:35:50.261822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e53f8-9f0b-4676-ba2c-bf2cb8baf98f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:35:50.262419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e53f8-9f0b-4676-ba2c-bf2cb8baf98f service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:50.262695 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e53f8-9f0b-4676-ba2c-bf2cb8baf98f service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:50.262963 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e53f8-9f0b-4676-ba2c-bf2cb8baf98f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:50.271748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e53f8-9f0b-4676-ba2c-bf2cb8baf98f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:35:50.273236 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e53f8-9f0b-4676-ba2c-bf2cb8baf98f service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:35:50.283190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 767/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:35:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:35:52.427639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659b010-c13a-4647-a86d-cdc0f4a79541 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:52.428075 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659b010-c13a-4647-a86d-cdc0f4a79541 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:52.428197 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d659b010-c13a-4647-a86d-cdc0f4a79541 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:52.429993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 764/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:35:52.435523 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38a25d-6c2a-4496-bc26-1a16f583997d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:52.435976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38a25d-6c2a-4496-bc26-1a16f583997d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:52.436158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc38a25d-6c2a-4496-bc26-1a16f583997d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:52.456578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-dc38a25d-6c2a-4496-bc26-1a16f583997d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:35:52.457817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-dc38a25d-6c2a-4496-bc26-1a16f583997d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:35:52.465729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 768/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:35:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:35:52.753390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659b010-c13a-4647-a86d-cdc0f4a79541 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:35:52.755092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d659b010-c13a-4647-a86d-cdc0f4a79541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:35:52.768384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d659b010-c13a-4647-a86d-cdc0f4a79541 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:35:52.771860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b03c0db-92ff-4aa1-84a5-84ae4f95d17f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:35:52.772448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03c0db-92ff-4aa1-84a5-84ae4f95d17f service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:52.772756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03c0db-92ff-4aa1-84a5-84ae4f95d17f service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:52.773026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b03c0db-92ff-4aa1-84a5-84ae4f95d17f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:52.781671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03c0db-92ff-4aa1-84a5-84ae4f95d17f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:35:52.783668 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b03c0db-92ff-4aa1-84a5-84ae4f95d17f service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:35:52.793032 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 765/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:35:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:35:56.565801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444ff14-0b89-45cc-ac1a-1020679a25b0 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:56.566383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444ff14-0b89-45cc-ac1a-1020679a25b0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:56.566383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444ff14-0b89-45cc-ac1a-1020679a25b0 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:56.567708 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 769/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:35:56.572919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c229e6b-6cdf-448c-a25f-ac76abce26c9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:56.573305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c229e6b-6cdf-448c-a25f-ac76abce26c9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:56.573482 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c229e6b-6cdf-448c-a25f-ac76abce26c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:56.581586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=81 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:35:56.594453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2c229e6b-6cdf-448c-a25f-ac76abce26c9 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:35:56.596221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2c229e6b-6cdf-448c-a25f-ac76abce26c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:35:56.604002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 766/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:35:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:35:56.905618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444ff14-0b89-45cc-ac1a-1020679a25b0 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:35:56.907318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c444ff14-0b89-45cc-ac1a-1020679a25b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:35:56.971387 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:35:56.984697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444ff14-0b89-45cc-ac1a-1020679a25b0 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:35:56.988752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69612f9-bc14-481a-bdab-d08a8120068c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:35:56.989352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69612f9-bc14-481a-bdab-d08a8120068c service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:56.989633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69612f9-bc14-481a-bdab-d08a8120068c service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:56.989907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69612f9-bc14-481a-bdab-d08a8120068c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:56.998861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69612f9-bc14-481a-bdab-d08a8120068c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:35:57.000291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69612f9-bc14-481a-bdab-d08a8120068c service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:35:57.010152 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 770/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:35:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:35:59.148936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7741ae-18bf-42bd-9cca-050c0132617c None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:59.149440 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7741ae-18bf-42bd-9cca-050c0132617c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:59.149537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7741ae-18bf-42bd-9cca-050c0132617c None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:59.150820 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 767/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 06:35:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:35:59.155985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e259ace-b4c7-4595-acd6-94064312057f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:59.156426 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e259ace-b4c7-4595-acd6-94064312057f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:59.156569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e259ace-b4c7-4595-acd6-94064312057f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:59.175875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2e259ace-b4c7-4595-acd6-94064312057f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:35:59.177115 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2e259ace-b4c7-4595-acd6-94064312057f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:35:59.184931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 771/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 06:35:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:35:59.482910 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7741ae-18bf-42bd-9cca-050c0132617c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:35:59.484561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fc7741ae-18bf-42bd-9cca-050c0132617c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:35:59.498128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7741ae-18bf-42bd-9cca-050c0132617c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:35:59.502231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4b3c4-4e03-41c7-bd53-861686d7cc61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:35:59.502819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4b3c4-4e03-41c7-bd53-861686d7cc61 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:35:59.503100 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4b3c4-4e03-41c7-bd53-861686d7cc61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:35:59.503370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4b3c4-4e03-41c7-bd53-861686d7cc61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:35:59.512107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4b3c4-4e03-41c7-bd53-861686d7cc61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:35:59.513542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4b3c4-4e03-41c7-bd53-861686d7cc61 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:35:59.522812 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 768/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:35:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:36:09.171084 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=11 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:36:09.518640 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=8 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:29.548226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21944f-69c8-4efc-9a54-caa8c6433c97 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:29.548919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21944f-69c8-4efc-9a54-caa8c6433c97 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:29.548919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d21944f-69c8-4efc-9a54-caa8c6433c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:29.571361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-3d21944f-69c8-4efc-9a54-caa8c6433c97 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:29.572651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3d21944f-69c8-4efc-9a54-caa8c6433c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:29.591739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 772/1540] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:29.602581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdab929-a2ca-407d-847e-2028b1b6d770 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:29.603220 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdab929-a2ca-407d-847e-2028b1b6d770 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:29.603220 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdab929-a2ca-407d-847e-2028b1b6d770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:29.630653 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e8dd1-4ab9-4c3d-8904-a56a9ae06d85 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:29.630974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e8dd1-4ab9-4c3d-8904-a56a9ae06d85 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:29.631217 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040e8dd1-4ab9-4c3d-8904-a56a9ae06d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:29.634933 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fcdab929-a2ca-407d-847e-2028b1b6d770 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:29.636159 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fcdab929-a2ca-407d-847e-2028b1b6d770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:29.658777 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-040e8dd1-4ab9-4c3d-8904-a56a9ae06d85 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:29.660109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-040e8dd1-4ab9-4c3d-8904-a56a9ae06d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:29.666892 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 769/1541] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:29.673817 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdab929-a2ca-407d-847e-2028b1b6d770 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:29.683055 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 773/1542] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:29.688636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdab929-a2ca-407d-847e-2028b1b6d770 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:29.691993 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ff652-622a-4f44-83a6-867e2efda48a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:29.692547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ff652-622a-4f44-83a6-867e2efda48a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:29.693069 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ff652-622a-4f44-83a6-867e2efda48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:29.714225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fa511-d7f1-4c45-8058-db1205048587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:29.714848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fa511-d7f1-4c45-8058-db1205048587 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:29.715123 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fa511-d7f1-4c45-8058-db1205048587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:29.715390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2fa511-d7f1-4c45-8058-db1205048587 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:29.716045 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fa511-d7f1-4c45-8058-db1205048587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:37:29.716523 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fa511-d7f1-4c45-8058-db1205048587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:29.718135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-2c2fa511-d7f1-4c45-8058-db1205048587 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:37:29.718135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: warnings.warn(msg) Sep 13 06:37:29.718135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: Sep 13 06:37:29.721023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2fa511-d7f1-4c45-8058-db1205048587 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:29.732490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0f4ff652-622a-4f44-83a6-867e2efda48a None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:29.734941 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0f4ff652-622a-4f44-83a6-867e2efda48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:29.745351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 770/1543] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:37:29.748230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 774/1544] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:37:29.753090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fa511-d7f1-4c45-8058-db1205048587 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:29.757435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ff652-622a-4f44-83a6-867e2efda48a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:29.767781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2fa511-d7f1-4c45-8058-db1205048587 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:29.770620 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ff652-622a-4f44-83a6-867e2efda48a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:29.781907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e33d68-238a-498e-8483-4b2d0c757276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:29.782544 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a813a-56ea-4b40-9203-523f370d55b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:29.783162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a813a-56ea-4b40-9203-523f370d55b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:29.783399 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e33d68-238a-498e-8483-4b2d0c757276 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:29.783518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a813a-56ea-4b40-9203-523f370d55b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:29.783689 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a813a-56ea-4b40-9203-523f370d55b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:29.784160 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e33d68-238a-498e-8483-4b2d0c757276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:29.784342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a813a-56ea-4b40-9203-523f370d55b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:37:29.784631 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a813a-56ea-4b40-9203-523f370d55b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:29.785045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e33d68-238a-498e-8483-4b2d0c757276 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:29.786041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e33d68-238a-498e-8483-4b2d0c757276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:29.786275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a813a-56ea-4b40-9203-523f370d55b3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:29.787504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: WARNING py.warnings [None req-64e33d68-238a-498e-8483-4b2d0c757276 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:37:29.787504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: warnings.warn(msg) Sep 13 06:37:29.787504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: Sep 13 06:37:29.789359 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e33d68-238a-498e-8483-4b2d0c757276 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:29.816623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 771/1545] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:37:29.819410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a813a-56ea-4b40-9203-523f370d55b3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:29.836347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a813a-56ea-4b40-9203-523f370d55b3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:29.859283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 775/1546] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:29 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:37:29.862507 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2421726-5705-4bd1-8be5-2b59bac66108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:29.863058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2421726-5705-4bd1-8be5-2b59bac66108 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:29.863335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2421726-5705-4bd1-8be5-2b59bac66108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:29.863602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2421726-5705-4bd1-8be5-2b59bac66108 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:29.864342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2421726-5705-4bd1-8be5-2b59bac66108 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:29.866165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2421726-5705-4bd1-8be5-2b59bac66108 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:29.867409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e33d68-238a-498e-8483-4b2d0c757276 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:29.946418 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 772/1547] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:29 2022] POST /identity/v3/projects => generated 377 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:29.956745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ac4d9-b981-4cbf-b9c7-bd6896639a7e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:29.956745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ac4d9-b981-4cbf-b9c7-bd6896639a7e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:29.956745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0ac4d9-b981-4cbf-b9c7-bd6896639a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.000865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cb0ac4d9-b981-4cbf-b9c7-bd6896639a7e None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:30.005641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cb0ac4d9-b981-4cbf-b9c7-bd6896639a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:30.007249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e33d68-238a-498e-8483-4b2d0c757276 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.097865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 773/1548] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:30.098630 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ac4d9-b981-4cbf-b9c7-bd6896639a7e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.116996 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c3a6d-b607-4ff3-b94e-a3dac99f731a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.117617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c3a6d-b607-4ff3-b94e-a3dac99f731a admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.117898 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c3a6d-b607-4ff3-b94e-a3dac99f731a admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.118300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c3a6d-b607-4ff3-b94e-a3dac99f731a admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.118941 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c3a6d-b607-4ff3-b94e-a3dac99f731a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.119616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0ac4d9-b981-4cbf-b9c7-bd6896639a7e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.121393 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c3a6d-b607-4ff3-b94e-a3dac99f731a admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.125664 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d34f07-8010-4749-acf4-ce6210f2196b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.126544 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d34f07-8010-4749-acf4-ce6210f2196b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.127046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d34f07-8010-4749-acf4-ce6210f2196b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.127549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d34f07-8010-4749-acf4-ce6210f2196b admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.128397 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d34f07-8010-4749-acf4-ce6210f2196b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.129765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-a0d34f07-8010-4749-acf4-ce6210f2196b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:37:30.129765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: warnings.warn(msg) Sep 13 06:37:30.129765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: Sep 13 06:37:30.131591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d34f07-8010-4749-acf4-ce6210f2196b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.159131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 776/1549] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:29 2022] POST /identity/v3/users => generated 288 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:30.159355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 774/1550] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/users => generated 289 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:30.159453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ff57c-6cbc-4b00-95f6-d7ee1bf0f8bb None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.159453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ff57c-6cbc-4b00-95f6-d7ee1bf0f8bb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.159453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ff57c-6cbc-4b00-95f6-d7ee1bf0f8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.159692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e46a-496f-4dbe-9eeb-4b2983c833a4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.159692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e46a-496f-4dbe-9eeb-4b2983c833a4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.160630 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8748e46a-496f-4dbe-9eeb-4b2983c833a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.181424 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-441ff57c-6cbc-4b00-95f6-d7ee1bf0f8bb None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:30.181827 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8748e46a-496f-4dbe-9eeb-4b2983c833a4 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:30.182635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-441ff57c-6cbc-4b00-95f6-d7ee1bf0f8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:30.183586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8748e46a-496f-4dbe-9eeb-4b2983c833a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:30.198162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 777/1551] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:30.198162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb39213-9faa-45bb-85d1-06c27aeaccca None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.198162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb39213-9faa-45bb-85d1-06c27aeaccca None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.198162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb39213-9faa-45bb-85d1-06c27aeaccca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.203117 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 775/1552] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:30.205367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1aba3-b0a0-4ed7-a656-70bf752d58e8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.205649 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1aba3-b0a0-4ed7-a656-70bf752d58e8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.205922 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b1aba3-b0a0-4ed7-a656-70bf752d58e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.221151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9fb39213-9faa-45bb-85d1-06c27aeaccca None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:30.222733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9fb39213-9faa-45bb-85d1-06c27aeaccca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:30.225664 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f2b1aba3-b0a0-4ed7-a656-70bf752d58e8 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:30.226812 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f2b1aba3-b0a0-4ed7-a656-70bf752d58e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:30.230853 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 778/1553] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:30.232265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba58fcf-b57e-4036-b829-0915192a1c9c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.233293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba58fcf-b57e-4036-b829-0915192a1c9c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.233511 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba58fcf-b57e-4036-b829-0915192a1c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.235975 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 776/1554] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:30.236897 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1aba3-b0a0-4ed7-a656-70bf752d58e8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.246849 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b1aba3-b0a0-4ed7-a656-70bf752d58e8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.252003 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83689278-f781-485a-ac7a-126da3c7aeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.252581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83689278-f781-485a-ac7a-126da3c7aeec admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.252888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83689278-f781-485a-ac7a-126da3c7aeec admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.253159 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83689278-f781-485a-ac7a-126da3c7aeec admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.253820 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83689278-f781-485a-ac7a-126da3c7aeec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.255390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83689278-f781-485a-ac7a-126da3c7aeec admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.256478 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6ba58fcf-b57e-4036-b829-0915192a1c9c None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:30.258900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6ba58fcf-b57e-4036-b829-0915192a1c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:30.265571 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 777/1555] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:30.266547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83689278-f781-485a-ac7a-126da3c7aeec admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.269048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 779/1556] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:30.270516 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16440770-8c3b-49c0-9b25-9174912ea743 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.270896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16440770-8c3b-49c0-9b25-9174912ea743 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.271378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16440770-8c3b-49c0-9b25-9174912ea743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.276774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83689278-f781-485a-ac7a-126da3c7aeec admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.281446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a97820-04f9-4703-96f5-efbb4eb79366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.282038 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a97820-04f9-4703-96f5-efbb4eb79366 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.282326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a97820-04f9-4703-96f5-efbb4eb79366 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.282594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a97820-04f9-4703-96f5-efbb4eb79366 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.283260 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a97820-04f9-4703-96f5-efbb4eb79366 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.284896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a97820-04f9-4703-96f5-efbb4eb79366 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.290463 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-16440770-8c3b-49c0-9b25-9174912ea743 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:30.291648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-16440770-8c3b-49c0-9b25-9174912ea743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:30.297090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 778/1557] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:30.298144 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ada21-d06c-46ba-92c5-522e51e1b47b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.298431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ada21-d06c-46ba-92c5-522e51e1b47b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.298761 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ada21-d06c-46ba-92c5-522e51e1b47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.303625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 780/1558] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:30.303625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe6dd1-b835-4ebc-a32c-787a53769997 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.303625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe6dd1-b835-4ebc-a32c-787a53769997 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.303625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fe6dd1-b835-4ebc-a32c-787a53769997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.320595 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c62ada21-d06c-46ba-92c5-522e51e1b47b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:30.320818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-36fe6dd1-b835-4ebc-a32c-787a53769997 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:30.321934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c62ada21-d06c-46ba-92c5-522e51e1b47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:30.322064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-36fe6dd1-b835-4ebc-a32c-787a53769997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:30.334035 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 779/1559] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:30.334035 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde95a6-c65b-43bd-b73c-0f6d74d99944 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.334035 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde95a6-c65b-43bd-b73c-0f6d74d99944 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.334035 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde95a6-c65b-43bd-b73c-0f6d74d99944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.334447 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 781/1560] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:30.334447 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe6dd1-b835-4ebc-a32c-787a53769997 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.345006 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fe6dd1-b835-4ebc-a32c-787a53769997 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.349734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafd61ae-906a-4c34-ad27-61144e45ffb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.350265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd61ae-906a-4c34-ad27-61144e45ffb1 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.350576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd61ae-906a-4c34-ad27-61144e45ffb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.350849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafd61ae-906a-4c34-ad27-61144e45ffb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.351497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd61ae-906a-4c34-ad27-61144e45ffb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:37:30.351694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cbde95a6-c65b-43bd-b73c-0f6d74d99944 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:30.351816 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd61ae-906a-4c34-ad27-61144e45ffb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.352924 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cbde95a6-c65b-43bd-b73c-0f6d74d99944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:30.353414 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafd61ae-906a-4c34-ad27-61144e45ffb1 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.360716 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 780/1561] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:30.361550 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde95a6-c65b-43bd-b73c-0f6d74d99944 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.362052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:30.368589 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 782/1562] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:37:30.370250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176694-6e8b-416e-ab3f-308e0f1255b1 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.370669 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176694-6e8b-416e-ab3f-308e0f1255b1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.371318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33176694-6e8b-416e-ab3f-308e0f1255b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.373697 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde95a6-c65b-43bd-b73c-0f6d74d99944 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.381735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6066214-0cab-4527-b109-869a7a24fbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.382538 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6066214-0cab-4527-b109-869a7a24fbe1 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.382852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6066214-0cab-4527-b109-869a7a24fbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.383174 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6066214-0cab-4527-b109-869a7a24fbe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.383870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6066214-0cab-4527-b109-869a7a24fbe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.385877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6066214-0cab-4527-b109-869a7a24fbe1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.394992 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-33176694-6e8b-416e-ab3f-308e0f1255b1 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:30.396189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-33176694-6e8b-416e-ab3f-308e0f1255b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:30.399393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 781/1563] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:30.400279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6066214-0cab-4527-b109-869a7a24fbe1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.407262 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 783/1564] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:30.408039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33176694-6e8b-416e-ab3f-308e0f1255b1 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.413043 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6066214-0cab-4527-b109-869a7a24fbe1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.417419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33176694-6e8b-416e-ab3f-308e0f1255b1 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.417618 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163c553-8968-4b69-acc7-6be3d601886e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.418204 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163c553-8968-4b69-acc7-6be3d601886e admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.418483 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163c553-8968-4b69-acc7-6be3d601886e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.418751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163c553-8968-4b69-acc7-6be3d601886e admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.419380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163c553-8968-4b69-acc7-6be3d601886e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.421024 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163c553-8968-4b69-acc7-6be3d601886e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.421972 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6d44a-ed97-4ae1-8bf4-376e33a9ac59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.422555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6d44a-ed97-4ae1-8bf4-376e33a9ac59 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.422832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6d44a-ed97-4ae1-8bf4-376e33a9ac59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.423108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6d44a-ed97-4ae1-8bf4-376e33a9ac59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.423745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6d44a-ed97-4ae1-8bf4-376e33a9ac59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:37:30.424051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6d44a-ed97-4ae1-8bf4-376e33a9ac59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.425714 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6d44a-ed97-4ae1-8bf4-376e33a9ac59 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.431079 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 782/1565] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:30.432049 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163c553-8968-4b69-acc7-6be3d601886e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.444841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 784/1566] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:37:30.444841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c894b-91ff-4c75-8b95-c87652366ef5 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.444841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c894b-91ff-4c75-8b95-c87652366ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.444841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0c894b-91ff-4c75-8b95-c87652366ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.445291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163c553-8968-4b69-acc7-6be3d601886e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.447947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8a462-f507-48f8-b197-0903cc08ad6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.448526 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8a462-f507-48f8-b197-0903cc08ad6f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.448847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8a462-f507-48f8-b197-0903cc08ad6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.449117 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8a462-f507-48f8-b197-0903cc08ad6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.449751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8a462-f507-48f8-b197-0903cc08ad6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:37:30.450050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8a462-f507-48f8-b197-0903cc08ad6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.452257 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8a462-f507-48f8-b197-0903cc08ad6f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.459339 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9e0c894b-91ff-4c75-8b95-c87652366ef5 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:30.460539 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9e0c894b-91ff-4c75-8b95-c87652366ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:30.464544 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 783/1567] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:37:30.465394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8a462-f507-48f8-b197-0903cc08ad6f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.469125 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 785/1568] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:30.472840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c894b-91ff-4c75-8b95-c87652366ef5 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.474228 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:30.477979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8a462-f507-48f8-b197-0903cc08ad6f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.480515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0c894b-91ff-4c75-8b95-c87652366ef5 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.484003 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3af45-c4c3-440d-82d2-0064e1ae367f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.484607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3af45-c4c3-440d-82d2-0064e1ae367f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.484934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3af45-c4c3-440d-82d2-0064e1ae367f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.485208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f3af45-c4c3-440d-82d2-0064e1ae367f admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.485346 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557131b-c36e-4d88-a40b-788a8fec87cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.485805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557131b-c36e-4d88-a40b-788a8fec87cc admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.485915 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3af45-c4c3-440d-82d2-0064e1ae367f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:37:30.486105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557131b-c36e-4d88-a40b-788a8fec87cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.486214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3af45-c4c3-440d-82d2-0064e1ae367f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.486378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557131b-c36e-4d88-a40b-788a8fec87cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.486959 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557131b-c36e-4d88-a40b-788a8fec87cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.487917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f3af45-c4c3-440d-82d2-0064e1ae367f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.489061 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557131b-c36e-4d88-a40b-788a8fec87cc admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.500339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 784/1569] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:37:30.505540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3af45-c4c3-440d-82d2-0064e1ae367f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.516094 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f3af45-c4c3-440d-82d2-0064e1ae367f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.523770 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 786/1570] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:30.523967 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a8e1f-f9c2-4378-b02d-6d0154780188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.524094 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557131b-c36e-4d88-a40b-788a8fec87cc admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.524216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a8e1f-f9c2-4378-b02d-6d0154780188 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.524216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a8e1f-f9c2-4378-b02d-6d0154780188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.524216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a8e1f-f9c2-4378-b02d-6d0154780188 admin admin] PATH_INFO: `/v3/projects/205e037c73cc4f50856ad2bd54690c08/users/2be13654c5be47f8919773766ab02148/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.537616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a8e1f-f9c2-4378-b02d-6d0154780188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=205e037c73cc4f50856ad2bd54690c08, user_id=2be13654c5be47f8919773766ab02148, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.540248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a8e1f-f9c2-4378-b02d-6d0154780188 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.553773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 785/1571] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:30 2022] PUT /identity/v3/projects/205e037c73cc4f50856ad2bd54690c08/users/2be13654c5be47f8919773766ab02148/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:30.554675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a8e1f-f9c2-4378-b02d-6d0154780188 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.586692 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557131b-c36e-4d88-a40b-788a8fec87cc admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.615917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a8e1f-f9c2-4378-b02d-6d0154780188 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.621490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b323505-e9ac-46d7-9633-266cdf426b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.622143 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b323505-e9ac-46d7-9633-266cdf426b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.622425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b323505-e9ac-46d7-9633-266cdf426b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.622701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b323505-e9ac-46d7-9633-266cdf426b0e admin admin] PATH_INFO: `/v3/projects/767bb45617ea47928f265a77f6a6f8dd/users/a05d9cf1223b44589ab5586ec50a5b2f/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.641770 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b323505-e9ac-46d7-9633-266cdf426b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=767bb45617ea47928f265a77f6a6f8dd, user_id=a05d9cf1223b44589ab5586ec50a5b2f, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.644443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b323505-e9ac-46d7-9633-266cdf426b0e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.644692 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2582fe3-8810-415f-8644-adfeb23d845b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.645363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2582fe3-8810-415f-8644-adfeb23d845b admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.645645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2582fe3-8810-415f-8644-adfeb23d845b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.645908 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2582fe3-8810-415f-8644-adfeb23d845b admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.646556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2582fe3-8810-415f-8644-adfeb23d845b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:37:30.646848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2582fe3-8810-415f-8644-adfeb23d845b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.648409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2582fe3-8810-415f-8644-adfeb23d845b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.657995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 786/1572] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:30 2022] PUT /identity/v3/projects/767bb45617ea47928f265a77f6a6f8dd/users/a05d9cf1223b44589ab5586ec50a5b2f/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:30.661752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b323505-e9ac-46d7-9633-266cdf426b0e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.664706 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 787/1573] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:37:30.665050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2582fe3-8810-415f-8644-adfeb23d845b admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.674693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2582fe3-8810-415f-8644-adfeb23d845b admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.724103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:30.726871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b323505-e9ac-46d7-9633-266cdf426b0e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.731955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6132453-fa51-4be0-8d04-5fa17e46a078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.733430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6132453-fa51-4be0-8d04-5fa17e46a078 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.733849 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6132453-fa51-4be0-8d04-5fa17e46a078 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.734137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6132453-fa51-4be0-8d04-5fa17e46a078 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.734795 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6132453-fa51-4be0-8d04-5fa17e46a078 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.736724 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6132453-fa51-4be0-8d04-5fa17e46a078 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.736885 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93641fd-ff03-489b-914c-d9d41f33533e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.737888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93641fd-ff03-489b-914c-d9d41f33533e admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.738383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93641fd-ff03-489b-914c-d9d41f33533e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.738893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93641fd-ff03-489b-914c-d9d41f33533e admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.739709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93641fd-ff03-489b-914c-d9d41f33533e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.742329 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93641fd-ff03-489b-914c-d9d41f33533e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.765436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 787/1574] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:30.766629 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6132453-fa51-4be0-8d04-5fa17e46a078 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.772329 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 788/1575] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:30.772329 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93641fd-ff03-489b-914c-d9d41f33533e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.807581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:30.831414 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93641fd-ff03-489b-914c-d9d41f33533e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.834177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6132453-fa51-4be0-8d04-5fa17e46a078 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.836163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f0c41-4ca0-477c-8e62-4124f812c419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.836801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f0c41-4ca0-477c-8e62-4124f812c419 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.837081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f0c41-4ca0-477c-8e62-4124f812c419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.837351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f0c41-4ca0-477c-8e62-4124f812c419 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.837976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f0c41-4ca0-477c-8e62-4124f812c419 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.838949 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482204b-db71-472b-853e-6f0188e5e8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.839533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482204b-db71-472b-853e-6f0188e5e8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.839814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482204b-db71-472b-853e-6f0188e5e8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.839925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f0c41-4ca0-477c-8e62-4124f812c419 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.840115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482204b-db71-472b-853e-6f0188e5e8b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.840798 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482204b-db71-472b-853e-6f0188e5e8b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:37:30.841105 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482204b-db71-472b-853e-6f0188e5e8b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.842675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482204b-db71-472b-853e-6f0188e5e8b1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.854970 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 788/1576] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:37:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:37:30.856083 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482204b-db71-472b-853e-6f0188e5e8b1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.866234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482204b-db71-472b-853e-6f0188e5e8b1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.871296 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6214ac4-7bfb-49fb-82a3-d8cbc05dd720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.871885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6214ac4-7bfb-49fb-82a3-d8cbc05dd720 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.872170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6214ac4-7bfb-49fb-82a3-d8cbc05dd720 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.872442 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6214ac4-7bfb-49fb-82a3-d8cbc05dd720 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.873686 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6214ac4-7bfb-49fb-82a3-d8cbc05dd720 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.874643 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 789/1577] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:30.875577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6214ac4-7bfb-49fb-82a3-d8cbc05dd720 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.878397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62140546-4ce0-4d5c-8d0a-b9d6de75e811 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.878686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62140546-4ce0-4d5c-8d0a-b9d6de75e811 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.878961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62140546-4ce0-4d5c-8d0a-b9d6de75e811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.899431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 789/1578] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/users => generated 303 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:30.899431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e0ca8-0fbc-4a00-9bed-a52335672dd4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.899431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e0ca8-0fbc-4a00-9bed-a52335672dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.899431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e0ca8-0fbc-4a00-9bed-a52335672dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.900956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-62140546-4ce0-4d5c-8d0a-b9d6de75e811 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:30.902160 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-62140546-4ce0-4d5c-8d0a-b9d6de75e811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:30.916711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2b3e0ca8-0fbc-4a00-9bed-a52335672dd4 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:30.917962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2b3e0ca8-0fbc-4a00-9bed-a52335672dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:30.962820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 790/1579] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:30.963756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62140546-4ce0-4d5c-8d0a-b9d6de75e811 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.974149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62140546-4ce0-4d5c-8d0a-b9d6de75e811 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:30.979197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4cf43-991a-4e33-a052-648f55ee3c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:30.979805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4cf43-991a-4e33-a052-648f55ee3c8c admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:30.980086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4cf43-991a-4e33-a052-648f55ee3c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:30.980359 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af4cf43-991a-4e33-a052-648f55ee3c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:30.981028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4cf43-991a-4e33-a052-648f55ee3c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:30.983563 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af4cf43-991a-4e33-a052-648f55ee3c8c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:30.988332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 790/1580] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:30.989037 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e0ca8-0fbc-4a00-9bed-a52335672dd4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:30.999056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e0ca8-0fbc-4a00-9bed-a52335672dd4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.003768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216efdd-10ce-49c1-ba12-1e7d2454a547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.004371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216efdd-10ce-49c1-ba12-1e7d2454a547 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.004653 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216efdd-10ce-49c1-ba12-1e7d2454a547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.005054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216efdd-10ce-49c1-ba12-1e7d2454a547 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.005624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216efdd-10ce-49c1-ba12-1e7d2454a547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.007548 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216efdd-10ce-49c1-ba12-1e7d2454a547 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.015622 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 791/1581] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/projects => generated 363 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:31.016290 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4cf43-991a-4e33-a052-648f55ee3c8c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.028584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 791/1582] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:30 2022] POST /identity/v3/users => generated 295 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:31.029310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216efdd-10ce-49c1-ba12-1e7d2454a547 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.038732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216efdd-10ce-49c1-ba12-1e7d2454a547 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.062344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:31.079885 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af4cf43-991a-4e33-a052-648f55ee3c8c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.084451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5f71f-c2be-4237-a8bd-a2940a634e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.085093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5f71f-c2be-4237-a8bd-a2940a634e8b admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.085369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5f71f-c2be-4237-a8bd-a2940a634e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.085637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5f71f-c2be-4237-a8bd-a2940a634e8b admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.086257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5f71f-c2be-4237-a8bd-a2940a634e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.088233 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5f71f-c2be-4237-a8bd-a2940a634e8b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.096879 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e95b71-146b-41b5-a13c-0d7271da3383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.097488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e95b71-146b-41b5-a13c-0d7271da3383 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.097775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e95b71-146b-41b5-a13c-0d7271da3383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.098054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e95b71-146b-41b5-a13c-0d7271da3383 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.098697 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e95b71-146b-41b5-a13c-0d7271da3383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.100574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e95b71-146b-41b5-a13c-0d7271da3383 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.110883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 792/1583] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:31 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:31.111798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5f71f-c2be-4237-a8bd-a2940a634e8b admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.122128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5f71f-c2be-4237-a8bd-a2940a634e8b admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.127116 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435aabc-cbec-45f0-a272-df42182ebbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.127711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435aabc-cbec-45f0-a272-df42182ebbf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.127989 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435aabc-cbec-45f0-a272-df42182ebbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.128258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0435aabc-cbec-45f0-a272-df42182ebbf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.128944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435aabc-cbec-45f0-a272-df42182ebbf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.129409 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 792/1584] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:31 2022] POST /identity/v3/projects => generated 391 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:31.130240 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e95b71-146b-41b5-a13c-0d7271da3383 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.130848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0435aabc-cbec-45f0-a272-df42182ebbf2 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.152196 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 793/1585] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:31 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:31.153038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435aabc-cbec-45f0-a272-df42182ebbf2 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.158558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:31.198243 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e95b71-146b-41b5-a13c-0d7271da3383 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.203730 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aecb7a-658f-4b2b-a1c3-7de50a366469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.204358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aecb7a-658f-4b2b-a1c3-7de50a366469 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.204637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aecb7a-658f-4b2b-a1c3-7de50a366469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.204939 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aecb7a-658f-4b2b-a1c3-7de50a366469 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.205575 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aecb7a-658f-4b2b-a1c3-7de50a366469 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.207167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78aecb7a-658f-4b2b-a1c3-7de50a366469 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.213039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0435aabc-cbec-45f0-a272-df42182ebbf2 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.217228 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 793/1586] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:31.218033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aecb7a-658f-4b2b-a1c3-7de50a366469 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.261461 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24034245-87e9-4407-9ae2-c7d5ecd37587 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.262073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24034245-87e9-4407-9ae2-c7d5ecd37587 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.262354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24034245-87e9-4407-9ae2-c7d5ecd37587 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.262632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24034245-87e9-4407-9ae2-c7d5ecd37587 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.272425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24034245-87e9-4407-9ae2-c7d5ecd37587 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.272935 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aecb7a-658f-4b2b-a1c3-7de50a366469 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.273932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24034245-87e9-4407-9ae2-c7d5ecd37587 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.276561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeca11c-2121-498d-8c2f-4a26a8e6c500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.277195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeca11c-2121-498d-8c2f-4a26a8e6c500 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.277472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeca11c-2121-498d-8c2f-4a26a8e6c500 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.277832 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeca11c-2121-498d-8c2f-4a26a8e6c500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.283502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 794/1587] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:31.284288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24034245-87e9-4407-9ae2-c7d5ecd37587 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.287683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeca11c-2121-498d-8c2f-4a26a8e6c500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.289946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeca11c-2121-498d-8c2f-4a26a8e6c500 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.293401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24034245-87e9-4407-9ae2-c7d5ecd37587 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.298648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b594d8-39ac-416e-be7e-cca9bd781141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.299246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b594d8-39ac-416e-be7e-cca9bd781141 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.299527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b594d8-39ac-416e-be7e-cca9bd781141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.299802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b594d8-39ac-416e-be7e-cca9bd781141 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.300719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b594d8-39ac-416e-be7e-cca9bd781141 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.301057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 794/1588] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:31.302637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeca11c-2121-498d-8c2f-4a26a8e6c500 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.302752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b594d8-39ac-416e-be7e-cca9bd781141 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.317299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeca11c-2121-498d-8c2f-4a26a8e6c500 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.323433 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178259aa-0429-47fb-92c3-ae7c73429e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.324135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178259aa-0429-47fb-92c3-ae7c73429e65 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.324413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178259aa-0429-47fb-92c3-ae7c73429e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.324702 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178259aa-0429-47fb-92c3-ae7c73429e65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.325347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178259aa-0429-47fb-92c3-ae7c73429e65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.327517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178259aa-0429-47fb-92c3-ae7c73429e65 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.328020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 795/1589] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:31 2022] POST /identity/v3/users => generated 282 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:31.328795 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b594d8-39ac-416e-be7e-cca9bd781141 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.340306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b594d8-39ac-416e-be7e-cca9bd781141 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.344120 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 795/1590] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:31.345322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178259aa-0429-47fb-92c3-ae7c73429e65 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.348642 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8315b0-b0f5-4f33-a169-64927d7496e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.349581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8315b0-b0f5-4f33-a169-64927d7496e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.350047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8315b0-b0f5-4f33-a169-64927d7496e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.350427 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8315b0-b0f5-4f33-a169-64927d7496e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.351674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8315b0-b0f5-4f33-a169-64927d7496e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.355328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8315b0-b0f5-4f33-a169-64927d7496e5 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.357008 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178259aa-0429-47fb-92c3-ae7c73429e65 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.363163 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8d396-c462-4fb1-bb35-335fe0e3d0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.363532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8d396-c462-4fb1-bb35-335fe0e3d0c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.363839 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8d396-c462-4fb1-bb35-335fe0e3d0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.364239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c8d396-c462-4fb1-bb35-335fe0e3d0c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.365061 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8d396-c462-4fb1-bb35-335fe0e3d0c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.366978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c8d396-c462-4fb1-bb35-335fe0e3d0c3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.368453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 796/1591] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:31.369688 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8315b0-b0f5-4f33-a169-64927d7496e5 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.386706 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8315b0-b0f5-4f33-a169-64927d7496e5 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.389750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 796/1592] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:31 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:31.390644 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8d396-c462-4fb1-bb35-335fe0e3d0c3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.398139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ce3aa-8fcd-42b6-9554-611ce45781ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.399246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ce3aa-8fcd-42b6-9554-611ce45781ef admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.399594 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ce3aa-8fcd-42b6-9554-611ce45781ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.399927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ce3aa-8fcd-42b6-9554-611ce45781ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.400934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ce3aa-8fcd-42b6-9554-611ce45781ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.401304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c8d396-c462-4fb1-bb35-335fe0e3d0c3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.402876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6ce3aa-8fcd-42b6-9554-611ce45781ef admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.407220 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cd900-d5ed-4f94-8aae-5a52c751addb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.407831 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cd900-d5ed-4f94-8aae-5a52c751addb admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.408103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cd900-d5ed-4f94-8aae-5a52c751addb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.408430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767cd900-d5ed-4f94-8aae-5a52c751addb admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.409121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cd900-d5ed-4f94-8aae-5a52c751addb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.411205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767cd900-d5ed-4f94-8aae-5a52c751addb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.417544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 797/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:31.419276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ce3aa-8fcd-42b6-9554-611ce45781ef admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.428829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 797/1594] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:31.429953 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cd900-d5ed-4f94-8aae-5a52c751addb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.433568 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ce3aa-8fcd-42b6-9554-611ce45781ef admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.441184 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb8ead-44e6-4166-babd-3b039244594f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.442052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb8ead-44e6-4166-babd-3b039244594f admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.442574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb8ead-44e6-4166-babd-3b039244594f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.442977 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb8ead-44e6-4166-babd-3b039244594f admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.443592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb8ead-44e6-4166-babd-3b039244594f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.445489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcb8ead-44e6-4166-babd-3b039244594f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.448006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767cd900-d5ed-4f94-8aae-5a52c751addb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.454828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce9608-c893-452a-be00-e03bb9c340cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.455637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce9608-c893-452a-be00-e03bb9c340cb admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.456104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce9608-c893-452a-be00-e03bb9c340cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.456535 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce9608-c893-452a-be00-e03bb9c340cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.457003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 798/1595] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:31.457558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce9608-c893-452a-be00-e03bb9c340cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.457835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb8ead-44e6-4166-babd-3b039244594f admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.459507 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce9608-c893-452a-be00-e03bb9c340cb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.467633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcb8ead-44e6-4166-babd-3b039244594f admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.473783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59cfc7-874f-402e-a94a-f10f976a87fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.474675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59cfc7-874f-402e-a94a-f10f976a87fc admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.475344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59cfc7-874f-402e-a94a-f10f976a87fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.475873 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b59cfc7-874f-402e-a94a-f10f976a87fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.476003 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 798/1596] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:31.476852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce9608-c893-452a-be00-e03bb9c340cb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.477139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59cfc7-874f-402e-a94a-f10f976a87fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.479314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b59cfc7-874f-402e-a94a-f10f976a87fc admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.488616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce9608-c893-452a-be00-e03bb9c340cb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.492216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 799/1597] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:31.493156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59cfc7-874f-402e-a94a-f10f976a87fc admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.493533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669cf31-4e51-40fa-be08-36a88d245dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.494085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669cf31-4e51-40fa-be08-36a88d245dbd admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.494685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669cf31-4e51-40fa-be08-36a88d245dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.494908 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669cf31-4e51-40fa-be08-36a88d245dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.495695 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669cf31-4e51-40fa-be08-36a88d245dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.497338 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669cf31-4e51-40fa-be08-36a88d245dbd admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.505160 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b59cfc7-874f-402e-a94a-f10f976a87fc admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.512441 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 799/1598] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:31.512441 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669cf31-4e51-40fa-be08-36a88d245dbd admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.514094 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a50e1a-44ab-43d2-8128-0f14e5f7625e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.515259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a50e1a-44ab-43d2-8128-0f14e5f7625e admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.515409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a50e1a-44ab-43d2-8128-0f14e5f7625e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.515840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a50e1a-44ab-43d2-8128-0f14e5f7625e admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.516579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a50e1a-44ab-43d2-8128-0f14e5f7625e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.518476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a50e1a-44ab-43d2-8128-0f14e5f7625e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.521975 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669cf31-4e51-40fa-be08-36a88d245dbd admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.526555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04749f1-7cbf-4e55-ae8c-a5de98bc440a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.527218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04749f1-7cbf-4e55-ae8c-a5de98bc440a admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.527497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04749f1-7cbf-4e55-ae8c-a5de98bc440a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.527778 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04749f1-7cbf-4e55-ae8c-a5de98bc440a admin admin] PATH_INFO: `/v3/projects/adc66b6a3ea2461f9c20091666d1ac70/users/5a9957c61adb46089de55606b88567d5/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.528946 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:31.535721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 800/1599] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:31.536725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a50e1a-44ab-43d2-8128-0f14e5f7625e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.547194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04749f1-7cbf-4e55-ae8c-a5de98bc440a admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc66b6a3ea2461f9c20091666d1ac70, user_id=5a9957c61adb46089de55606b88567d5, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.549889 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04749f1-7cbf-4e55-ae8c-a5de98bc440a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.551721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a50e1a-44ab-43d2-8128-0f14e5f7625e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.557196 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9173f-f35d-48eb-b69a-d5c01ecd98b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.558071 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9173f-f35d-48eb-b69a-d5c01ecd98b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.558361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9173f-f35d-48eb-b69a-d5c01ecd98b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.558763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f9173f-f35d-48eb-b69a-d5c01ecd98b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.559419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9173f-f35d-48eb-b69a-d5c01ecd98b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.561621 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f9173f-f35d-48eb-b69a-d5c01ecd98b9 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.568260 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 800/1600] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:31 2022] PUT /identity/v3/projects/adc66b6a3ea2461f9c20091666d1ac70/users/5a9957c61adb46089de55606b88567d5/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:31.569668 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04749f1-7cbf-4e55-ae8c-a5de98bc440a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.573068 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 801/1601] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:31.574219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9173f-f35d-48eb-b69a-d5c01ecd98b9 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.586844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f9173f-f35d-48eb-b69a-d5c01ecd98b9 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.616814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:31.662231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04749f1-7cbf-4e55-ae8c-a5de98bc440a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.665950 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259f06f-10c1-44fa-a3c0-208e256add9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.666690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259f06f-10c1-44fa-a3c0-208e256add9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.667044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259f06f-10c1-44fa-a3c0-208e256add9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.667416 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3259f06f-10c1-44fa-a3c0-208e256add9e admin admin] PATH_INFO: `/v3/projects/0a1392f593e64412ad50056443af48af/users/dbf32a1dd3914e6290d3dc661f6dbeef/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.668211 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e29cfa-b0e2-4a17-8c5b-ed53b5b51540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.669001 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e29cfa-b0e2-4a17-8c5b-ed53b5b51540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.669409 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e29cfa-b0e2-4a17-8c5b-ed53b5b51540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.670378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e29cfa-b0e2-4a17-8c5b-ed53b5b51540 admin admin] PATH_INFO: `/v3/projects/d05bb7aaa40549468266ef2bf868b0e5/users/cfdd9d86fbce4b0881a94ab730500ae6/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.686667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259f06f-10c1-44fa-a3c0-208e256add9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a1392f593e64412ad50056443af48af, user_id=dbf32a1dd3914e6290d3dc661f6dbeef, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.688034 dv-cinder-856385-1-smb devstack@keystone.service[81461]: WARNING py.warnings [None req-3259f06f-10c1-44fa-a3c0-208e256add9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:37:31.688034 dv-cinder-856385-1-smb devstack@keystone.service[81461]: warnings.warn(msg) Sep 13 06:37:31.688034 dv-cinder-856385-1-smb devstack@keystone.service[81461]: Sep 13 06:37:31.691312 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3259f06f-10c1-44fa-a3c0-208e256add9e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.692773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e29cfa-b0e2-4a17-8c5b-ed53b5b51540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d05bb7aaa40549468266ef2bf868b0e5, user_id=cfdd9d86fbce4b0881a94ab730500ae6, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.696042 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e29cfa-b0e2-4a17-8c5b-ed53b5b51540 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.709194 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 802/1602] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:31 2022] PUT /identity/v3/projects/0a1392f593e64412ad50056443af48af/users/dbf32a1dd3914e6290d3dc661f6dbeef/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:31.710497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259f06f-10c1-44fa-a3c0-208e256add9e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.711722 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 801/1603] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:31 2022] PUT /identity/v3/projects/d05bb7aaa40549468266ef2bf868b0e5/users/cfdd9d86fbce4b0881a94ab730500ae6/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:31.712711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e29cfa-b0e2-4a17-8c5b-ed53b5b51540 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.802000 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e29cfa-b0e2-4a17-8c5b-ed53b5b51540 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.807232 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c76eb-7802-4f70-8b74-ec52cf5cab7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.807503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3259f06f-10c1-44fa-a3c0-208e256add9e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:31.807913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c76eb-7802-4f70-8b74-ec52cf5cab7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.808189 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c76eb-7802-4f70-8b74-ec52cf5cab7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.808499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5c76eb-7802-4f70-8b74-ec52cf5cab7c admin admin] PATH_INFO: `/v3/projects/0b82e69873ca49aba3825ccd4cde01cf/users/173ae2d542054fe89b5043aef4bda493/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.815376 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e1f0ac-b2fe-4b6a-83b5-3adca5a8cf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:31.816389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1f0ac-b2fe-4b6a-83b5-3adca5a8cf9b admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.817005 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1f0ac-b2fe-4b6a-83b5-3adca5a8cf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.817430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1f0ac-b2fe-4b6a-83b5-3adca5a8cf9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.818772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1f0ac-b2fe-4b6a-83b5-3adca5a8cf9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.821540 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e1f0ac-b2fe-4b6a-83b5-3adca5a8cf9b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.829211 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c76eb-7802-4f70-8b74-ec52cf5cab7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b82e69873ca49aba3825ccd4cde01cf, user_id=173ae2d542054fe89b5043aef4bda493, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:31.833786 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5c76eb-7802-4f70-8b74-ec52cf5cab7c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:31.837201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 803/1604] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:31.839208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac5a9a-2476-4f9e-8396-9c7954661aa7 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.839659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac5a9a-2476-4f9e-8396-9c7954661aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.840258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aac5a9a-2476-4f9e-8396-9c7954661aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:31.863197 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 802/1605] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:31 2022] PUT /identity/v3/projects/0b82e69873ca49aba3825ccd4cde01cf/users/173ae2d542054fe89b5043aef4bda493/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:31.864314 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c76eb-7802-4f70-8b74-ec52cf5cab7c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:31.864801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-5aac5a9a-2476-4f9e-8396-9c7954661aa7 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:31.866202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5aac5a9a-2476-4f9e-8396-9c7954661aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:31.984565 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 804/1606] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:31.985745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235045f-bb56-4757-b560-369973fa1934 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:31.986918 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235045f-bb56-4757-b560-369973fa1934 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:31.988017 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3235045f-bb56-4757-b560-369973fa1934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:32.016290 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5c76eb-7802-4f70-8b74-ec52cf5cab7c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:32.024659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-3235045f-bb56-4757-b560-369973fa1934 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:32.027493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3235045f-bb56-4757-b560-369973fa1934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:32.028269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff059a-761d-44a9-a37c-312880fe9d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:32.029083 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff059a-761d-44a9-a37c-312880fe9d0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:32.030018 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff059a-761d-44a9-a37c-312880fe9d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:32.030505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ff059a-761d-44a9-a37c-312880fe9d0c admin admin] PATH_INFO: `/v3/projects/743060b0e89c422988d4e450dd8cb0dd/users/5c78f4ff6bfb445a8639c75d10622587/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:32.054495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 805/1607] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:32.055760 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac57e6-89ad-44ad-9112-36f39edfb3f2 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:32.056048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac57e6-89ad-44ad-9112-36f39edfb3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:32.056322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac57e6-89ad-44ad-9112-36f39edfb3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:32.076324 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:32.076940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff059a-761d-44a9-a37c-312880fe9d0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=743060b0e89c422988d4e450dd8cb0dd, user_id=5c78f4ff6bfb445a8639c75d10622587, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:32.092372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ff059a-761d-44a9-a37c-312880fe9d0c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:32.122675 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e0ac57e6-89ad-44ad-9112-36f39edfb3f2 None None] MFA Rules not processed for user `dbf32a1dd3914e6290d3dc661f6dbeef`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:32.128109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 803/1608] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:31 2022] PUT /identity/v3/projects/743060b0e89c422988d4e450dd8cb0dd/users/5c78f4ff6bfb445a8639c75d10622587/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:32.139308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e0ac57e6-89ad-44ad-9112-36f39edfb3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:32.141153 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff059a-761d-44a9-a37c-312880fe9d0c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:32.183533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:32.259237 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 806/1609] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:32.260984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979030-c4ad-4b0a-a397-dd00c321d61b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:32.261462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979030-c4ad-4b0a-a397-dd00c321d61b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:32.261734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5979030-c4ad-4b0a-a397-dd00c321d61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:32.265957 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ff059a-761d-44a9-a37c-312880fe9d0c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:32.272416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88983ee6-8906-4eeb-b908-376adc6c9cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:32.274165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88983ee6-8906-4eeb-b908-376adc6c9cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:32.274634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88983ee6-8906-4eeb-b908-376adc6c9cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:32.275067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88983ee6-8906-4eeb-b908-376adc6c9cc1 admin admin] PATH_INFO: `/v3/projects/934624a4612647b6aa32687bfd843241/users/4bad46590fab4c94a789626e42aca76d/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:32.294388 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88983ee6-8906-4eeb-b908-376adc6c9cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=934624a4612647b6aa32687bfd843241, user_id=4bad46590fab4c94a789626e42aca76d, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:32.298271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88983ee6-8906-4eeb-b908-376adc6c9cc1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:32.299814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e5979030-c4ad-4b0a-a397-dd00c321d61b None None] MFA Rules not processed for user `173ae2d542054fe89b5043aef4bda493`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:32.301664 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e5979030-c4ad-4b0a-a397-dd00c321d61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:32.314595 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 804/1610] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:32 2022] PUT /identity/v3/projects/934624a4612647b6aa32687bfd843241/users/4bad46590fab4c94a789626e42aca76d/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:32.317685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88983ee6-8906-4eeb-b908-376adc6c9cc1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:32.400366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 807/1611] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:32.402265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5979030-c4ad-4b0a-a397-dd00c321d61b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:32.419039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88983ee6-8906-4eeb-b908-376adc6c9cc1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:32.433879 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fab70ad-b52f-43f1-9463-81e142b9ac62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:32.434532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab70ad-b52f-43f1-9463-81e142b9ac62 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:32.434978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab70ad-b52f-43f1-9463-81e142b9ac62 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:32.435351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fab70ad-b52f-43f1-9463-81e142b9ac62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:32.525020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5979030-c4ad-4b0a-a397-dd00c321d61b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:32.530669 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e206f5f-9fe1-427d-bc67-b2e12054dee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:32.531620 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e206f5f-9fe1-427d-bc67-b2e12054dee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:32.532202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e206f5f-9fe1-427d-bc67-b2e12054dee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:32.532820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e206f5f-9fe1-427d-bc67-b2e12054dee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:32.556766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab70ad-b52f-43f1-9463-81e142b9ac62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:32.558713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fab70ad-b52f-43f1-9463-81e142b9ac62 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:32.570693 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 805/1612] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:32.571952 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108df9c-e4cf-42aa-a768-fb6dd72d973d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:32.572311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108df9c-e4cf-42aa-a768-fb6dd72d973d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:32.572743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6108df9c-e4cf-42aa-a768-fb6dd72d973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:32.596936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:32.612128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6108df9c-e4cf-42aa-a768-fb6dd72d973d None None] MFA Rules not processed for user `5c78f4ff6bfb445a8639c75d10622587`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:32.613407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6108df9c-e4cf-42aa-a768-fb6dd72d973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:32.644529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e206f5f-9fe1-427d-bc67-b2e12054dee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:32.647297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e206f5f-9fe1-427d-bc67-b2e12054dee5 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:32.661588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 808/1613] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:32.662946 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e206f5f-9fe1-427d-bc67-b2e12054dee5 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:32.673885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:32.679097 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e206f5f-9fe1-427d-bc67-b2e12054dee5 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:32.690702 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd33e38-c23a-4929-8b18-92245d863aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:32.691611 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd33e38-c23a-4929-8b18-92245d863aad admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:32.691897 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd33e38-c23a-4929-8b18-92245d863aad admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:32.693128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd33e38-c23a-4929-8b18-92245d863aad admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:32.694438 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd33e38-c23a-4929-8b18-92245d863aad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:32.696705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd33e38-c23a-4929-8b18-92245d863aad admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:32.705638 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 806/1614] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:32.710895 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb56549-6f41-458a-b6d6-ea3de4058fe1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:32.711250 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb56549-6f41-458a-b6d6-ea3de4058fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:32.711628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb56549-6f41-458a-b6d6-ea3de4058fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:32.734723 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 809/1615] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:32 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:32.736356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd03bd-b18d-4a51-b5aa-87cd72baaafc None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:32.736890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd03bd-b18d-4a51-b5aa-87cd72baaafc None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:32.737368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd03bd-b18d-4a51-b5aa-87cd72baaafc None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:32.737805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3fb56549-6f41-458a-b6d6-ea3de4058fe1 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:32.739164 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3fb56549-6f41-458a-b6d6-ea3de4058fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:32.739726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 810/1616] 10.222.0.42 () {54 vars in 962 bytes} [Tue Sep 13 06:37:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:37:32.740606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd03bd-b18d-4a51-b5aa-87cd72baaafc None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:32.838199 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 807/1617] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:32.839265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb56549-6f41-458a-b6d6-ea3de4058fe1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:32.848915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd03bd-b18d-4a51-b5aa-87cd72baaafc None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:32.851254 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb56549-6f41-458a-b6d6-ea3de4058fe1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:32.856558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaab5a9-5e28-4523-a905-cfba802d1dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:32.857004 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c070eba-33df-4bca-a1b3-84355cd9068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:32.857665 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaab5a9-5e28-4523-a905-cfba802d1dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:32.857841 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070eba-33df-4bca-a1b3-84355cd9068d admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:32.858289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070eba-33df-4bca-a1b3-84355cd9068d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:32.858645 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c070eba-33df-4bca-a1b3-84355cd9068d admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:32.858763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaab5a9-5e28-4523-a905-cfba802d1dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:32.859184 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaab5a9-5e28-4523-a905-cfba802d1dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:32.859562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c070eba-33df-4bca-a1b3-84355cd9068d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:32.860189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaab5a9-5e28-4523-a905-cfba802d1dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:32.861753 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c070eba-33df-4bca-a1b3-84355cd9068d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:32.862810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaab5a9-5e28-4523-a905-cfba802d1dc8 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:32.898723 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 808/1618] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:32 2022] POST /identity/v3/users => generated 293 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:32.900350 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c34a9-0f1e-459b-bb84-02ed48cd891f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:32.900905 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c34a9-0f1e-459b-bb84-02ed48cd891f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:32.901286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c34a9-0f1e-459b-bb84-02ed48cd891f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:32.915132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 811/1619] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:32 2022] POST /identity/v3/projects => generated 363 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:32.917488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaab5a9-5e28-4523-a905-cfba802d1dc8 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:32.957824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cb5c34a9-0f1e-459b-bb84-02ed48cd891f None None] MFA Rules not processed for user `7fbb67072ba544e39073787eb25fcf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:32.959867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cb5c34a9-0f1e-459b-bb84-02ed48cd891f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:32.996545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaab5a9-5e28-4523-a905-cfba802d1dc8 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:33.003475 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9792db0-87a4-44fc-b6b7-b6f2b3008c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:33.004466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9792db0-87a4-44fc-b6b7-b6f2b3008c14 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:33.005018 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9792db0-87a4-44fc-b6b7-b6f2b3008c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:33.005713 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9792db0-87a4-44fc-b6b7-b6f2b3008c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:33.057206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 809/1620] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Sep 13 06:37:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:33.058451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c34a9-0f1e-459b-bb84-02ed48cd891f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:33.083432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:33.104264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9792db0-87a4-44fc-b6b7-b6f2b3008c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:33.106126 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9792db0-87a4-44fc-b6b7-b6f2b3008c14 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:33.120331 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 812/1621] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:33.122586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9792db0-87a4-44fc-b6b7-b6f2b3008c14 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:33.136124 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9792db0-87a4-44fc-b6b7-b6f2b3008c14 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:33.143671 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4f17d-b64d-442b-8899-f396526d1587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:33.144493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4f17d-b64d-442b-8899-f396526d1587 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:33.144839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4f17d-b64d-442b-8899-f396526d1587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:33.145172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e4f17d-b64d-442b-8899-f396526d1587 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:33.145871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4f17d-b64d-442b-8899-f396526d1587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:33.149278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e4f17d-b64d-442b-8899-f396526d1587 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:33.195736 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 813/1622] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:33 2022] POST /identity/v3/users => generated 288 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:33.202567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:33.204147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4f17d-b64d-442b-8899-f396526d1587 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:33.228522 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c34a9-0f1e-459b-bb84-02ed48cd891f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:33.235305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e4f17d-b64d-442b-8899-f396526d1587 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:33.235551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3088ca-e253-48b6-8c69-c40ceb3e3680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:33.235878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3088ca-e253-48b6-8c69-c40ceb3e3680 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:33.236226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3088ca-e253-48b6-8c69-c40ceb3e3680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:33.236509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3088ca-e253-48b6-8c69-c40ceb3e3680 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:33.237227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3088ca-e253-48b6-8c69-c40ceb3e3680 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:33.238930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3088ca-e253-48b6-8c69-c40ceb3e3680 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:33.251643 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cac09e-b8fe-46dd-95d8-0f6ef3313ecc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:33.252340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cac09e-b8fe-46dd-95d8-0f6ef3313ecc service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:33.252616 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cac09e-b8fe-46dd-95d8-0f6ef3313ecc service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:33.252914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cac09e-b8fe-46dd-95d8-0f6ef3313ecc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:33.256281 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 810/1623] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:33.257445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3088ca-e253-48b6-8c69-c40ceb3e3680 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:33.271722 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3088ca-e253-48b6-8c69-c40ceb3e3680 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:33.283329 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe923b5-b496-4f65-98a4-95126569a274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:33.286267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe923b5-b496-4f65-98a4-95126569a274 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:33.287560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe923b5-b496-4f65-98a4-95126569a274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:33.288032 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe923b5-b496-4f65-98a4-95126569a274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:33.289960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe923b5-b496-4f65-98a4-95126569a274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:33.297333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe923b5-b496-4f65-98a4-95126569a274 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:33.333871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 811/1624] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:33.336226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cac09e-b8fe-46dd-95d8-0f6ef3313ecc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:33.339937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe923b5-b496-4f65-98a4-95126569a274 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:33.342265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cac09e-b8fe-46dd-95d8-0f6ef3313ecc service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:33.369575 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 814/1625] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:33.370625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cac09e-b8fe-46dd-95d8-0f6ef3313ecc service nova] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:33.397110 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cac09e-b8fe-46dd-95d8-0f6ef3313ecc service nova] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:33.409687 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe923b5-b496-4f65-98a4-95126569a274 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:33.421257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8003fd-4742-49c7-8ef6-d8b593f92bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:33.422598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8003fd-4742-49c7-8ef6-d8b593f92bd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:33.422885 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8003fd-4742-49c7-8ef6-d8b593f92bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:33.423163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8003fd-4742-49c7-8ef6-d8b593f92bd6 admin admin] PATH_INFO: `/v3/projects/e32fc17674a34431afb197e317a78262/users/aaf62d2a73ca43f3ace00dbc150c4991/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:33.428432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366a7dc-68cb-49f4-a456-026165f2c48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:33.430735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366a7dc-68cb-49f4-a456-026165f2c48a admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:33.431368 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366a7dc-68cb-49f4-a456-026165f2c48a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:33.431663 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366a7dc-68cb-49f4-a456-026165f2c48a admin admin] PATH_INFO: `/v3/projects/807c7fe9905c40bba1e102d187bf961c/users/900e7a8885cd4e9f89acfe6caecce4c5/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:33.460394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8003fd-4742-49c7-8ef6-d8b593f92bd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32fc17674a34431afb197e317a78262, user_id=aaf62d2a73ca43f3ace00dbc150c4991, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:33.465549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8003fd-4742-49c7-8ef6-d8b593f92bd6 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:33.474667 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366a7dc-68cb-49f4-a456-026165f2c48a admin admin] RBAC: Authorizing `identity:create_grant(project_id=807c7fe9905c40bba1e102d187bf961c, user_id=900e7a8885cd4e9f89acfe6caecce4c5, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:33.483018 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366a7dc-68cb-49f4-a456-026165f2c48a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:33.494563 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 815/1626] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:33 2022] PUT /identity/v3/projects/e32fc17674a34431afb197e317a78262/users/aaf62d2a73ca43f3ace00dbc150c4991/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:33.499686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8003fd-4742-49c7-8ef6-d8b593f92bd6 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:33.524032 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 812/1627] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:33 2022] PUT /identity/v3/projects/807c7fe9905c40bba1e102d187bf961c/users/900e7a8885cd4e9f89acfe6caecce4c5/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:33.529368 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366a7dc-68cb-49f4-a456-026165f2c48a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:33.711832 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366a7dc-68cb-49f4-a456-026165f2c48a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:33.745534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f627f-4cc2-4d51-ab3d-ab9eb018a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:33.747539 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8003fd-4742-49c7-8ef6-d8b593f92bd6 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:33.748736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f627f-4cc2-4d51-ab3d-ab9eb018a8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:33.749562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f627f-4cc2-4d51-ab3d-ab9eb018a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:33.749850 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f627f-4cc2-4d51-ab3d-ab9eb018a8d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:33.751668 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f627f-4cc2-4d51-ab3d-ab9eb018a8d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:33.753618 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f627f-4cc2-4d51-ab3d-ab9eb018a8d4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:33.766679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b44f7-772f-4337-ba64-cae2a0cc6801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:33.767326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b44f7-772f-4337-ba64-cae2a0cc6801 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:33.767612 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b44f7-772f-4337-ba64-cae2a0cc6801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:33.767890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b44f7-772f-4337-ba64-cae2a0cc6801 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:33.768559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b44f7-772f-4337-ba64-cae2a0cc6801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:33.778088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b44f7-772f-4337-ba64-cae2a0cc6801 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:33.792086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 813/1628] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:33.793389 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f627f-4cc2-4d51-ab3d-ab9eb018a8d4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:33.818068 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 816/1629] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:33.819297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b44f7-772f-4337-ba64-cae2a0cc6801 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:33.824708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f627f-4cc2-4d51-ab3d-ab9eb018a8d4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:33.839027 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fd751-556b-405c-9134-5a44a16c4fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:33.840550 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fd751-556b-405c-9134-5a44a16c4fc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:33.840862 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fd751-556b-405c-9134-5a44a16c4fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:33.841149 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fd751-556b-405c-9134-5a44a16c4fc2 admin admin] PATH_INFO: `/v3/projects/807c7fe9905c40bba1e102d187bf961c/users/900e7a8885cd4e9f89acfe6caecce4c5/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:33.845547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b44f7-772f-4337-ba64-cae2a0cc6801 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:33.846967 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fd751-556b-405c-9134-5a44a16c4fc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=807c7fe9905c40bba1e102d187bf961c, user_id=900e7a8885cd4e9f89acfe6caecce4c5, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:33.852870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781fd751-556b-405c-9134-5a44a16c4fc2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:33.865840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912bccc7-a90a-4ed1-93b2-31c576f5ef17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:33.866610 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bccc7-a90a-4ed1-93b2-31c576f5ef17 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:33.867360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bccc7-a90a-4ed1-93b2-31c576f5ef17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:33.867652 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912bccc7-a90a-4ed1-93b2-31c576f5ef17 admin admin] PATH_INFO: `/v3/projects/e32fc17674a34431afb197e317a78262/users/aaf62d2a73ca43f3ace00dbc150c4991/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:33.874580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bccc7-a90a-4ed1-93b2-31c576f5ef17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e32fc17674a34431afb197e317a78262, user_id=aaf62d2a73ca43f3ace00dbc150c4991, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:33.883765 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912bccc7-a90a-4ed1-93b2-31c576f5ef17 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:33.900715 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 814/1630] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:33 2022] PUT /identity/v3/projects/807c7fe9905c40bba1e102d187bf961c/users/900e7a8885cd4e9f89acfe6caecce4c5/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:33.905536 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd38721-cffa-4dac-a0d3-010803e8fece None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:33.905933 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd38721-cffa-4dac-a0d3-010803e8fece None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:33.906310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd38721-cffa-4dac-a0d3-010803e8fece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:33.921175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 817/1631] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:33 2022] PUT /identity/v3/projects/e32fc17674a34431afb197e317a78262/users/aaf62d2a73ca43f3ace00dbc150c4991/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:33.923465 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556cf66-661d-41a1-8b41-fa93177b0519 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:33.923942 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556cf66-661d-41a1-8b41-fa93177b0519 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:33.924396 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6556cf66-661d-41a1-8b41-fa93177b0519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:33.967450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cfd38721-cffa-4dac-a0d3-010803e8fece None None] MFA Rules not processed for user `900e7a8885cd4e9f89acfe6caecce4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:33.971391 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cfd38721-cffa-4dac-a0d3-010803e8fece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:33.979075 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6556cf66-661d-41a1-8b41-fa93177b0519 None None] MFA Rules not processed for user `aaf62d2a73ca43f3ace00dbc150c4991`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:33.980402 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6556cf66-661d-41a1-8b41-fa93177b0519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:33.996384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:34.100261 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 818/1632] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:34.103550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f05925-ae0c-4f05-84d4-c8cfdf4dd2da None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:34.104210 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f05925-ae0c-4f05-84d4-c8cfdf4dd2da None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:34.104781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f05925-ae0c-4f05-84d4-c8cfdf4dd2da None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:34.106355 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 819/1633] 10.222.0.42 () {54 vars in 912 bytes} [Tue Sep 13 06:37:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:37:34.112516 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f05925-ae0c-4f05-84d4-c8cfdf4dd2da None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:34.184877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 815/1634] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:33 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:37:34.194664 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f05925-ae0c-4f05-84d4-c8cfdf4dd2da None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:34.199382 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1849d-3d31-48b8-9625-1684be28d0bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:34.200177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1849d-3d31-48b8-9625-1684be28d0bb service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:34.200563 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1849d-3d31-48b8-9625-1684be28d0bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:34.200961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c1849d-3d31-48b8-9625-1684be28d0bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:34.207518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa7810-12ce-4e30-9676-9feaf0ad3d27 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:34.211145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa7810-12ce-4e30-9676-9feaf0ad3d27 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:34.211971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa7810-12ce-4e30-9676-9feaf0ad3d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:34.215442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1849d-3d31-48b8-9625-1684be28d0bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:34.218308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c1849d-3d31-48b8-9625-1684be28d0bb service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:34.232197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 820/1635] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:34.234189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1849d-3d31-48b8-9625-1684be28d0bb service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:34.245617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c1849d-3d31-48b8-9625-1684be28d0bb service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:34.252492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd55469-9ed1-4f12-84c1-ad51f16a22be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:34.255882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd55469-9ed1-4f12-84c1-ad51f16a22be service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:34.258540 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd55469-9ed1-4f12-84c1-ad51f16a22be service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:34.259008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd55469-9ed1-4f12-84c1-ad51f16a22be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:34.268544 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-80fa7810-12ce-4e30-9676-9feaf0ad3d27 None None] MFA Rules not processed for user `7fbb67072ba544e39073787eb25fcf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:34.272198 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-80fa7810-12ce-4e30-9676-9feaf0ad3d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:34.287079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd55469-9ed1-4f12-84c1-ad51f16a22be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:34.298420 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd55469-9ed1-4f12-84c1-ad51f16a22be service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:34.317348 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 821/1636] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:34.317979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:34.460076 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd55469-9ed1-4f12-84c1-ad51f16a22be service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:34.471569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd55469-9ed1-4f12-84c1-ad51f16a22be service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:34.481395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568aebd-888e-42c9-b5bd-93a78973a243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:34.482094 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568aebd-888e-42c9-b5bd-93a78973a243 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:34.482876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568aebd-888e-42c9-b5bd-93a78973a243 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:34.483153 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8568aebd-888e-42c9-b5bd-93a78973a243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:34.537476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 816/1637] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 13 06:37:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:34.565011 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa7810-12ce-4e30-9676-9feaf0ad3d27 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:34.578193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa7810-12ce-4e30-9676-9feaf0ad3d27 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:34.586863 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16652380-1e3e-46e9-9831-5c44d80978a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:34.588158 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16652380-1e3e-46e9-9831-5c44d80978a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:34.589506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16652380-1e3e-46e9-9831-5c44d80978a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:34.589940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16652380-1e3e-46e9-9831-5c44d80978a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:34.608828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568aebd-888e-42c9-b5bd-93a78973a243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:34.610455 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8568aebd-888e-42c9-b5bd-93a78973a243 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:34.619808 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16652380-1e3e-46e9-9831-5c44d80978a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:34.621606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16652380-1e3e-46e9-9831-5c44d80978a0 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:34.646443 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 822/1638] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:34.651491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 817/1639] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:35.120985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568aebd-888e-42c9-b5bd-93a78973a243 service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:35.134926 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8568aebd-888e-42c9-b5bd-93a78973a243 service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:35.144167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c066b04-bfe8-4744-977a-181d0d4de1d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:35.144874 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c066b04-bfe8-4744-977a-181d0d4de1d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:35.145111 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c066b04-bfe8-4744-977a-181d0d4de1d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:35.145407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c066b04-bfe8-4744-977a-181d0d4de1d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:35.266113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:35.328058 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c066b04-bfe8-4744-977a-181d0d4de1d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:35.329559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c066b04-bfe8-4744-977a-181d0d4de1d1 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:35.351431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 823/1640] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:36.850016 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b524fa6-ad3b-44ae-b8c8-75ce9e7470ee None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:36.850016 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b524fa6-ad3b-44ae-b8c8-75ce9e7470ee None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:36.850016 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b524fa6-ad3b-44ae-b8c8-75ce9e7470ee None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:36.851685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 818/1641] 10.222.0.42 () {54 vars in 962 bytes} [Tue Sep 13 06:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:37:36.886342 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d441686-c328-440a-8aeb-ce4555ce2638 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:36.886857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d441686-c328-440a-8aeb-ce4555ce2638 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:36.887157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d441686-c328-440a-8aeb-ce4555ce2638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:36.954779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-1d441686-c328-440a-8aeb-ce4555ce2638 None None] MFA Rules not processed for user `7fbb67072ba544e39073787eb25fcf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:36.956291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1d441686-c328-440a-8aeb-ce4555ce2638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:36.978450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 824/1642] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Sep 13 06:37:36 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:36.985893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cb6ec-c54e-4069-ba67-8a7e8642eaed None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:36.986524 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cb6ec-c54e-4069-ba67-8a7e8642eaed None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:36.987099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cb6ec-c54e-4069-ba67-8a7e8642eaed None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:36.989330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 819/1643] 10.222.0.42 () {54 vars in 912 bytes} [Tue Sep 13 06:37:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:37:37.001927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c0c4b-9da1-464a-9d10-8c221e9ddc0f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:37.002405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c0c4b-9da1-464a-9d10-8c221e9ddc0f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:37.002811 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521c0c4b-9da1-464a-9d10-8c221e9ddc0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:37.049020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-521c0c4b-9da1-464a-9d10-8c221e9ddc0f None None] MFA Rules not processed for user `7fbb67072ba544e39073787eb25fcf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:37.051741 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-521c0c4b-9da1-464a-9d10-8c221e9ddc0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:37.074154 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 825/1644] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 13 06:37:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:37.211390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cb6ec-c54e-4069-ba67-8a7e8642eaed None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:37.238986 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cb6ec-c54e-4069-ba67-8a7e8642eaed None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:37.252541 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a8af-d42e-41bf-88be-f757833ea10b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:37.253380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a8af-d42e-41bf-88be-f757833ea10b service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:37.253980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a8af-d42e-41bf-88be-f757833ea10b service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:37.254404 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2a8af-d42e-41bf-88be-f757833ea10b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:37.295486 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e0240-97f2-4c7d-a3c4-2bcb6b4588a3 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:37.296064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e0240-97f2-4c7d-a3c4-2bcb6b4588a3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:37.296591 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e0240-97f2-4c7d-a3c4-2bcb6b4588a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:37.305397 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2a8af-d42e-41bf-88be-f757833ea10b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:37.315791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2a8af-d42e-41bf-88be-f757833ea10b service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:37.359786 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 820/1645] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:37.384599 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2e0e0240-97f2-4c7d-a3c4-2bcb6b4588a3 None None] MFA Rules not processed for user `5a9957c61adb46089de55606b88567d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:37.386850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2e0e0240-97f2-4c7d-a3c4-2bcb6b4588a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:37.554479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 826/1646] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:37 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:37.555758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a8af-d42e-41bf-88be-f757833ea10b service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:37.713185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2a8af-d42e-41bf-88be-f757833ea10b service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:37.726540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a152a-f7f0-49e4-9b2d-3d355e86201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:37.727319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a152a-f7f0-49e4-9b2d-3d355e86201a admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:37.727601 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a152a-f7f0-49e4-9b2d-3d355e86201a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:37.727874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a152a-f7f0-49e4-9b2d-3d355e86201a admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:37.728535 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a152a-f7f0-49e4-9b2d-3d355e86201a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:37.730852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a152a-f7f0-49e4-9b2d-3d355e86201a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:37.805594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 821/1647] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:37 2022] POST /identity/v3/projects => generated 405 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:37:37.806694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e0240-97f2-4c7d-a3c4-2bcb6b4588a3 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:37.823818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e0240-97f2-4c7d-a3c4-2bcb6b4588a3 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:37.984310 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52260769-5d10-4130-9aaf-9d2bab886e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:37.984978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52260769-5d10-4130-9aaf-9d2bab886e8c admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:37.985681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52260769-5d10-4130-9aaf-9d2bab886e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:37.985681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52260769-5d10-4130-9aaf-9d2bab886e8c admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:37.986817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52260769-5d10-4130-9aaf-9d2bab886e8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:37.996073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52260769-5d10-4130-9aaf-9d2bab886e8c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:38.041695 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 827/1648] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:37 2022] POST /identity/v3/users => generated 309 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:38.045819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a152a-f7f0-49e4-9b2d-3d355e86201a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:38.060602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a152a-f7f0-49e4-9b2d-3d355e86201a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:38.073946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf15114-e386-423a-ab46-c2b6f01bb509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:38.075533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf15114-e386-423a-ab46-c2b6f01bb509 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:38.076314 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf15114-e386-423a-ab46-c2b6f01bb509 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:38.077190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf15114-e386-423a-ab46-c2b6f01bb509 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:38.078062 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf15114-e386-423a-ab46-c2b6f01bb509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:38.080525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf15114-e386-423a-ab46-c2b6f01bb509 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:38.111462 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 822/1649] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:38.115636 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52260769-5d10-4130-9aaf-9d2bab886e8c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:38.131192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52260769-5d10-4130-9aaf-9d2bab886e8c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:38.146145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225e11d-b07f-46c0-9f99-71c9f49675ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:38.147360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225e11d-b07f-46c0-9f99-71c9f49675ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:38.147832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225e11d-b07f-46c0-9f99-71c9f49675ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:38.148280 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225e11d-b07f-46c0-9f99-71c9f49675ac admin admin] PATH_INFO: `/v3/projects/e20dd77de9254f4e8e3a1e8af2fddbff/users/1324983a5ffa403db3196599ac5522ae/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:38.170999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225e11d-b07f-46c0-9f99-71c9f49675ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20dd77de9254f4e8e3a1e8af2fddbff, user_id=1324983a5ffa403db3196599ac5522ae, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:38.174602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0225e11d-b07f-46c0-9f99-71c9f49675ac admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:38.202650 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 828/1650] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:38 2022] PUT /identity/v3/projects/e20dd77de9254f4e8e3a1e8af2fddbff/users/1324983a5ffa403db3196599ac5522ae/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:38.206550 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf15114-e386-423a-ab46-c2b6f01bb509 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:38.222251 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf15114-e386-423a-ab46-c2b6f01bb509 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:38.398446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:38.426612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475de89-925b-4d3b-b8db-73758dca64ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:38.427240 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475de89-925b-4d3b-b8db-73758dca64ec admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:38.427524 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475de89-925b-4d3b-b8db-73758dca64ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:38.427792 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2475de89-925b-4d3b-b8db-73758dca64ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:38.428436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475de89-925b-4d3b-b8db-73758dca64ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:38.432448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2475de89-925b-4d3b-b8db-73758dca64ec admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:38.464629 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 823/1651] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:38.468651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225e11d-b07f-46c0-9f99-71c9f49675ac admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:38.485925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225e11d-b07f-46c0-9f99-71c9f49675ac admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:38.504434 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e901cb0-0139-42a7-86ef-0b46146771c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:38.505572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e901cb0-0139-42a7-86ef-0b46146771c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:38.505572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e901cb0-0139-42a7-86ef-0b46146771c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:38.505770 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e901cb0-0139-42a7-86ef-0b46146771c7 admin admin] PATH_INFO: `/v3/projects/e20dd77de9254f4e8e3a1e8af2fddbff/users/1324983a5ffa403db3196599ac5522ae/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:38.510530 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e901cb0-0139-42a7-86ef-0b46146771c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20dd77de9254f4e8e3a1e8af2fddbff, user_id=1324983a5ffa403db3196599ac5522ae, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:38.515292 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e901cb0-0139-42a7-86ef-0b46146771c7 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:38.545067 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 829/1652] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:38 2022] PUT /identity/v3/projects/e20dd77de9254f4e8e3a1e8af2fddbff/users/1324983a5ffa403db3196599ac5522ae/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:38.843056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475de89-925b-4d3b-b8db-73758dca64ec admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:38.879072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2475de89-925b-4d3b-b8db-73758dca64ec admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:39.022041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11bb9d-c356-4976-b8cc-14fef691ac94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:39.023142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11bb9d-c356-4976-b8cc-14fef691ac94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:39.023436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11bb9d-c356-4976-b8cc-14fef691ac94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:39.024985 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11bb9d-c356-4976-b8cc-14fef691ac94 admin admin] PATH_INFO: `/v3/users/5c78f4ff6bfb445a8639c75d10622587` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:39.027253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11bb9d-c356-4976-b8cc-14fef691ac94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c78f4ff6bfb445a8639c75d10622587)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:39.032549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11bb9d-c356-4976-b8cc-14fef691ac94 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:39.146643 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-db11bb9d-c356-4976-b8cc-14fef691ac94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c78f4ff6bfb445a8639c75d10622587'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:39.160866 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-db11bb9d-c356-4976-b8cc-14fef691ac94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c78f4ff6bfb445a8639c75d10622587'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:39.190319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-db11bb9d-c356-4976-b8cc-14fef691ac94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c78f4ff6bfb445a8639c75d10622587'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:39.218287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-db11bb9d-c356-4976-b8cc-14fef691ac94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c78f4ff6bfb445a8639c75d10622587'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:39.219840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-db11bb9d-c356-4976-b8cc-14fef691ac94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c78f4ff6bfb445a8639c75d10622587'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:39.227928 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 824/1653] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:37:38 2022] DELETE /identity/v3/users/5c78f4ff6bfb445a8639c75d10622587 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:39.232283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6b4d5-aa47-4ce8-ac57-d4432da44580 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:39.232813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6b4d5-aa47-4ce8-ac57-d4432da44580 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:39.233363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb6b4d5-aa47-4ce8-ac57-d4432da44580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:39.243952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:39.269961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-deb6b4d5-aa47-4ce8-ac57-d4432da44580 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:39.271429 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-deb6b4d5-aa47-4ce8-ac57-d4432da44580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:39.365649 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 830/1654] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:39.415994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11bb9d-c356-4976-b8cc-14fef691ac94 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:39.420720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-db11bb9d-c356-4976-b8cc-14fef691ac94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:39.546065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11bb9d-c356-4976-b8cc-14fef691ac94 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:39.550218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed63d22-2ec2-4f75-a865-21b36d77f171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:39.550966 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed63d22-2ec2-4f75-a865-21b36d77f171 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:39.551358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed63d22-2ec2-4f75-a865-21b36d77f171 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:39.551745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed63d22-2ec2-4f75-a865-21b36d77f171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:39.588539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed63d22-2ec2-4f75-a865-21b36d77f171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:39.594108 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed63d22-2ec2-4f75-a865-21b36d77f171 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:39.614431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 825/1655] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:41.254180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcea722-401b-4a6e-9c77-41862c5c67f9 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:41.254668 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcea722-401b-4a6e-9c77-41862c5c67f9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:41.254910 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcea722-401b-4a6e-9c77-41862c5c67f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:41.308201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-bbcea722-401b-4a6e-9c77-41862c5c67f9 None None] MFA Rules not processed for user `1324983a5ffa403db3196599ac5522ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:41.309911 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-bbcea722-401b-4a6e-9c77-41862c5c67f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:41.547934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed63d22-2ec2-4f75-a865-21b36d77f171 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:41.549455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-aed63d22-2ec2-4f75-a865-21b36d77f171 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:41.570549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 831/1656] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:41 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:41.598097 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed63d22-2ec2-4f75-a865-21b36d77f171 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:41.604313 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c036d9e-17ef-4b4d-8907-d2e2d9536589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:41.605190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c036d9e-17ef-4b4d-8907-d2e2d9536589 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:41.605569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c036d9e-17ef-4b4d-8907-d2e2d9536589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:41.605939 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c036d9e-17ef-4b4d-8907-d2e2d9536589 admin admin] PATH_INFO: `/v3/users/173ae2d542054fe89b5043aef4bda493` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:41.607226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c036d9e-17ef-4b4d-8907-d2e2d9536589 admin admin] RBAC: Authorizing `identity:delete_user(user_id=173ae2d542054fe89b5043aef4bda493)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:41.610041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c036d9e-17ef-4b4d-8907-d2e2d9536589 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:41.619851 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:41.702739 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0c036d9e-17ef-4b4d-8907-d2e2d9536589 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '173ae2d542054fe89b5043aef4bda493'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:41.722135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0c036d9e-17ef-4b4d-8907-d2e2d9536589 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '173ae2d542054fe89b5043aef4bda493'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:41.742231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0c036d9e-17ef-4b4d-8907-d2e2d9536589 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '173ae2d542054fe89b5043aef4bda493'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:41.760678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0c036d9e-17ef-4b4d-8907-d2e2d9536589 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '173ae2d542054fe89b5043aef4bda493'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:41.763092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0c036d9e-17ef-4b4d-8907-d2e2d9536589 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '173ae2d542054fe89b5043aef4bda493'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:41.785170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 826/1657] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:37:41 2022] DELETE /identity/v3/users/173ae2d542054fe89b5043aef4bda493 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:41.786761 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311f35c-ff89-44c5-9245-b6990d88595c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:41.787188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311f35c-ff89-44c5-9245-b6990d88595c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:41.788248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a311f35c-ff89-44c5-9245-b6990d88595c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:41.812078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a311f35c-ff89-44c5-9245-b6990d88595c None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:41.813733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a311f35c-ff89-44c5-9245-b6990d88595c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:41.828625 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c036d9e-17ef-4b4d-8907-d2e2d9536589 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:41.830765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0c036d9e-17ef-4b4d-8907-d2e2d9536589 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:41.964874 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 832/1658] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:37:41.985310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c036d9e-17ef-4b4d-8907-d2e2d9536589 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:41.997023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:41.997422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:41.997783 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:41.998518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] PATH_INFO: `/v3/projects/743060b0e89c422988d4e450dd8cb0dd` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:42.003440 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] RBAC: Authorizing `identity:delete_project(project_id=743060b0e89c422988d4e450dd8cb0dd)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:42.004735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: WARNING py.warnings [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:37:42.004735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: warnings.warn(msg) Sep 13 06:37:42.004735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: Sep 13 06:37:42.009228 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:42.095939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311f35c-ff89-44c5-9245-b6990d88595c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:42.097437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a311f35c-ff89-44c5-9245-b6990d88595c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:42.160871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '743060b0e89c422988d4e450dd8cb0dd', 'request_id': 'req-f2a381cc-61c1-407b-9b85-e8788dacb907'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:42.175479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '743060b0e89c422988d4e450dd8cb0dd', 'request_id': 'req-f2a381cc-61c1-407b-9b85-e8788dacb907'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:42.192052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:42.220855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '743060b0e89c422988d4e450dd8cb0dd', 'request_id': 'req-f2a381cc-61c1-407b-9b85-e8788dacb907'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:42.256081 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] The token cache is being invalidate because project 743060b0e89c422988d4e450dd8cb0dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:37:42.256372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:42.260061 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:42.262333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 827/1659] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:37:41 2022] DELETE /identity/v3/projects/743060b0e89c422988d4e450dd8cb0dd => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:42.264093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a311f35c-ff89-44c5-9245-b6990d88595c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:42.266595 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:42.268386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:42.343187 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:42.455405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe59ed-7167-4cff-ba7f-a3574e8d3f49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:42.456133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a381cc-61c1-407b-9b85-e8788dacb907 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:42.457796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe59ed-7167-4cff-ba7f-a3574e8d3f49 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:42.458221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe59ed-7167-4cff-ba7f-a3574e8d3f49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:42.458631 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe59ed-7167-4cff-ba7f-a3574e8d3f49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:42.464013 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-71fe59ed-7167-4cff-ba7f-a3574e8d3f49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:42.474329 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c8d38-651c-46c1-94cb-2994de36f6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:42.475155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c8d38-651c-46c1-94cb-2994de36f6f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:42.477201 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c8d38-651c-46c1-94cb-2994de36f6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:42.478817 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c8d38-651c-46c1-94cb-2994de36f6f2 admin admin] PATH_INFO: `/v3/users/aaf62d2a73ca43f3ace00dbc150c4991` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:42.487539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c8d38-651c-46c1-94cb-2994de36f6f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaf62d2a73ca43f3ace00dbc150c4991)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:42.489824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7c8d38-651c-46c1-94cb-2994de36f6f2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:42.510672 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe59ed-7167-4cff-ba7f-a3574e8d3f49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:42.515393 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fe59ed-7167-4cff-ba7f-a3574e8d3f49 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:42.555436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 833/1660] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:37:42.646137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f7c8d38-651c-46c1-94cb-2994de36f6f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaf62d2a73ca43f3ace00dbc150c4991'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:42.661871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f7c8d38-651c-46c1-94cb-2994de36f6f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaf62d2a73ca43f3ace00dbc150c4991'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:42.687122 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f7c8d38-651c-46c1-94cb-2994de36f6f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaf62d2a73ca43f3ace00dbc150c4991'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:42.700022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f7c8d38-651c-46c1-94cb-2994de36f6f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaf62d2a73ca43f3ace00dbc150c4991'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:42.701995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f7c8d38-651c-46c1-94cb-2994de36f6f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaf62d2a73ca43f3ace00dbc150c4991'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:42.713881 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 828/1661] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:37:42 2022] DELETE /identity/v3/users/aaf62d2a73ca43f3ace00dbc150c4991 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:43.879102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec429f8e-b9d0-4037-8076-94d51db49288 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:43.879617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec429f8e-b9d0-4037-8076-94d51db49288 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:43.879734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec429f8e-b9d0-4037-8076-94d51db49288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:43.966972 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ec429f8e-b9d0-4037-8076-94d51db49288 None None] MFA Rules not processed for user `a05d9cf1223b44589ab5586ec50a5b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:43.968241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ec429f8e-b9d0-4037-8076-94d51db49288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:44.142644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 834/1662] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:44.159923 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c8d38-651c-46c1-94cb-2994de36f6f2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:44.162115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6f7c8d38-651c-46c1-94cb-2994de36f6f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:44.167002 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec429f8e-b9d0-4037-8076-94d51db49288 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:44.168434 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ec429f8e-b9d0-4037-8076-94d51db49288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:44.328986 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec429f8e-b9d0-4037-8076-94d51db49288 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:44.334720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d49118-6861-4d02-a099-ab07f64fc208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:44.335733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d49118-6861-4d02-a099-ab07f64fc208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:44.336154 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d49118-6861-4d02-a099-ab07f64fc208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:44.336727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d49118-6861-4d02-a099-ab07f64fc208 admin admin] PATH_INFO: `/v3/projects/e32fc17674a34431afb197e317a78262` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:44.341469 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d49118-6861-4d02-a099-ab07f64fc208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e32fc17674a34431afb197e317a78262)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:44.343613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d49118-6861-4d02-a099-ab07f64fc208 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:44.362267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c8d38-651c-46c1-94cb-2994de36f6f2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:44.376832 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af97ad1a-653f-4168-8294-a19a7607b348 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:44.379330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97ad1a-653f-4168-8294-a19a7607b348 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:44.379866 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97ad1a-653f-4168-8294-a19a7607b348 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:44.380351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af97ad1a-653f-4168-8294-a19a7607b348 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:44.394194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97ad1a-653f-4168-8294-a19a7607b348 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:44.398630 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af97ad1a-653f-4168-8294-a19a7607b348 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:44.401791 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:44.448880 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-45d49118-6861-4d02-a099-ab07f64fc208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e32fc17674a34431afb197e317a78262', 'request_id': 'req-45d49118-6861-4d02-a099-ab07f64fc208'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:44.469411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-45d49118-6861-4d02-a099-ab07f64fc208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e32fc17674a34431afb197e317a78262', 'request_id': 'req-45d49118-6861-4d02-a099-ab07f64fc208'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:44.473936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 829/1663] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:44.479581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-45d49118-6861-4d02-a099-ab07f64fc208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e32fc17674a34431afb197e317a78262', 'request_id': 'req-45d49118-6861-4d02-a099-ab07f64fc208'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:44.502072 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-45d49118-6861-4d02-a099-ab07f64fc208 admin admin] The token cache is being invalidate because project e32fc17674a34431afb197e317a78262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:37:44.502519 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-45d49118-6861-4d02-a099-ab07f64fc208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:44.503268 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-45d49118-6861-4d02-a099-ab07f64fc208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:44.516999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 835/1664] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:37:44 2022] DELETE /identity/v3/projects/e32fc17674a34431afb197e317a78262 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:37:44.519633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f26871-0c61-487d-8950-8c57b07fe8aa None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:44.522160 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f26871-0c61-487d-8950-8c57b07fe8aa None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:44.522670 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f26871-0c61-487d-8950-8c57b07fe8aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:44.569936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-87f26871-0c61-487d-8950-8c57b07fe8aa None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:44.574357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-87f26871-0c61-487d-8950-8c57b07fe8aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:44.627084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:44.833942 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326e5a4-7f5a-4518-9ee9-9fb59f599bbf None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:44.834273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326e5a4-7f5a-4518-9ee9-9fb59f599bbf None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:44.834513 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c326e5a4-7f5a-4518-9ee9-9fb59f599bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:44.842810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 830/1665] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:44.882534 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-c326e5a4-7f5a-4518-9ee9-9fb59f599bbf None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:44.886077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c326e5a4-7f5a-4518-9ee9-9fb59f599bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:44.906247 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 836/1666] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:37:44.910737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f26871-0c61-487d-8950-8c57b07fe8aa None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:44.923837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f26871-0c61-487d-8950-8c57b07fe8aa None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:44.935800 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fca2e2-ec67-4a50-b527-f6b826cd8fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:44.936429 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fca2e2-ec67-4a50-b527-f6b826cd8fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:44.936779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fca2e2-ec67-4a50-b527-f6b826cd8fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:44.937013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fca2e2-ec67-4a50-b527-f6b826cd8fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:44.937669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fca2e2-ec67-4a50-b527-f6b826cd8fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:37:44.937968 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fca2e2-ec67-4a50-b527-f6b826cd8fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:44.939571 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fca2e2-ec67-4a50-b527-f6b826cd8fbe admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:44.976191 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 831/1667] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:37:44.977528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326e5a4-7f5a-4518-9ee9-9fb59f599bbf None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:44.994779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c326e5a4-7f5a-4518-9ee9-9fb59f599bbf None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:45.006116 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9737e-74bc-4482-a152-cbb9faf721fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:45.007043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9737e-74bc-4482-a152-cbb9faf721fe admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:45.007525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9737e-74bc-4482-a152-cbb9faf721fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:45.007957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9737e-74bc-4482-a152-cbb9faf721fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:45.009004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9737e-74bc-4482-a152-cbb9faf721fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:45.011158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9737e-74bc-4482-a152-cbb9faf721fe admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:45.074829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 837/1668] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:44 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:45.079029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fca2e2-ec67-4a50-b527-f6b826cd8fbe admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:45.096288 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fca2e2-ec67-4a50-b527-f6b826cd8fbe admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:45.174081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8b45d-c186-4782-b959-60f0e5e7bcc6 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:45.174294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8b45d-c186-4782-b959-60f0e5e7bcc6 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:45.174731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd8b45d-c186-4782-b959-60f0e5e7bcc6 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:45.176235 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 838/1669] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 13 06:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:37:45.214239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced469e-15e4-4cd3-b678-2d3a78891234 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:45.214852 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced469e-15e4-4cd3-b678-2d3a78891234 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:45.215268 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced469e-15e4-4cd3-b678-2d3a78891234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:45.232819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2f039-0e6a-4c64-ab73-f251f5657f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:45.233475 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2f039-0e6a-4c64-ab73-f251f5657f7f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:45.234366 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2f039-0e6a-4c64-ab73-f251f5657f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:45.234693 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f2f039-0e6a-4c64-ab73-f251f5657f7f admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:45.235342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2f039-0e6a-4c64-ab73-f251f5657f7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:45.238549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f2f039-0e6a-4c64-ab73-f251f5657f7f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:45.255539 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0ced469e-15e4-4cd3-b678-2d3a78891234 None None] MFA Rules not processed for user `b84a23931b60457e865f056352a396d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:45.256913 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0ced469e-15e4-4cd3-b678-2d3a78891234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:45.274533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 832/1670] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:45 2022] POST /identity/v3/users => generated 288 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:45.276921 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2f039-0e6a-4c64-ab73-f251f5657f7f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:45.293014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f2f039-0e6a-4c64-ab73-f251f5657f7f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:45.301847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb349286-742c-4c74-a87a-597578177159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:45.302879 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb349286-742c-4c74-a87a-597578177159 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:45.302879 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb349286-742c-4c74-a87a-597578177159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:45.303128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb349286-742c-4c74-a87a-597578177159 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:45.303702 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb349286-742c-4c74-a87a-597578177159 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:45.305641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb349286-742c-4c74-a87a-597578177159 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:45.338340 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 833/1671] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:45.339504 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb349286-742c-4c74-a87a-597578177159 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:45.354563 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb349286-742c-4c74-a87a-597578177159 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:45.360320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deab876-9e9b-435e-aeb0-dda74d795114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:45.361052 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deab876-9e9b-435e-aeb0-dda74d795114 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:45.361255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deab876-9e9b-435e-aeb0-dda74d795114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:45.361529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deab876-9e9b-435e-aeb0-dda74d795114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:45.362178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deab876-9e9b-435e-aeb0-dda74d795114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:45.365604 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0deab876-9e9b-435e-aeb0-dda74d795114 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:45.388296 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 834/1672] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:45.389432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deab876-9e9b-435e-aeb0-dda74d795114 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:45.402200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deab876-9e9b-435e-aeb0-dda74d795114 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:45.409466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96a07b-3825-4194-a0fe-ae343b29d17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:45.410152 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96a07b-3825-4194-a0fe-ae343b29d17d admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:45.410676 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96a07b-3825-4194-a0fe-ae343b29d17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:45.411258 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96a07b-3825-4194-a0fe-ae343b29d17d admin admin] PATH_INFO: `/v3/projects/783ff584357d41b098ba0efe5159ee0c/users/3148ec0b28ec44098f4de4474c7db9c0/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:45.426460 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 839/1673] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 13 06:37:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:37:45.441637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96a07b-3825-4194-a0fe-ae343b29d17d admin admin] RBAC: Authorizing `identity:create_grant(project_id=783ff584357d41b098ba0efe5159ee0c, user_id=3148ec0b28ec44098f4de4474c7db9c0, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:45.444537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96a07b-3825-4194-a0fe-ae343b29d17d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:45.475502 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 835/1674] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:45 2022] PUT /identity/v3/projects/783ff584357d41b098ba0efe5159ee0c/users/3148ec0b28ec44098f4de4474c7db9c0/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:45.477005 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9965f-b10b-48f1-8968-ff1c1a4f2446 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:45.477288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9965f-b10b-48f1-8968-ff1c1a4f2446 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:45.477559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec9965f-b10b-48f1-8968-ff1c1a4f2446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:45.547680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-fec9965f-b10b-48f1-8968-ff1c1a4f2446 None None] MFA Rules not processed for user `3148ec0b28ec44098f4de4474c7db9c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:45.548958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fec9965f-b10b-48f1-8968-ff1c1a4f2446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:45.599256 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96a07b-3825-4194-a0fe-ae343b29d17d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:45.605534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fb96a07b-3825-4194-a0fe-ae343b29d17d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:45.774168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 840/1675] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:45.781895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9965f-b10b-48f1-8968-ff1c1a4f2446 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:45.823256 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:45.841241 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:45.923781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96a07b-3825-4194-a0fe-ae343b29d17d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:45.949275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663495-6f3c-435a-9d8b-3f983fe5360b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84a23931b60457e865f056352a396d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:45.953010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663495-6f3c-435a-9d8b-3f983fe5360b service placement] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:45.954839 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663495-6f3c-435a-9d8b-3f983fe5360b service placement] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:45.955119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d663495-6f3c-435a-9d8b-3f983fe5360b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:45.983947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d663495-6f3c-435a-9d8b-3f983fe5360b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:45.987735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d663495-6f3c-435a-9d8b-3f983fe5360b service placement] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:46.022040 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 836/1676] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:37:46.045502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec9965f-b10b-48f1-8968-ff1c1a4f2446 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:46.057616 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac895bd-a085-41a3-9bd2-371f88854156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:46.058262 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac895bd-a085-41a3-9bd2-371f88854156 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:46.058648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac895bd-a085-41a3-9bd2-371f88854156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:46.059016 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac895bd-a085-41a3-9bd2-371f88854156 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:46.059756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac895bd-a085-41a3-9bd2-371f88854156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:46.064686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac895bd-a085-41a3-9bd2-371f88854156 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:46.133590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 841/1677] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:45 2022] POST /identity/v3/projects => generated 377 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:46.134614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663495-6f3c-435a-9d8b-3f983fe5360b service placement] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:46.158450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d663495-6f3c-435a-9d8b-3f983fe5360b service placement] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:46.271085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0a91-06ba-48ec-9c62-39912daec60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:46.272020 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0a91-06ba-48ec-9c62-39912daec60d admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:46.272375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0a91-06ba-48ec-9c62-39912daec60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:46.272759 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0a91-06ba-48ec-9c62-39912daec60d admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:46.273492 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b0a91-06ba-48ec-9c62-39912daec60d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:46.276629 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b0a91-06ba-48ec-9c62-39912daec60d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:46.338603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 837/1678] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:46 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:46.340217 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac895bd-a085-41a3-9bd2-371f88854156 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:46.358498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac895bd-a085-41a3-9bd2-371f88854156 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:46.367417 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d858090-9a5f-473c-a044-048a76d927f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:46.368446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d858090-9a5f-473c-a044-048a76d927f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:46.368855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d858090-9a5f-473c-a044-048a76d927f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:46.369522 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d858090-9a5f-473c-a044-048a76d927f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:46.370291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d858090-9a5f-473c-a044-048a76d927f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:46.372250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d858090-9a5f-473c-a044-048a76d927f0 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:46.389490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 842/1679] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:46.394178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0a91-06ba-48ec-9c62-39912daec60d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:46.414728 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0a91-06ba-48ec-9c62-39912daec60d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:46.422423 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe1e12-8706-4197-a0b3-6426c3fae46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:46.423884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe1e12-8706-4197-a0b3-6426c3fae46c admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:46.424274 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe1e12-8706-4197-a0b3-6426c3fae46c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:46.424656 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe1e12-8706-4197-a0b3-6426c3fae46c admin admin] PATH_INFO: `/v3/projects/e39b237a9c7b478290566078ab2379c3/users/5300a9cda310489aa3b47ade1af9552b/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:46.483947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe1e12-8706-4197-a0b3-6426c3fae46c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39b237a9c7b478290566078ab2379c3, user_id=5300a9cda310489aa3b47ade1af9552b, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:46.507830 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fe1e12-8706-4197-a0b3-6426c3fae46c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:46.540464 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d858090-9a5f-473c-a044-048a76d927f0 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:46.547169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-7d858090-9a5f-473c-a044-048a76d927f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:46.595227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d858090-9a5f-473c-a044-048a76d927f0 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:46.598726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 838/1680] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:46 2022] PUT /identity/v3/projects/e39b237a9c7b478290566078ab2379c3/users/5300a9cda310489aa3b47ade1af9552b/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:46.602030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe1e12-8706-4197-a0b3-6426c3fae46c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:46.802235 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8361ddc0-6c4d-443f-b5e0-b50fdf4ff407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:46.803085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361ddc0-6c4d-443f-b5e0-b50fdf4ff407 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:46.803288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361ddc0-6c4d-443f-b5e0-b50fdf4ff407 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:46.804007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8361ddc0-6c4d-443f-b5e0-b50fdf4ff407 admin admin] PATH_INFO: `/v3/projects/0b82e69873ca49aba3825ccd4cde01cf` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:46.806859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361ddc0-6c4d-443f-b5e0-b50fdf4ff407 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b82e69873ca49aba3825ccd4cde01cf)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:46.808909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8361ddc0-6c4d-443f-b5e0-b50fdf4ff407 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:46.883614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe1e12-8706-4197-a0b3-6426c3fae46c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:46.897114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da416df-aece-4f1b-a8ad-88f9906dcafa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:46.897751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da416df-aece-4f1b-a8ad-88f9906dcafa admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:46.898034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da416df-aece-4f1b-a8ad-88f9906dcafa admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:46.899600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da416df-aece-4f1b-a8ad-88f9906dcafa admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:46.900309 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da416df-aece-4f1b-a8ad-88f9906dcafa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:46.909158 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da416df-aece-4f1b-a8ad-88f9906dcafa admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:46.946688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 839/1681] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:46.947593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da416df-aece-4f1b-a8ad-88f9906dcafa admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:46.961270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8361ddc0-6c4d-443f-b5e0-b50fdf4ff407 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b82e69873ca49aba3825ccd4cde01cf', 'request_id': 'req-8361ddc0-6c4d-443f-b5e0-b50fdf4ff407'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:46.975445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da416df-aece-4f1b-a8ad-88f9906dcafa admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:47.000766 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8361ddc0-6c4d-443f-b5e0-b50fdf4ff407 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b82e69873ca49aba3825ccd4cde01cf', 'request_id': 'req-8361ddc0-6c4d-443f-b5e0-b50fdf4ff407'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:47.018339 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8361ddc0-6c4d-443f-b5e0-b50fdf4ff407 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b82e69873ca49aba3825ccd4cde01cf', 'request_id': 'req-8361ddc0-6c4d-443f-b5e0-b50fdf4ff407'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:47.067154 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8361ddc0-6c4d-443f-b5e0-b50fdf4ff407 admin admin] The token cache is being invalidate because project 0b82e69873ca49aba3825ccd4cde01cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:37:47.070146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8361ddc0-6c4d-443f-b5e0-b50fdf4ff407 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:47.081587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8361ddc0-6c4d-443f-b5e0-b50fdf4ff407 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:47.087960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 843/1682] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:37:46 2022] DELETE /identity/v3/projects/0b82e69873ca49aba3825ccd4cde01cf => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:37:47.090949 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a973ed-3000-477c-9f97-0ab1b6a5be8f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:47.094029 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a973ed-3000-477c-9f97-0ab1b6a5be8f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:47.094516 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a973ed-3000-477c-9f97-0ab1b6a5be8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:47.109760 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:47.161323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca08003-67be-4937-a275-3e3f6b9a5f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:47.162033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca08003-67be-4937-a275-3e3f6b9a5f35 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:47.162317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca08003-67be-4937-a275-3e3f6b9a5f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:47.162721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca08003-67be-4937-a275-3e3f6b9a5f35 admin admin] PATH_INFO: `/v3/projects/e39b237a9c7b478290566078ab2379c3/users/5300a9cda310489aa3b47ade1af9552b/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:47.168777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca08003-67be-4937-a275-3e3f6b9a5f35 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39b237a9c7b478290566078ab2379c3, user_id=5300a9cda310489aa3b47ade1af9552b, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:47.170830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:47.171471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca08003-67be-4937-a275-3e3f6b9a5f35 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:47.193143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-23a973ed-3000-477c-9f97-0ab1b6a5be8f None None] MFA Rules not processed for user `2be13654c5be47f8919773766ab02148`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:47.197436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-23a973ed-3000-477c-9f97-0ab1b6a5be8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:47.206093 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 840/1683] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:46 2022] PUT /identity/v3/projects/e39b237a9c7b478290566078ab2379c3/users/5300a9cda310489aa3b47ade1af9552b/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:47.207652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658206a7-c9af-4edf-8355-581d14813dfc None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:47.207980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658206a7-c9af-4edf-8355-581d14813dfc None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:47.208203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658206a7-c9af-4edf-8355-581d14813dfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:47.271458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-658206a7-c9af-4edf-8355-581d14813dfc None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:47.272090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-658206a7-c9af-4edf-8355-581d14813dfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:47.352688 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 844/1684] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:47.365796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5906f-d6f2-4f83-a192-402622a0ae21 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:47.365998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5906f-d6f2-4f83-a192-402622a0ae21 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:47.366251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5906f-d6f2-4f83-a192-402622a0ae21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:47.461255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-afd5906f-d6f2-4f83-a192-402622a0ae21 None None] MFA Rules not processed for user `5300a9cda310489aa3b47ade1af9552b`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:47.464977 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-afd5906f-d6f2-4f83-a192-402622a0ae21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:47.475236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 841/1685] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:47.475236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e38a-6847-4b87-a285-56a9ed799f0a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:47.475236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e38a-6847-4b87-a285-56a9ed799f0a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:47.475236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37e38a-6847-4b87-a285-56a9ed799f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:47.551503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-dd37e38a-6847-4b87-a285-56a9ed799f0a None None] MFA Rules not processed for user `2be13654c5be47f8919773766ab02148`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:47.567644 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-dd37e38a-6847-4b87-a285-56a9ed799f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:47.598152 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 842/1686] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:47.599430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b698-421d-4523-af37-b77389c0b051 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:47.599716 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b698-421d-4523-af37-b77389c0b051 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:47.599993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b698-421d-4523-af37-b77389c0b051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:47.706375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-02d3b698-421d-4523-af37-b77389c0b051 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:47.710322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-02d3b698-421d-4523-af37-b77389c0b051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:47.734915 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 843/1687] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:47.736685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b698-421d-4523-af37-b77389c0b051 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:47.756141 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 845/1688] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 403 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:47.757168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5906f-d6f2-4f83-a192-402622a0ae21 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:47.761430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-02d3b698-421d-4523-af37-b77389c0b051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:47.796849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5906f-d6f2-4f83-a192-402622a0ae21 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:47.814770 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0a03b-df98-46a1-9d35-3b94ed37b709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:47.815411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0a03b-df98-46a1-9d35-3b94ed37b709 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:47.824792 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0a03b-df98-46a1-9d35-3b94ed37b709 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:47.825885 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a0a03b-df98-46a1-9d35-3b94ed37b709 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:47.829951 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0a03b-df98-46a1-9d35-3b94ed37b709 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:37:47.830487 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0a03b-df98-46a1-9d35-3b94ed37b709 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:47.838679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a0a03b-df98-46a1-9d35-3b94ed37b709 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:47.869941 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 846/1689] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:37:47.877965 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0a03b-df98-46a1-9d35-3b94ed37b709 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:47.881846 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b7a0a03b-df98-46a1-9d35-3b94ed37b709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:47.975227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b698-421d-4523-af37-b77389c0b051 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:47.986515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0876a-ff07-450a-9221-e6b170010ab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:47.987593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0876a-ff07-450a-9221-e6b170010ab8 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:47.988030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0876a-ff07-450a-9221-e6b170010ab8 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:47.988630 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee0876a-ff07-450a-9221-e6b170010ab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:48.014810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0876a-ff07-450a-9221-e6b170010ab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:48.018681 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee0876a-ff07-450a-9221-e6b170010ab8 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:48.053746 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a0a03b-df98-46a1-9d35-3b94ed37b709 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:48.053889 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 844/1690] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:48.055034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0876a-ff07-450a-9221-e6b170010ab8 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:48.067259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce93f78-78af-4ffc-964c-3e368303785b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:48.067907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce93f78-78af-4ffc-964c-3e368303785b service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:48.068241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce93f78-78af-4ffc-964c-3e368303785b service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:48.068517 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce93f78-78af-4ffc-964c-3e368303785b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:48.072633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2ce93f78-78af-4ffc-964c-3e368303785b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:48.083005 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee0876a-ff07-450a-9221-e6b170010ab8 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:48.097127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7d7a7-dcf4-4f54-ad41-9779a22869c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:48.098475 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7d7a7-dcf4-4f54-ad41-9779a22869c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:48.101003 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7d7a7-dcf4-4f54-ad41-9779a22869c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:48.101497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7d7a7-dcf4-4f54-ad41-9779a22869c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:48.102194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7d7a7-dcf4-4f54-ad41-9779a22869c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:48.104250 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7d7a7-dcf4-4f54-ad41-9779a22869c8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:48.161631 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:48.183452 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 845/1691] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:48 2022] POST /identity/v3/projects => generated 371 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:48.185416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7d7a7-dcf4-4f54-ad41-9779a22869c8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:48.254389 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:48.256837 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce93f78-78af-4ffc-964c-3e368303785b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:48.265414 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce93f78-78af-4ffc-964c-3e368303785b service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:48.315356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 847/1692] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:47 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:48.336480 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7d7a7-dcf4-4f54-ad41-9779a22869c8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:48.349933 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee770f-9611-4828-8300-770235abb7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:48.350654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee770f-9611-4828-8300-770235abb7f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:48.351014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee770f-9611-4828-8300-770235abb7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:48.351366 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee770f-9611-4828-8300-770235abb7f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:48.352090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee770f-9611-4828-8300-770235abb7f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:48.355748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaee770f-9611-4828-8300-770235abb7f9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:48.415103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 846/1693] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:48 2022] POST /identity/v3/users => generated 286 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:48.416742 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce93f78-78af-4ffc-964c-3e368303785b service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:48.438980 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce93f78-78af-4ffc-964c-3e368303785b service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:48.451383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145396a-fa58-491f-bb57-399fee8b4f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:48.454354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145396a-fa58-491f-bb57-399fee8b4f0c admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:48.456713 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145396a-fa58-491f-bb57-399fee8b4f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:48.457039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145396a-fa58-491f-bb57-399fee8b4f0c admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:48.457740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145396a-fa58-491f-bb57-399fee8b4f0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:48.469219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145396a-fa58-491f-bb57-399fee8b4f0c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:48.503807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 848/1694] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:48.507290 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee770f-9611-4828-8300-770235abb7f9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:48.522918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee770f-9611-4828-8300-770235abb7f9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:48.539169 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d9048-088c-4959-a5d8-a60afdf62b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:48.540065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d9048-088c-4959-a5d8-a60afdf62b45 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:48.540448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d9048-088c-4959-a5d8-a60afdf62b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:48.541008 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d9048-088c-4959-a5d8-a60afdf62b45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:48.541757 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d9048-088c-4959-a5d8-a60afdf62b45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:48.545289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d9048-088c-4959-a5d8-a60afdf62b45 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:48.575287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145396a-fa58-491f-bb57-399fee8b4f0c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:48.576762 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 847/1695] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:48 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:48.592960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d9048-088c-4959-a5d8-a60afdf62b45 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:48.594867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-269d9048-088c-4959-a5d8-a60afdf62b45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:48.597704 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145396a-fa58-491f-bb57-399fee8b4f0c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:48.616258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2d8fd-6144-417a-8c5f-410e74023178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:48.617446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2d8fd-6144-417a-8c5f-410e74023178 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:48.619633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2d8fd-6144-417a-8c5f-410e74023178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:48.619798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2d8fd-6144-417a-8c5f-410e74023178 admin admin] PATH_INFO: `/v3/projects/abdef7f74108467897d2209ff7cdd2e1/users/3acac0c978f04d8f80521ef1dff7bec8/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:48.619985 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d9048-088c-4959-a5d8-a60afdf62b45 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:48.635813 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dfec7-799b-45ab-b074-58a87facd2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:48.636774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dfec7-799b-45ab-b074-58a87facd2c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:48.636774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dfec7-799b-45ab-b074-58a87facd2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:48.637050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0dfec7-799b-45ab-b074-58a87facd2c5 admin admin] PATH_INFO: `/v3/users/5a9957c61adb46089de55606b88567d5` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:48.638658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dfec7-799b-45ab-b074-58a87facd2c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a9957c61adb46089de55606b88567d5)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:48.644639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0dfec7-799b-45ab-b074-58a87facd2c5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:48.664631 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2d8fd-6144-417a-8c5f-410e74023178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abdef7f74108467897d2209ff7cdd2e1, user_id=3acac0c978f04d8f80521ef1dff7bec8, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:48.669624 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2d8fd-6144-417a-8c5f-410e74023178 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:48.700293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 849/1696] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:48 2022] PUT /identity/v3/projects/abdef7f74108467897d2209ff7cdd2e1/users/3acac0c978f04d8f80521ef1dff7bec8/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:37:48.713373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ede173-54c1-4015-949c-3dbb0347dd22 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:48.713828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ede173-54c1-4015-949c-3dbb0347dd22 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:48.714200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ede173-54c1-4015-949c-3dbb0347dd22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:48.757458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fd0dfec7-799b-45ab-b074-58a87facd2c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a9957c61adb46089de55606b88567d5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:48.772268 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e9ede173-54c1-4015-949c-3dbb0347dd22 None None] MFA Rules not processed for user `3acac0c978f04d8f80521ef1dff7bec8`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:48.776046 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e9ede173-54c1-4015-949c-3dbb0347dd22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:48.786139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fd0dfec7-799b-45ab-b074-58a87facd2c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a9957c61adb46089de55606b88567d5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:48.821860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fd0dfec7-799b-45ab-b074-58a87facd2c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a9957c61adb46089de55606b88567d5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:48.843579 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fd0dfec7-799b-45ab-b074-58a87facd2c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a9957c61adb46089de55606b88567d5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:48.844396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fd0dfec7-799b-45ab-b074-58a87facd2c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a9957c61adb46089de55606b88567d5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:48.863294 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 848/1697] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:37:48 2022] DELETE /identity/v3/users/5a9957c61adb46089de55606b88567d5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:37:48.933745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 850/1698] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:37:48.933840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dfec7-799b-45ab-b074-58a87facd2c5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:48.935355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fd0dfec7-799b-45ab-b074-58a87facd2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:48.941185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc196ceb-f693-432d-9932-b5586d044ef5 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:48.941455 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc196ceb-f693-432d-9932-b5586d044ef5 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:48.941725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc196ceb-f693-432d-9932-b5586d044ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:48.991639 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-dc196ceb-f693-432d-9932-b5586d044ef5 None None] MFA Rules not processed for user `cfdd9d86fbce4b0881a94ab730500ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:48.993607 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-dc196ceb-f693-432d-9932-b5586d044ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:49.124337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 851/1699] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:49.170782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0dfec7-799b-45ab-b074-58a87facd2c5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:49.208042 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28c6ee-0154-406c-841b-a50fd0d5a6db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:49.208836 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28c6ee-0154-406c-841b-a50fd0d5a6db service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:49.209122 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28c6ee-0154-406c-841b-a50fd0d5a6db service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:49.209401 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c28c6ee-0154-406c-841b-a50fd0d5a6db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:49.238737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:49.350471 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942faf6b-e1b2-4368-8efb-11b855ef60f1 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:49.351656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942faf6b-e1b2-4368-8efb-11b855ef60f1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:49.352238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942faf6b-e1b2-4368-8efb-11b855ef60f1 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:49.363058 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 852/1700] 10.222.0.42 () {54 vars in 912 bytes} [Tue Sep 13 06:37:49 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:37:49.369766 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b85c9-ef30-4d33-a3dc-aceea51646d9 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:49.370390 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b85c9-ef30-4d33-a3dc-aceea51646d9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:49.370863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265b85c9-ef30-4d33-a3dc-aceea51646d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:49.376805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28c6ee-0154-406c-841b-a50fd0d5a6db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:49.380507 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c28c6ee-0154-406c-841b-a50fd0d5a6db service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:49.421246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 849/1701] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:48 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:49.476267 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:49.541749 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-265b85c9-ef30-4d33-a3dc-aceea51646d9 None None] MFA Rules not processed for user `a5efc921a219444bb0b45e8b4d08dcc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:49.546580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-265b85c9-ef30-4d33-a3dc-aceea51646d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:49.685889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 853/1702] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 13 06:37:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:49.729488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28c6ee-0154-406c-841b-a50fd0d5a6db service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:49.732794 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3c28c6ee-0154-406c-841b-a50fd0d5a6db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:49.778104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c28c6ee-0154-406c-841b-a50fd0d5a6db service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:49.799026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b77c64-1b1a-48e6-a15b-effafe7b23e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:49.801831 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b77c64-1b1a-48e6-a15b-effafe7b23e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:49.802273 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b77c64-1b1a-48e6-a15b-effafe7b23e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:49.803643 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b77c64-1b1a-48e6-a15b-effafe7b23e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:49.825039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b77c64-1b1a-48e6-a15b-effafe7b23e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:49.830200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b77c64-1b1a-48e6-a15b-effafe7b23e8 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:49.852887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 850/1703] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:49.890592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b85c9-ef30-4d33-a3dc-aceea51646d9 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:49.892481 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-265b85c9-ef30-4d33-a3dc-aceea51646d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:50.150680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265b85c9-ef30-4d33-a3dc-aceea51646d9 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:50.177493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468c687-2fca-48fc-b39f-b7919a545041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:50.178311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468c687-2fca-48fc-b39f-b7919a545041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:50.179688 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468c687-2fca-48fc-b39f-b7919a545041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:50.180597 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3468c687-2fca-48fc-b39f-b7919a545041 admin admin] PATH_INFO: `/v3/projects/adc66b6a3ea2461f9c20091666d1ac70` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:50.182655 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468c687-2fca-48fc-b39f-b7919a545041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc66b6a3ea2461f9c20091666d1ac70)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:50.186480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3468c687-2fca-48fc-b39f-b7919a545041 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:50.232788 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b77c64-1b1a-48e6-a15b-effafe7b23e8 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:50.269135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b77c64-1b1a-48e6-a15b-effafe7b23e8 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:50.292838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cbf6f-a839-4e70-99b8-32d6ca291842 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:50.295750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cbf6f-a839-4e70-99b8-32d6ca291842 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:50.297955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cbf6f-a839-4e70-99b8-32d6ca291842 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:50.298238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408cbf6f-a839-4e70-99b8-32d6ca291842 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:50.323359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cbf6f-a839-4e70-99b8-32d6ca291842 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:50.332201 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408cbf6f-a839-4e70-99b8-32d6ca291842 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:50.361146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-3468c687-2fca-48fc-b39f-b7919a545041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc66b6a3ea2461f9c20091666d1ac70', 'request_id': 'req-3468c687-2fca-48fc-b39f-b7919a545041'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:50.373579 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 851/1704] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:50.383231 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-3468c687-2fca-48fc-b39f-b7919a545041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc66b6a3ea2461f9c20091666d1ac70', 'request_id': 'req-3468c687-2fca-48fc-b39f-b7919a545041'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:50.397484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-3468c687-2fca-48fc-b39f-b7919a545041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc66b6a3ea2461f9c20091666d1ac70', 'request_id': 'req-3468c687-2fca-48fc-b39f-b7919a545041'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:50.447108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-3468c687-2fca-48fc-b39f-b7919a545041 admin admin] The token cache is being invalidate because project adc66b6a3ea2461f9c20091666d1ac70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:37:50.447471 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-3468c687-2fca-48fc-b39f-b7919a545041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:50.455943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-3468c687-2fca-48fc-b39f-b7919a545041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:50.458378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 854/1705] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:37:49 2022] DELETE /identity/v3/projects/adc66b6a3ea2461f9c20091666d1ac70 => generated 0 bytes in 569 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:50.462512 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cbf6f-a839-4e70-99b8-32d6ca291842 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:50.481077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408cbf6f-a839-4e70-99b8-32d6ca291842 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:50.663896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18ccc17-e8b9-49cf-9629-8a4bc9861aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:50.665774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ccc17-e8b9-49cf-9629-8a4bc9861aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:50.666625 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ccc17-e8b9-49cf-9629-8a4bc9861aed admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:50.667441 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18ccc17-e8b9-49cf-9629-8a4bc9861aed admin admin] PATH_INFO: `/v3/users/1324983a5ffa403db3196599ac5522ae` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:50.671064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ccc17-e8b9-49cf-9629-8a4bc9861aed admin admin] RBAC: Authorizing `identity:delete_user(user_id=1324983a5ffa403db3196599ac5522ae)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:50.680835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18ccc17-e8b9-49cf-9629-8a4bc9861aed admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:50.806768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b18ccc17-e8b9-49cf-9629-8a4bc9861aed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1324983a5ffa403db3196599ac5522ae'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:50.818196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b18ccc17-e8b9-49cf-9629-8a4bc9861aed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1324983a5ffa403db3196599ac5522ae'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:50.834742 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b18ccc17-e8b9-49cf-9629-8a4bc9861aed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1324983a5ffa403db3196599ac5522ae'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:50.847104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b18ccc17-e8b9-49cf-9629-8a4bc9861aed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1324983a5ffa403db3196599ac5522ae'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:50.848981 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b18ccc17-e8b9-49cf-9629-8a4bc9861aed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1324983a5ffa403db3196599ac5522ae'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:50.866458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 852/1706] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:37:50 2022] DELETE /identity/v3/users/1324983a5ffa403db3196599ac5522ae => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:51.471404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468c687-2fca-48fc-b39f-b7919a545041 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:51.473346 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3468c687-2fca-48fc-b39f-b7919a545041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:51.498500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3468c687-2fca-48fc-b39f-b7919a545041 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:51.748827 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:51.765677 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e2959-1f7c-43bb-9929-212f3be60e17 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:51.766125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e2959-1f7c-43bb-9929-212f3be60e17 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:51.766688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6e2959-1f7c-43bb-9929-212f3be60e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:51.839857 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:51.889255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bf6e2959-1f7c-43bb-9929-212f3be60e17 None None] MFA Rules not processed for user `a05d9cf1223b44589ab5586ec50a5b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:51.890139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:51.892886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bf6e2959-1f7c-43bb-9929-212f3be60e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:51.893444 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:51.895130 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:51.895562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46 admin admin] PATH_INFO: `/v3/projects/e20dd77de9254f4e8e3a1e8af2fddbff` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:51.898751 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20dd77de9254f4e8e3a1e8af2fddbff)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:51.905921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:52.021502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20dd77de9254f4e8e3a1e8af2fddbff', 'request_id': 'req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:52.041735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20dd77de9254f4e8e3a1e8af2fddbff', 'request_id': 'req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:52.050502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20dd77de9254f4e8e3a1e8af2fddbff', 'request_id': 'req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:52.070130 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46 admin admin] The token cache is being invalidate because project e20dd77de9254f4e8e3a1e8af2fddbff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:37:52.070612 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:52.072713 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:52.084293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 855/1707] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:37:51 2022] DELETE /identity/v3/projects/e20dd77de9254f4e8e3a1e8af2fddbff => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:52.088308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:52.093587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:52.112414 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 853/1708] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:37:52.129595 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a91351-dbc3-435c-82a3-4e8e42903b39 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:52.130093 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a91351-dbc3-435c-82a3-4e8e42903b39 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:52.130441 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a91351-dbc3-435c-82a3-4e8e42903b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:52.190787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-14a91351-dbc3-435c-82a3-4e8e42903b39 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:52.192186 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-14a91351-dbc3-435c-82a3-4e8e42903b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:52.321799 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24df1eb-9c87-4d90-a84b-6a0f5e769e46 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:52.337320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ff685f-eacb-4094-a776-c882d6e951a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84a23931b60457e865f056352a396d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:52.338456 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff685f-eacb-4094-a776-c882d6e951a1 service placement] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:52.339123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff685f-eacb-4094-a776-c882d6e951a1 service placement] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:52.339645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ff685f-eacb-4094-a776-c882d6e951a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:52.356523 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-60ff685f-eacb-4094-a776-c882d6e951a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:52.379105 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 854/1709] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:52.381522 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a91351-dbc3-435c-82a3-4e8e42903b39 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:52.385540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-14a91351-dbc3-435c-82a3-4e8e42903b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:52.396335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff685f-eacb-4094-a776-c882d6e951a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:52.401919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ff685f-eacb-4094-a776-c882d6e951a1 service placement] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:52.439943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 856/1710] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:52.443807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835b3e0-f234-4669-a9bf-00590ccd4448 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:52.444259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835b3e0-f234-4669-a9bf-00590ccd4448 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:52.445388 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835b3e0-f234-4669-a9bf-00590ccd4448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:52.497000 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-5835b3e0-f234-4669-a9bf-00590ccd4448 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:52.499276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5835b3e0-f234-4669-a9bf-00590ccd4448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:52.519272 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 857/1711] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:52.525791 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835b3e0-f234-4669-a9bf-00590ccd4448 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:52.541456 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835b3e0-f234-4669-a9bf-00590ccd4448 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:52.559066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0f078-21c8-409d-bc45-2cc09bd2a233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:52.560499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f078-21c8-409d-bc45-2cc09bd2a233 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:52.561526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f078-21c8-409d-bc45-2cc09bd2a233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:52.562191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b0f078-21c8-409d-bc45-2cc09bd2a233 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:52.567282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0f078-21c8-409d-bc45-2cc09bd2a233 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:37:52.568305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0f078-21c8-409d-bc45-2cc09bd2a233 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:52.571834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b0f078-21c8-409d-bc45-2cc09bd2a233 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:52.614094 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 858/1712] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:37:52.615788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0f078-21c8-409d-bc45-2cc09bd2a233 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:52.650556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b0f078-21c8-409d-bc45-2cc09bd2a233 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:52.657266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26554ce3-1245-46e4-83f1-5a7e2e151e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:52.657989 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26554ce3-1245-46e4-83f1-5a7e2e151e89 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:52.658273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26554ce3-1245-46e4-83f1-5a7e2e151e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:52.659204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26554ce3-1245-46e4-83f1-5a7e2e151e89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:52.659914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26554ce3-1245-46e4-83f1-5a7e2e151e89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:52.662466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26554ce3-1245-46e4-83f1-5a7e2e151e89 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:52.663500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a91351-dbc3-435c-82a3-4e8e42903b39 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:52.682683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad5092-66ee-4e5e-8f87-5b47e1d02ff1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:52.686499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad5092-66ee-4e5e-8f87-5b47e1d02ff1 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:52.686791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad5092-66ee-4e5e-8f87-5b47e1d02ff1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:52.687069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ad5092-66ee-4e5e-8f87-5b47e1d02ff1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:52.695785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f1ad5092-66ee-4e5e-8f87-5b47e1d02ff1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:52.737681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 859/1713] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:52 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:52.739875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26554ce3-1245-46e4-83f1-5a7e2e151e89 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:52.780214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:52.925734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26554ce3-1245-46e4-83f1-5a7e2e151e89 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:52.940878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad5092-66ee-4e5e-8f87-5b47e1d02ff1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:52.942085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea613c97-a198-4367-947b-e970d199aa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:52.942344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ad5092-66ee-4e5e-8f87-5b47e1d02ff1 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:52.945402 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea613c97-a198-4367-947b-e970d199aa75 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:52.948187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea613c97-a198-4367-947b-e970d199aa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:52.948707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea613c97-a198-4367-947b-e970d199aa75 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:52.949556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea613c97-a198-4367-947b-e970d199aa75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:52.961589 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea613c97-a198-4367-947b-e970d199aa75 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:52.973760 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 855/1714] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:53.051837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad5092-66ee-4e5e-8f87-5b47e1d02ff1 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:53.052455 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 860/1715] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:52 2022] POST /identity/v3/users => generated 287 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:53.057475 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:53.069422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ad5092-66ee-4e5e-8f87-5b47e1d02ff1 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:53.086023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b711e-3622-4e2a-aea7-e8bdc86cbae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:53.086667 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b711e-3622-4e2a-aea7-e8bdc86cbae2 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:53.087103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b711e-3622-4e2a-aea7-e8bdc86cbae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:53.087385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9b711e-3622-4e2a-aea7-e8bdc86cbae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:53.088047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b711e-3622-4e2a-aea7-e8bdc86cbae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:53.089717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9b711e-3622-4e2a-aea7-e8bdc86cbae2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:53.115362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 856/1716] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:37:53.116642 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea613c97-a198-4367-947b-e970d199aa75 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:53.135411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea613c97-a198-4367-947b-e970d199aa75 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:53.160346 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00ac812-e37d-468e-a27d-8d39c22ed109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:53.164218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ac812-e37d-468e-a27d-8d39c22ed109 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:53.165574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ac812-e37d-468e-a27d-8d39c22ed109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:53.167077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00ac812-e37d-468e-a27d-8d39c22ed109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:53.171744 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ac812-e37d-468e-a27d-8d39c22ed109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:53.182685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00ac812-e37d-468e-a27d-8d39c22ed109 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:53.249848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b711e-3622-4e2a-aea7-e8bdc86cbae2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:53.250213 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 861/1717] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:53.274352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9b711e-3622-4e2a-aea7-e8bdc86cbae2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:53.294547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0408f-f531-49bf-8d8a-6e4d8a81ba01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:53.295793 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0408f-f531-49bf-8d8a-6e4d8a81ba01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:53.296441 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0408f-f531-49bf-8d8a-6e4d8a81ba01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:53.296757 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0408f-f531-49bf-8d8a-6e4d8a81ba01 admin admin] PATH_INFO: `/v3/projects/9bb88d9b658d4ee8ada3257cc9752f46/users/448739ff08754300b7d3b8f3c94118ae/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:53.346722 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0408f-f531-49bf-8d8a-6e4d8a81ba01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bb88d9b658d4ee8ada3257cc9752f46, user_id=448739ff08754300b7d3b8f3c94118ae, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:53.355191 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0408f-f531-49bf-8d8a-6e4d8a81ba01 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:53.392269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 857/1718] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:53 2022] PUT /identity/v3/projects/9bb88d9b658d4ee8ada3257cc9752f46/users/448739ff08754300b7d3b8f3c94118ae/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:53.405464 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f476d8b-bd02-46b5-b046-a2be183ba3b0 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:53.405745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f476d8b-bd02-46b5-b046-a2be183ba3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:53.406216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f476d8b-bd02-46b5-b046-a2be183ba3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:53.457260 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6f476d8b-bd02-46b5-b046-a2be183ba3b0 None None] MFA Rules not processed for user `448739ff08754300b7d3b8f3c94118ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:53.464814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6f476d8b-bd02-46b5-b046-a2be183ba3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:53.689613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 862/1719] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:53.694119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0408f-f531-49bf-8d8a-6e4d8a81ba01 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:53.983779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0408f-f531-49bf-8d8a-6e4d8a81ba01 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:54.010264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c12c0d-505f-4999-8891-894b49c3150c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:54.010919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c12c0d-505f-4999-8891-894b49c3150c admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:54.012051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c12c0d-505f-4999-8891-894b49c3150c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:54.012051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c12c0d-505f-4999-8891-894b49c3150c admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:54.012214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c12c0d-505f-4999-8891-894b49c3150c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:54.014632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c12c0d-505f-4999-8891-894b49c3150c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:54.037590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f476d8b-bd02-46b5-b046-a2be183ba3b0 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:54.039242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6f476d8b-bd02-46b5-b046-a2be183ba3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:54.087735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f476d8b-bd02-46b5-b046-a2be183ba3b0 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:54.103991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e47717-bc4a-449d-b1e1-128ac97385c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:54.105426 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e47717-bc4a-449d-b1e1-128ac97385c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:54.109401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e47717-bc4a-449d-b1e1-128ac97385c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:54.109762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e47717-bc4a-449d-b1e1-128ac97385c9 admin admin] PATH_INFO: `/v3/users/3acac0c978f04d8f80521ef1dff7bec8` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:54.110850 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 858/1720] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:53 2022] POST /identity/v3/projects => generated 373 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:54.111873 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c12c0d-505f-4999-8891-894b49c3150c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:54.114659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e47717-bc4a-449d-b1e1-128ac97385c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3acac0c978f04d8f80521ef1dff7bec8)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:54.124240 dv-cinder-856385-1-smb devstack@keystone.service[81461]: WARNING py.warnings [None req-e8e47717-bc4a-449d-b1e1-128ac97385c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 06:37:54.124240 dv-cinder-856385-1-smb devstack@keystone.service[81461]: warnings.warn(msg) Sep 13 06:37:54.124240 dv-cinder-856385-1-smb devstack@keystone.service[81461]: Sep 13 06:37:54.131519 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e47717-bc4a-449d-b1e1-128ac97385c9 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:54.281814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c12c0d-505f-4999-8891-894b49c3150c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:54.293546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d457c6-a671-4f93-984c-d37e8141e506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:54.295087 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d457c6-a671-4f93-984c-d37e8141e506 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:54.296440 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d457c6-a671-4f93-984c-d37e8141e506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:54.296746 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d457c6-a671-4f93-984c-d37e8141e506 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:54.298381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d457c6-a671-4f93-984c-d37e8141e506 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:54.305051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d457c6-a671-4f93-984c-d37e8141e506 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:54.355919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 859/1721] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:54 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:54.357609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e9518-d0a6-4ca8-93fb-39e7b2d58041 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:54.358006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e9518-d0a6-4ca8-93fb-39e7b2d58041 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:54.358377 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613e9518-d0a6-4ca8-93fb-39e7b2d58041 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:54.362635 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 860/1722] 10.222.0.42 () {54 vars in 912 bytes} [Tue Sep 13 06:37:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:37:54.366031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e9518-d0a6-4ca8-93fb-39e7b2d58041 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:54.416698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613e9518-d0a6-4ca8-93fb-39e7b2d58041 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:54.422646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08e106-a394-4a90-adad-42bc85f56297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:54.423656 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08e106-a394-4a90-adad-42bc85f56297 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:54.423990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08e106-a394-4a90-adad-42bc85f56297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:54.424315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08e106-a394-4a90-adad-42bc85f56297 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:54.425061 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08e106-a394-4a90-adad-42bc85f56297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:54.426942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08e106-a394-4a90-adad-42bc85f56297 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:54.438080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e8e47717-bc4a-449d-b1e1-128ac97385c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3acac0c978f04d8f80521ef1dff7bec8'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:54.483378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 861/1723] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:54.485564 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7189e-981d-4212-83ad-0d8dcfcfc504 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:54.487234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7189e-981d-4212-83ad-0d8dcfcfc504 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:54.487579 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc7189e-981d-4212-83ad-0d8dcfcfc504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:54.493596 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e8e47717-bc4a-449d-b1e1-128ac97385c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3acac0c978f04d8f80521ef1dff7bec8'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:54.537825 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7cc7189e-981d-4212-83ad-0d8dcfcfc504 None None] MFA Rules not processed for user `a5efc921a219444bb0b45e8b4d08dcc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:54.539210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7cc7189e-981d-4212-83ad-0d8dcfcfc504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:54.573479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e8e47717-bc4a-449d-b1e1-128ac97385c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3acac0c978f04d8f80521ef1dff7bec8'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:54.578153 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e8e47717-bc4a-449d-b1e1-128ac97385c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3acac0c978f04d8f80521ef1dff7bec8'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:54.590804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:54.596070 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:54.604314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e8e47717-bc4a-449d-b1e1-128ac97385c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3acac0c978f04d8f80521ef1dff7bec8'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:54.621072 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 863/1724] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:37:54 2022] DELETE /identity/v3/users/3acac0c978f04d8f80521ef1dff7bec8 => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:54.622331 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e47717-bc4a-449d-b1e1-128ac97385c9 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:54.624952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e8e47717-bc4a-449d-b1e1-128ac97385c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:54.702248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 862/1725] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 13 06:37:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:54.703503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2b41a-a8f6-4196-acd7-3795bcb74ec5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:54.703790 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2b41a-a8f6-4196-acd7-3795bcb74ec5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:54.704072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd2b41a-a8f6-4196-acd7-3795bcb74ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:54.777760 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-abd2b41a-a8f6-4196-acd7-3795bcb74ec5 None None] MFA Rules not processed for user `4bad46590fab4c94a789626e42aca76d`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:54.779210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-abd2b41a-a8f6-4196-acd7-3795bcb74ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:54.817989 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e47717-bc4a-449d-b1e1-128ac97385c9 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:54.839320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d99179-b19a-43ea-976c-7f0bd77ea93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:54.841500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d99179-b19a-43ea-976c-7f0bd77ea93f admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:54.841820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d99179-b19a-43ea-976c-7f0bd77ea93f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:54.845997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d99179-b19a-43ea-976c-7f0bd77ea93f admin admin] PATH_INFO: `/v3/projects/5de5893ff0d44972b0fd0ca55a34f972/users/baa903643c124af2816270bb5915c3f5/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:54.884652 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d99179-b19a-43ea-976c-7f0bd77ea93f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de5893ff0d44972b0fd0ca55a34f972, user_id=baa903643c124af2816270bb5915c3f5, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:54.894495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d99179-b19a-43ea-976c-7f0bd77ea93f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:54.925950 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 864/1726] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:54 2022] PUT /identity/v3/projects/5de5893ff0d44972b0fd0ca55a34f972/users/baa903643c124af2816270bb5915c3f5/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:54.932974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038c20c-9068-4bb8-b47b-4a8c534b3347 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:54.933255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038c20c-9068-4bb8-b47b-4a8c534b3347 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:54.933515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038c20c-9068-4bb8-b47b-4a8c534b3347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:54.962588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 863/1727] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:54 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:54.962588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2b41a-a8f6-4196-acd7-3795bcb74ec5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:54.963832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2038c20c-9068-4bb8-b47b-4a8c534b3347 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:54.964487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-abd2b41a-a8f6-4196-acd7-3795bcb74ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:54.966211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2038c20c-9068-4bb8-b47b-4a8c534b3347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:55.158215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 865/1728] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:55.159416 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038c20c-9068-4bb8-b47b-4a8c534b3347 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:55.192318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038c20c-9068-4bb8-b47b-4a8c534b3347 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:55.208213 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04625493-4e43-484d-9cd9-8cc7708b8e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:55.208870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625493-4e43-484d-9cd9-8cc7708b8e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:55.209156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625493-4e43-484d-9cd9-8cc7708b8e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:55.209437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04625493-4e43-484d-9cd9-8cc7708b8e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:55.213459 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd2b41a-a8f6-4196-acd7-3795bcb74ec5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:55.214259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04625493-4e43-484d-9cd9-8cc7708b8e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:55.220915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04625493-4e43-484d-9cd9-8cc7708b8e23 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:55.255300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 866/1729] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:55.256637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc9015-5daa-40b8-a0bc-f484cc480b5b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:55.276512 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc9015-5daa-40b8-a0bc-f484cc480b5b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:55.276829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc9015-5daa-40b8-a0bc-f484cc480b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:55.344846 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-41dc9015-5daa-40b8-a0bc-f484cc480b5b None None] MFA Rules not processed for user `4bad46590fab4c94a789626e42aca76d`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:55.346007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-41dc9015-5daa-40b8-a0bc-f484cc480b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:55.480172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d25395-de29-4f34-bd1c-053414b48575 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:55.484607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d25395-de29-4f34-bd1c-053414b48575 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:55.485197 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d25395-de29-4f34-bd1c-053414b48575 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:55.485476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d25395-de29-4f34-bd1c-053414b48575 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:55.508001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 867/1730] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:55.508001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc9015-5daa-40b8-a0bc-f484cc480b5b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:55.513657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-41dc9015-5daa-40b8-a0bc-f484cc480b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:55.526106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d25395-de29-4f34-bd1c-053414b48575 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:55.527572 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d25395-de29-4f34-bd1c-053414b48575 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:55.549595 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc9015-5daa-40b8-a0bc-f484cc480b5b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:55.552278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 864/1731] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:55.554156 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d25395-de29-4f34-bd1c-053414b48575 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:55.560637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b1f0c-3cb9-4d2c-8ad2-d904c9b5e907 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:55.562998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b1f0c-3cb9-4d2c-8ad2-d904c9b5e907 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:55.563358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b1f0c-3cb9-4d2c-8ad2-d904c9b5e907 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:55.563645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027b1f0c-3cb9-4d2c-8ad2-d904c9b5e907 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:55.583530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d25395-de29-4f34-bd1c-053414b48575 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:55.595614 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b1f0c-3cb9-4d2c-8ad2-d904c9b5e907 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:55.597129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027b1f0c-3cb9-4d2c-8ad2-d904c9b5e907 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:55.598278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dbbd5d-e93f-4360-968c-c7a0f537f3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:55.599039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbbd5d-e93f-4360-968c-c7a0f537f3e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:55.599321 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbbd5d-e93f-4360-968c-c7a0f537f3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:55.599642 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dbbd5d-e93f-4360-968c-c7a0f537f3e6 admin admin] PATH_INFO: `/v3/projects/5de5893ff0d44972b0fd0ca55a34f972/users/baa903643c124af2816270bb5915c3f5/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:55.612201 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbbd5d-e93f-4360-968c-c7a0f537f3e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5de5893ff0d44972b0fd0ca55a34f972, user_id=baa903643c124af2816270bb5915c3f5, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:55.616888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:55.624100 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dbbd5d-e93f-4360-968c-c7a0f537f3e6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:55.631509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 868/1732] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:55.633615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b1f0c-3cb9-4d2c-8ad2-d904c9b5e907 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:55.639305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-027b1f0c-3cb9-4d2c-8ad2-d904c9b5e907 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:55.668924 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 865/1733] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:55 2022] PUT /identity/v3/projects/5de5893ff0d44972b0fd0ca55a34f972/users/baa903643c124af2816270bb5915c3f5/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:55.694735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856dd11-26c2-4c9c-8b9b-e431e4bdc55f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:55.695041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856dd11-26c2-4c9c-8b9b-e431e4bdc55f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:55.695296 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4856dd11-26c2-4c9c-8b9b-e431e4bdc55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:55.822769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4856dd11-26c2-4c9c-8b9b-e431e4bdc55f None None] MFA Rules not processed for user `baa903643c124af2816270bb5915c3f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:55.824938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4856dd11-26c2-4c9c-8b9b-e431e4bdc55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:55.834765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:55.878304 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027b1f0c-3cb9-4d2c-8ad2-d904c9b5e907 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:55.998769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 866/1734] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:56.017059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856dd11-26c2-4c9c-8b9b-e431e4bdc55f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:56.021595 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4856dd11-26c2-4c9c-8b9b-e431e4bdc55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:56.069279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011189a-3396-4e52-97ee-fad53f01e9db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:56.072079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011189a-3396-4e52-97ee-fad53f01e9db service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:56.072422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011189a-3396-4e52-97ee-fad53f01e9db service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:56.072896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011189a-3396-4e52-97ee-fad53f01e9db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:56.196547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4856dd11-26c2-4c9c-8b9b-e431e4bdc55f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:56.201821 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c3206-c609-47b0-a803-894446820dca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:56.202661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c3206-c609-47b0-a803-894446820dca service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:56.203949 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c3206-c609-47b0-a803-894446820dca service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:56.204383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c3206-c609-47b0-a803-894446820dca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:56.217301 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c3206-c609-47b0-a803-894446820dca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:56.219828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c3206-c609-47b0-a803-894446820dca service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:56.232762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011189a-3396-4e52-97ee-fad53f01e9db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:56.236872 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011189a-3396-4e52-97ee-fad53f01e9db service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:56.240070 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 867/1735] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:37:56.261375 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 869/1736] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:55 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:56.367323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c3206-c609-47b0-a803-894446820dca service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:56.369686 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-855c3206-c609-47b0-a803-894446820dca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:56.537558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f6745-f55c-4f6f-9d77-6a6482d2c11d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:56.537963 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f6745-f55c-4f6f-9d77-6a6482d2c11d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:56.538717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f6745-f55c-4f6f-9d77-6a6482d2c11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:56.569943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d21f6745-f55c-4f6f-9d77-6a6482d2c11d None None] MFA Rules not processed for user `cfdd9d86fbce4b0881a94ab730500ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:56.571441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d21f6745-f55c-4f6f-9d77-6a6482d2c11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:56.587831 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c3206-c609-47b0-a803-894446820dca service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:56.618002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09dbaab-b864-4756-af6c-b8d6320b9e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:56.618731 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dbaab-b864-4756-af6c-b8d6320b9e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:56.619017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dbaab-b864-4756-af6c-b8d6320b9e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:56.619557 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09dbaab-b864-4756-af6c-b8d6320b9e54 admin admin] PATH_INFO: `/v3/projects/abdef7f74108467897d2209ff7cdd2e1` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:56.628703 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dbaab-b864-4756-af6c-b8d6320b9e54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abdef7f74108467897d2209ff7cdd2e1)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:56.634992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09dbaab-b864-4756-af6c-b8d6320b9e54 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:56.637283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:56.759199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 870/1737] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:56.763065 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16ed60-ca0e-40eb-a915-b3a1f2277653 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:56.764533 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16ed60-ca0e-40eb-a915-b3a1f2277653 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:56.766031 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16ed60-ca0e-40eb-a915-b3a1f2277653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:56.783149 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:56.791597 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a09dbaab-b864-4756-af6c-b8d6320b9e54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abdef7f74108467897d2209ff7cdd2e1', 'request_id': 'req-a09dbaab-b864-4756-af6c-b8d6320b9e54'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:56.817817 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a09dbaab-b864-4756-af6c-b8d6320b9e54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abdef7f74108467897d2209ff7cdd2e1', 'request_id': 'req-a09dbaab-b864-4756-af6c-b8d6320b9e54'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:56.838135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a09dbaab-b864-4756-af6c-b8d6320b9e54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abdef7f74108467897d2209ff7cdd2e1', 'request_id': 'req-a09dbaab-b864-4756-af6c-b8d6320b9e54'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:56.886946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a09dbaab-b864-4756-af6c-b8d6320b9e54 admin admin] The token cache is being invalidate because project abdef7f74108467897d2209ff7cdd2e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:37:56.887458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a09dbaab-b864-4756-af6c-b8d6320b9e54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:56.889737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a09dbaab-b864-4756-af6c-b8d6320b9e54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:56.894022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 868/1738] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:37:56 2022] DELETE /identity/v3/projects/abdef7f74108467897d2209ff7cdd2e1 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:56.900558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286dd18-cf94-4758-ae50-ce3d2ce05f22 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:56.904461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286dd18-cf94-4758-ae50-ce3d2ce05f22 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:56.906698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e286dd18-cf94-4758-ae50-ce3d2ce05f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:56.982182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e286dd18-cf94-4758-ae50-ce3d2ce05f22 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:56.984920 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6a16ed60-ca0e-40eb-a915-b3a1f2277653 None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:56.986136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6a16ed60-ca0e-40eb-a915-b3a1f2277653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:56.990899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e286dd18-cf94-4758-ae50-ce3d2ce05f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:57.161321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 871/1739] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 13 06:37:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:57.232450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 869/1740] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:57.234547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46f444-49e6-4507-884f-937666af467b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:57.234997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46f444-49e6-4507-884f-937666af467b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:57.235496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e46f444-49e6-4507-884f-937666af467b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:57.265264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-4e46f444-49e6-4507-884f-937666af467b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:57.266447 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4e46f444-49e6-4507-884f-937666af467b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:57.297029 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 872/1741] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:57.300713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286dd18-cf94-4758-ae50-ce3d2ce05f22 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:57.318308 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e286dd18-cf94-4758-ae50-ce3d2ce05f22 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:57.330944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87488-1ba3-4465-ae0f-2642ab064987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:57.331717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87488-1ba3-4465-ae0f-2642ab064987 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:57.332096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87488-1ba3-4465-ae0f-2642ab064987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:57.334257 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e87488-1ba3-4465-ae0f-2642ab064987 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:57.337662 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87488-1ba3-4465-ae0f-2642ab064987 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:37:57.338115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87488-1ba3-4465-ae0f-2642ab064987 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:57.341944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e87488-1ba3-4465-ae0f-2642ab064987 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:57.377317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 870/1742] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:37:57.381849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46f444-49e6-4507-884f-937666af467b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:57.394230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e46f444-49e6-4507-884f-937666af467b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:57.412024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc09a4b-6853-4aba-baff-b5d86c8942ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:57.413208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc09a4b-6853-4aba-baff-b5d86c8942ac admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:57.414685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc09a4b-6853-4aba-baff-b5d86c8942ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:57.414917 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc09a4b-6853-4aba-baff-b5d86c8942ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:57.424340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc09a4b-6853-4aba-baff-b5d86c8942ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:57.433375 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc09a4b-6853-4aba-baff-b5d86c8942ac admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:57.533349 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 873/1743] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:57 2022] POST /identity/v3/projects => generated 367 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:57.534393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87488-1ba3-4465-ae0f-2642ab064987 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:57.536645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc09a4b-6853-4aba-baff-b5d86c8942ac admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:57.536810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e4e87488-1ba3-4465-ae0f-2642ab064987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:57.657012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc09a4b-6853-4aba-baff-b5d86c8942ac admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:57.677385 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c02d10-2900-43de-8b4e-9cf9509e1203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:57.678026 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c02d10-2900-43de-8b4e-9cf9509e1203 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:57.678305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c02d10-2900-43de-8b4e-9cf9509e1203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:57.678636 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c02d10-2900-43de-8b4e-9cf9509e1203 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:57.679241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c02d10-2900-43de-8b4e-9cf9509e1203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:57.689274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c02d10-2900-43de-8b4e-9cf9509e1203 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:57.767319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e87488-1ba3-4465-ae0f-2642ab064987 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:57.781849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 874/1744] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:37:57 2022] POST /identity/v3/users => generated 284 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:37:57.782889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c02d10-2900-43de-8b4e-9cf9509e1203 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:57.788266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-90c02d10-2900-43de-8b4e-9cf9509e1203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:57.812594 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c02d10-2900-43de-8b4e-9cf9509e1203 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:57.841562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af94158-8832-4070-b405-ef9eacfffa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:57.842482 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af94158-8832-4070-b405-ef9eacfffa3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:57.842915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af94158-8832-4070-b405-ef9eacfffa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:57.843347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af94158-8832-4070-b405-ef9eacfffa3f admin admin] PATH_INFO: `/v3/users/448739ff08754300b7d3b8f3c94118ae` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:57.844789 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af94158-8832-4070-b405-ef9eacfffa3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=448739ff08754300b7d3b8f3c94118ae)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:57.854557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af94158-8832-4070-b405-ef9eacfffa3f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:57.872943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:57.962883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1af94158-8832-4070-b405-ef9eacfffa3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '448739ff08754300b7d3b8f3c94118ae'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:57.972975 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:57.981936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1af94158-8832-4070-b405-ef9eacfffa3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '448739ff08754300b7d3b8f3c94118ae'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:58.015515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1af94158-8832-4070-b405-ef9eacfffa3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '448739ff08754300b7d3b8f3c94118ae'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:58.017067 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1af94158-8832-4070-b405-ef9eacfffa3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '448739ff08754300b7d3b8f3c94118ae'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:58.024894 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef401a-2d3e-426a-835b-ec0acf06044b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:58.027623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef401a-2d3e-426a-835b-ec0acf06044b service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:58.028133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef401a-2d3e-426a-835b-ec0acf06044b service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:58.029254 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef401a-2d3e-426a-835b-ec0acf06044b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:58.033783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1af94158-8832-4070-b405-ef9eacfffa3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '448739ff08754300b7d3b8f3c94118ae'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:37:58.047176 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 875/1745] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:37:57 2022] DELETE /identity/v3/users/448739ff08754300b7d3b8f3c94118ae => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:58.049047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af94158-8832-4070-b405-ef9eacfffa3f admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:58.059714 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1af94158-8832-4070-b405-ef9eacfffa3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:58.244512 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af94158-8832-4070-b405-ef9eacfffa3f admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:58.258530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef401a-2d3e-426a-835b-ec0acf06044b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:58.259130 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd3512-d9a4-4a57-9fde-d60345e5789e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:58.260769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd3512-d9a4-4a57-9fde-d60345e5789e admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:58.261056 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd3512-d9a4-4a57-9fde-d60345e5789e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:58.262146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd3512-d9a4-4a57-9fde-d60345e5789e admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:58.262748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef401a-2d3e-426a-835b-ec0acf06044b service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:58.263627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd3512-d9a4-4a57-9fde-d60345e5789e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:58.267903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd3512-d9a4-4a57-9fde-d60345e5789e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:58.288397 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 871/1746] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:37:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 06:37:58.293682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 876/1747] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:37:58.296220 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a547fe-27bc-4d7b-ab64-97328c537083 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:58.297138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a547fe-27bc-4d7b-ab64-97328c537083 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:58.297529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a547fe-27bc-4d7b-ab64-97328c537083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:58.298218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd3512-d9a4-4a57-9fde-d60345e5789e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:58.321547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd3512-d9a4-4a57-9fde-d60345e5789e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:58.345898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-51a547fe-27bc-4d7b-ab64-97328c537083 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:58.345898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-51a547fe-27bc-4d7b-ab64-97328c537083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:58.365397 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 872/1748] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:58.368087 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef35f2-f495-470d-8624-959ac49d32db None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:58.368488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef35f2-f495-470d-8624-959ac49d32db None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:58.369746 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ef35f2-f495-470d-8624-959ac49d32db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:58.372321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910632d-3fa9-43df-bb14-60ef1f308210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:58.374069 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910632d-3fa9-43df-bb14-60ef1f308210 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:58.374291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910632d-3fa9-43df-bb14-60ef1f308210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:58.374572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910632d-3fa9-43df-bb14-60ef1f308210 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:58.379136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910632d-3fa9-43df-bb14-60ef1f308210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:58.387268 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910632d-3fa9-43df-bb14-60ef1f308210 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:58.433797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 877/1749] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:37:58.434935 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910632d-3fa9-43df-bb14-60ef1f308210 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:58.439514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9910632d-3fa9-43df-bb14-60ef1f308210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:58.449442 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-31ef35f2-f495-470d-8624-959ac49d32db None None] MFA Rules not processed for user `4bad46590fab4c94a789626e42aca76d`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:58.453769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-31ef35f2-f495-470d-8624-959ac49d32db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:58.662000 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910632d-3fa9-43df-bb14-60ef1f308210 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:58.667154 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3db9e-2f9d-4e6c-bf35-b35740ba82aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:58.667998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3db9e-2f9d-4e6c-bf35-b35740ba82aa service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:58.668274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3db9e-2f9d-4e6c-bf35-b35740ba82aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:58.668548 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3db9e-2f9d-4e6c-bf35-b35740ba82aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:58.682103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3db9e-2f9d-4e6c-bf35-b35740ba82aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:58.685166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd3db9e-2f9d-4e6c-bf35-b35740ba82aa service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:58.692471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 873/1750] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:58.693490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef35f2-f495-470d-8624-959ac49d32db None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:58.710705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 878/1751] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:37:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:37:58.751014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ef35f2-f495-470d-8624-959ac49d32db None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:58.804452 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea52ff6-d94d-49e7-ada3-d165bba1721b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:58.805184 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea52ff6-d94d-49e7-ada3-d165bba1721b admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:58.805472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea52ff6-d94d-49e7-ada3-d165bba1721b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:58.805746 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea52ff6-d94d-49e7-ada3-d165bba1721b admin admin] PATH_INFO: `/v3/projects/665605b93086438a8fcd62b1c8440074/users/bca8e77a60b5464585a2d025b5605573/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:58.915991 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea52ff6-d94d-49e7-ada3-d165bba1721b admin admin] RBAC: Authorizing `identity:create_grant(project_id=665605b93086438a8fcd62b1c8440074, user_id=bca8e77a60b5464585a2d025b5605573, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:58.932946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea52ff6-d94d-49e7-ada3-d165bba1721b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:37:58.995495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 874/1752] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:37:58 2022] PUT /identity/v3/projects/665605b93086438a8fcd62b1c8440074/users/bca8e77a60b5464585a2d025b5605573/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:37:59.006721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18085bdb-14f3-48b8-a1c5-fd4bfca4a8d4 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:59.007113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18085bdb-14f3-48b8-a1c5-fd4bfca4a8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:59.007391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18085bdb-14f3-48b8-a1c5-fd4bfca4a8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:59.156002 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:37:59.183332 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-18085bdb-14f3-48b8-a1c5-fd4bfca4a8d4 None None] MFA Rules not processed for user `bca8e77a60b5464585a2d025b5605573`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:37:59.200345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-18085bdb-14f3-48b8-a1c5-fd4bfca4a8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:37:59.662676 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea52ff6-d94d-49e7-ada3-d165bba1721b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:37:59.663309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 879/1753] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:37:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 657 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:37:59.944956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea52ff6-d94d-49e7-ada3-d165bba1721b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:37:59.967543 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfe819-5189-4b8d-8b95-bd326507e5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:37:59.971006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfe819-5189-4b8d-8b95-bd326507e5bb admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:37:59.973650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfe819-5189-4b8d-8b95-bd326507e5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:37:59.974681 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdfe819-5189-4b8d-8b95-bd326507e5bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:37:59.978701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfe819-5189-4b8d-8b95-bd326507e5bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:37:59.998807 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdfe819-5189-4b8d-8b95-bd326507e5bb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:00.036481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:00.185258 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 875/1754] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:37:59 2022] POST /identity/v3/projects => generated 369 bytes in 522 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:38:00.189215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18085bdb-14f3-48b8-a1c5-fd4bfca4a8d4 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:00.227474 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18085bdb-14f3-48b8-a1c5-fd4bfca4a8d4 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:00.432497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05456516-5779-4ac7-aa0b-2747ed2ceca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:00.433449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05456516-5779-4ac7-aa0b-2747ed2ceca0 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:00.436414 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05456516-5779-4ac7-aa0b-2747ed2ceca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:00.436850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05456516-5779-4ac7-aa0b-2747ed2ceca0 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:00.442288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05456516-5779-4ac7-aa0b-2747ed2ceca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:00.448520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05456516-5779-4ac7-aa0b-2747ed2ceca0 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:00.588933 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 880/1755] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:00 2022] POST /identity/v3/users => generated 291 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:00.593949 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfe819-5189-4b8d-8b95-bd326507e5bb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:00.616304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdfe819-5189-4b8d-8b95-bd326507e5bb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:00.636464 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ca2769-23e2-4173-980d-816e8380dc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:00.637992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca2769-23e2-4173-980d-816e8380dc4c admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:00.639436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca2769-23e2-4173-980d-816e8380dc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:00.639871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ca2769-23e2-4173-980d-816e8380dc4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:00.641561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca2769-23e2-4173-980d-816e8380dc4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:00.644277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ca2769-23e2-4173-980d-816e8380dc4c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:00.704363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 876/1756] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:00.708814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05456516-5779-4ac7-aa0b-2747ed2ceca0 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:00.743117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05456516-5779-4ac7-aa0b-2747ed2ceca0 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:00.758366 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dc574-bb31-47cc-bb5b-7cc83b4ee6a4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:00.758882 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dc574-bb31-47cc-bb5b-7cc83b4ee6a4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:00.759719 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dc574-bb31-47cc-bb5b-7cc83b4ee6a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:00.763847 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b532025-a979-4d6c-8aa8-dd9e4f71d146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:00.765017 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b532025-a979-4d6c-8aa8-dd9e4f71d146 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:00.765575 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b532025-a979-4d6c-8aa8-dd9e4f71d146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:00.766064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b532025-a979-4d6c-8aa8-dd9e4f71d146 admin admin] PATH_INFO: `/v3/projects/8728e3d883cf40c89404463dbca2a267/users/c64026ff25914e30824bd2cf94d1fb8d/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:00.812934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b532025-a979-4d6c-8aa8-dd9e4f71d146 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8728e3d883cf40c89404463dbca2a267, user_id=c64026ff25914e30824bd2cf94d1fb8d, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:00.829034 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b532025-a979-4d6c-8aa8-dd9e4f71d146 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:00.839420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c30dc574-bb31-47cc-bb5b-7cc83b4ee6a4 None None] MFA Rules not processed for user `a5efc921a219444bb0b45e8b4d08dcc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:00.846966 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c30dc574-bb31-47cc-bb5b-7cc83b4ee6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:00.879956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 881/1757] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:00 2022] PUT /identity/v3/projects/8728e3d883cf40c89404463dbca2a267/users/c64026ff25914e30824bd2cf94d1fb8d/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:00.884428 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b532025-a979-4d6c-8aa8-dd9e4f71d146 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:01.086417 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 877/1758] 10.222.0.44 () {58 vars in 1015 bytes} [Tue Sep 13 06:38:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:01.140619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dc574-bb31-47cc-bb5b-7cc83b4ee6a4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:01.153687 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c30dc574-bb31-47cc-bb5b-7cc83b4ee6a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:01.187936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dc574-bb31-47cc-bb5b-7cc83b4ee6a4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:01.246681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b532025-a979-4d6c-8aa8-dd9e4f71d146 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:01.308737 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c0693-09a6-4bf4-bf7b-b2f8f79ee6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:01.313326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c0693-09a6-4bf4-bf7b-b2f8f79ee6c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:01.321576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c0693-09a6-4bf4-bf7b-b2f8f79ee6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:01.322360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c0693-09a6-4bf4-bf7b-b2f8f79ee6c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:01.328437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c0693-09a6-4bf4-bf7b-b2f8f79ee6c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:01.339909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c0693-09a6-4bf4-bf7b-b2f8f79ee6c4 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:01.392564 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00dc235-adb9-4eaa-9264-0aab36718a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:01.393995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dc235-adb9-4eaa-9264-0aab36718a14 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:01.394285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dc235-adb9-4eaa-9264-0aab36718a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:01.394565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00dc235-adb9-4eaa-9264-0aab36718a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:01.412914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00dc235-adb9-4eaa-9264-0aab36718a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:01.415177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00dc235-adb9-4eaa-9264-0aab36718a14 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:01.418331 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 882/1759] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 535 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:01.426649 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c0693-09a6-4bf4-bf7b-b2f8f79ee6c4 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:01.441084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 878/1760] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:01.459024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:01.470374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c0693-09a6-4bf4-bf7b-b2f8f79ee6c4 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:01.488574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea2ac8-1c3c-49cb-b7e4-8028a48b03ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:01.493325 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea2ac8-1c3c-49cb-b7e4-8028a48b03ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:01.493616 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea2ac8-1c3c-49cb-b7e4-8028a48b03ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:01.493914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea2ac8-1c3c-49cb-b7e4-8028a48b03ce admin admin] PATH_INFO: `/v3/projects/8728e3d883cf40c89404463dbca2a267/users/c64026ff25914e30824bd2cf94d1fb8d/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:01.507186 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea2ac8-1c3c-49cb-b7e4-8028a48b03ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8728e3d883cf40c89404463dbca2a267, user_id=c64026ff25914e30824bd2cf94d1fb8d, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:01.516256 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea2ac8-1c3c-49cb-b7e4-8028a48b03ce admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:01.562609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 883/1761] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:01 2022] PUT /identity/v3/projects/8728e3d883cf40c89404463dbca2a267/users/c64026ff25914e30824bd2cf94d1fb8d/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:01.584770 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdab2b9-b2ee-4ff3-b478-abe5226320fb None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:01.585015 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdab2b9-b2ee-4ff3-b478-abe5226320fb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:01.585849 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdab2b9-b2ee-4ff3-b478-abe5226320fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:01.607953 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea2ac8-1c3c-49cb-b7e4-8028a48b03ce admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:01.610008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-43ea2ac8-1c3c-49cb-b7e4-8028a48b03ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:01.701718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cfdab2b9-b2ee-4ff3-b478-abe5226320fb None None] MFA Rules not processed for user `c64026ff25914e30824bd2cf94d1fb8d`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:01.703003 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cfdab2b9-b2ee-4ff3-b478-abe5226320fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:01.947724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea2ac8-1c3c-49cb-b7e4-8028a48b03ce admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:01.970478 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40426688-622a-49df-92b0-9713503595f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:01.974145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40426688-622a-49df-92b0-9713503595f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:01.975713 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40426688-622a-49df-92b0-9713503595f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:01.977929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40426688-622a-49df-92b0-9713503595f2 admin admin] PATH_INFO: `/v3/projects/9bb88d9b658d4ee8ada3257cc9752f46` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:01.980651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40426688-622a-49df-92b0-9713503595f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bb88d9b658d4ee8ada3257cc9752f46)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:01.989556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40426688-622a-49df-92b0-9713503595f2 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:02.016571 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 879/1762] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:01 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 443 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:02.029247 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdab2b9-b2ee-4ff3-b478-abe5226320fb None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:02.031803 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cfdab2b9-b2ee-4ff3-b478-abe5226320fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:02.065516 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:02.256969 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdab2b9-b2ee-4ff3-b478-abe5226320fb None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:02.307374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-40426688-622a-49df-92b0-9713503595f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bb88d9b658d4ee8ada3257cc9752f46', 'request_id': 'req-40426688-622a-49df-92b0-9713503595f2'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:02.321251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-40426688-622a-49df-92b0-9713503595f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bb88d9b658d4ee8ada3257cc9752f46', 'request_id': 'req-40426688-622a-49df-92b0-9713503595f2'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:02.356582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-40426688-622a-49df-92b0-9713503595f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bb88d9b658d4ee8ada3257cc9752f46', 'request_id': 'req-40426688-622a-49df-92b0-9713503595f2'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:02.393082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53facbd5-6795-41da-922f-6d6b5bb0d158 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:02.393850 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53facbd5-6795-41da-922f-6d6b5bb0d158 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:02.394351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53facbd5-6795-41da-922f-6d6b5bb0d158 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:02.394640 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53facbd5-6795-41da-922f-6d6b5bb0d158 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:02.449707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-40426688-622a-49df-92b0-9713503595f2 admin admin] The token cache is being invalidate because project 9bb88d9b658d4ee8ada3257cc9752f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:02.450781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-40426688-622a-49df-92b0-9713503595f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:02.453952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-40426688-622a-49df-92b0-9713503595f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:02.459722 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 884/1763] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:01 2022] DELETE /identity/v3/projects/9bb88d9b658d4ee8ada3257cc9752f46 => generated 0 bytes in 849 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:02.461464 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40426688-622a-49df-92b0-9713503595f2 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:02.463544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-40426688-622a-49df-92b0-9713503595f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:02.588878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53facbd5-6795-41da-922f-6d6b5bb0d158 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:02.594556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53facbd5-6795-41da-922f-6d6b5bb0d158 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:02.637062 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 880/1764] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 608 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:02.802663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40426688-622a-49df-92b0-9713503595f2 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:02.855445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d6c7e-45ea-4297-881a-e4667f8a2257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:02.856058 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6c7e-45ea-4297-881a-e4667f8a2257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:02.856379 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6c7e-45ea-4297-881a-e4667f8a2257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:02.856646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d6c7e-45ea-4297-881a-e4667f8a2257 admin admin] PATH_INFO: `/v3/users/baa903643c124af2816270bb5915c3f5` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:02.858301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d6c7e-45ea-4297-881a-e4667f8a2257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=baa903643c124af2816270bb5915c3f5)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:02.859743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53facbd5-6795-41da-922f-6d6b5bb0d158 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:02.861000 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498d6c7e-45ea-4297-881a-e4667f8a2257 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:02.862499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-53facbd5-6795-41da-922f-6d6b5bb0d158 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:02.889197 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53facbd5-6795-41da-922f-6d6b5bb0d158 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:02.902898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b127c00-4189-4107-9185-4abfb00faf1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:02.906553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b127c00-4189-4107-9185-4abfb00faf1d service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:02.908142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b127c00-4189-4107-9185-4abfb00faf1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:02.910316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b127c00-4189-4107-9185-4abfb00faf1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:02.916191 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6b127c00-4189-4107-9185-4abfb00faf1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:02.960778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:03.073399 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b127c00-4189-4107-9185-4abfb00faf1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:03.076390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b127c00-4189-4107-9185-4abfb00faf1d service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:03.083692 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-498d6c7e-45ea-4297-881a-e4667f8a2257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'baa903643c124af2816270bb5915c3f5'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:03.091641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 881/1765] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:03.129410 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-498d6c7e-45ea-4297-881a-e4667f8a2257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'baa903643c124af2816270bb5915c3f5'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:03.167548 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-498d6c7e-45ea-4297-881a-e4667f8a2257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'baa903643c124af2816270bb5915c3f5'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:03.168304 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-498d6c7e-45ea-4297-881a-e4667f8a2257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'baa903643c124af2816270bb5915c3f5'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:03.192299 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-498d6c7e-45ea-4297-881a-e4667f8a2257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'baa903643c124af2816270bb5915c3f5'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:03.202846 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 885/1766] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:02 2022] DELETE /identity/v3/users/baa903643c124af2816270bb5915c3f5 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:06.405380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b127c00-4189-4107-9185-4abfb00faf1d service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:06.411132 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b127c00-4189-4107-9185-4abfb00faf1d service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:06.459296 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:06.640547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b20341-3729-4899-b121-bcd46e57783e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:06.641441 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b20341-3729-4899-b121-bcd46e57783e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:06.641882 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b20341-3729-4899-b121-bcd46e57783e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:06.642315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b20341-3729-4899-b121-bcd46e57783e admin admin] PATH_INFO: `/v3/projects/5de5893ff0d44972b0fd0ca55a34f972` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:06.643655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b20341-3729-4899-b121-bcd46e57783e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5de5893ff0d44972b0fd0ca55a34f972)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:06.645896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b20341-3729-4899-b121-bcd46e57783e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:06.737225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07b20341-3729-4899-b121-bcd46e57783e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5de5893ff0d44972b0fd0ca55a34f972', 'request_id': 'req-07b20341-3729-4899-b121-bcd46e57783e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:06.745047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07b20341-3729-4899-b121-bcd46e57783e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5de5893ff0d44972b0fd0ca55a34f972', 'request_id': 'req-07b20341-3729-4899-b121-bcd46e57783e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:06.758834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07b20341-3729-4899-b121-bcd46e57783e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5de5893ff0d44972b0fd0ca55a34f972', 'request_id': 'req-07b20341-3729-4899-b121-bcd46e57783e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:06.786354 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07b20341-3729-4899-b121-bcd46e57783e admin admin] The token cache is being invalidate because project 5de5893ff0d44972b0fd0ca55a34f972 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:06.786728 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07b20341-3729-4899-b121-bcd46e57783e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:06.787450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07b20341-3729-4899-b121-bcd46e57783e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:06.792328 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 882/1767] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:06 2022] DELETE /identity/v3/projects/5de5893ff0d44972b0fd0ca55a34f972 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:06.797632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432d60f-4a48-486a-bfef-ab13530919b3 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:06.798521 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432d60f-4a48-486a-bfef-ab13530919b3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:06.799156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8432d60f-4a48-486a-bfef-ab13530919b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:06.861177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8432d60f-4a48-486a-bfef-ab13530919b3 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:06.866843 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8432d60f-4a48-486a-bfef-ab13530919b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:07.159901 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 886/1768] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:07.165831 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb757bd-6b81-4b40-8ec9-b18cdaaffd0c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:07.166141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb757bd-6b81-4b40-8ec9-b18cdaaffd0c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:07.166410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb757bd-6b81-4b40-8ec9-b18cdaaffd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:07.230030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8bb757bd-6b81-4b40-8ec9-b18cdaaffd0c None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:07.231392 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8bb757bd-6b81-4b40-8ec9-b18cdaaffd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:07.271648 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 883/1769] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:07.275195 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432d60f-4a48-486a-bfef-ab13530919b3 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:07.335500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8432d60f-4a48-486a-bfef-ab13530919b3 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:07.355989 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4049e-3eb5-469c-a851-26eb755899be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:07.358014 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4049e-3eb5-469c-a851-26eb755899be admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:07.358258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4049e-3eb5-469c-a851-26eb755899be admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:07.359758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4049e-3eb5-469c-a851-26eb755899be admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:07.364960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4049e-3eb5-469c-a851-26eb755899be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:07.365342 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4049e-3eb5-469c-a851-26eb755899be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:07.368228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4049e-3eb5-469c-a851-26eb755899be admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:07.438829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 887/1770] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:38:07.443748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb757bd-6b81-4b40-8ec9-b18cdaaffd0c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:07.463518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb757bd-6b81-4b40-8ec9-b18cdaaffd0c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:07.483875 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb567a2-e9d2-4917-956c-52276d45c362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:07.484956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb567a2-e9d2-4917-956c-52276d45c362 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:07.485320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb567a2-e9d2-4917-956c-52276d45c362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:07.485604 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb567a2-e9d2-4917-956c-52276d45c362 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:07.487301 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb567a2-e9d2-4917-956c-52276d45c362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:07.492684 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb567a2-e9d2-4917-956c-52276d45c362 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:07.593519 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 884/1771] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:07 2022] POST /identity/v3/projects => generated 389 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:07.597416 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4049e-3eb5-469c-a851-26eb755899be admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:07.616780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4049e-3eb5-469c-a851-26eb755899be admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:07.882271 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e7850-060c-4e5c-a75b-1085737c5812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:07.883470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e7850-060c-4e5c-a75b-1085737c5812 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:07.883763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e7850-060c-4e5c-a75b-1085737c5812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:07.884357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e7850-060c-4e5c-a75b-1085737c5812 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:07.885983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e7850-060c-4e5c-a75b-1085737c5812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:07.889170 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e7850-060c-4e5c-a75b-1085737c5812 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:08.035833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 888/1772] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:07 2022] POST /identity/v3/users => generated 295 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:08.036271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb567a2-e9d2-4917-956c-52276d45c362 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:08.054433 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb567a2-e9d2-4917-956c-52276d45c362 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:08.082063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d682ae-10eb-40e3-a463-51ad01f0debc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:08.082757 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d682ae-10eb-40e3-a463-51ad01f0debc admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:08.083035 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d682ae-10eb-40e3-a463-51ad01f0debc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:08.083311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d682ae-10eb-40e3-a463-51ad01f0debc admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:08.083986 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d682ae-10eb-40e3-a463-51ad01f0debc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:08.091488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d682ae-10eb-40e3-a463-51ad01f0debc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:08.126609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 885/1773] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:08.126822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e7850-060c-4e5c-a75b-1085737c5812 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:08.137056 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e7850-060c-4e5c-a75b-1085737c5812 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:08.158228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e090d-7339-4870-84d8-bf58384dfa22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:08.159374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e090d-7339-4870-84d8-bf58384dfa22 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:08.161071 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e090d-7339-4870-84d8-bf58384dfa22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:08.161856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e090d-7339-4870-84d8-bf58384dfa22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:08.164791 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e090d-7339-4870-84d8-bf58384dfa22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:08.175038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e090d-7339-4870-84d8-bf58384dfa22 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:08.229570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 889/1774] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:08.235577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d682ae-10eb-40e3-a463-51ad01f0debc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:08.257451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d682ae-10eb-40e3-a463-51ad01f0debc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:08.286951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffa2cc-4eb3-4b21-b392-0fbaae303c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:08.287630 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffa2cc-4eb3-4b21-b392-0fbaae303c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:08.288138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffa2cc-4eb3-4b21-b392-0fbaae303c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:08.288420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ffa2cc-4eb3-4b21-b392-0fbaae303c76 admin admin] PATH_INFO: `/v3/projects/1b713dbe0a1e4ff6937fc714a938bb71/users/3fbbb49448c24c51a08442eefb7c228e/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:08.328278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffa2cc-4eb3-4b21-b392-0fbaae303c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b713dbe0a1e4ff6937fc714a938bb71, user_id=3fbbb49448c24c51a08442eefb7c228e, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:08.332569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ffa2cc-4eb3-4b21-b392-0fbaae303c76 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:08.364820 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 886/1775] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:08 2022] PUT /identity/v3/projects/1b713dbe0a1e4ff6937fc714a938bb71/users/3fbbb49448c24c51a08442eefb7c228e/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:08.376108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b62759-fb70-4efc-a013-f55249b8a8e3 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:08.376925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b62759-fb70-4efc-a013-f55249b8a8e3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:08.377509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b62759-fb70-4efc-a013-f55249b8a8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:08.444723 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:08.467046 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-96b62759-fb70-4efc-a013-f55249b8a8e3 None None] MFA Rules not processed for user `3fbbb49448c24c51a08442eefb7c228e`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:08.469398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-96b62759-fb70-4efc-a013-f55249b8a8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:08.657660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 890/1776] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:08 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:08.662192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffa2cc-4eb3-4b21-b392-0fbaae303c76 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:08.788230 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:08.846976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ffa2cc-4eb3-4b21-b392-0fbaae303c76 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:08.858591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32764f-dd2a-42a1-9b24-204e991e8ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:08.867453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32764f-dd2a-42a1-9b24-204e991e8ddc admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:08.868018 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32764f-dd2a-42a1-9b24-204e991e8ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:08.868449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32764f-dd2a-42a1-9b24-204e991e8ddc admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:08.869717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32764f-dd2a-42a1-9b24-204e991e8ddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:08.872173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32764f-dd2a-42a1-9b24-204e991e8ddc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:08.993494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 887/1777] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:08 2022] POST /identity/v3/projects => generated 389 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:08.998322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b62759-fb70-4efc-a013-f55249b8a8e3 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:09.012100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b62759-fb70-4efc-a013-f55249b8a8e3 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:09.127307 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbe5b0-4c38-4266-a726-e6d61ae76831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:09.130953 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbe5b0-4c38-4266-a726-e6d61ae76831 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:09.131701 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbe5b0-4c38-4266-a726-e6d61ae76831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:09.132419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dbe5b0-4c38-4266-a726-e6d61ae76831 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:09.136604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbe5b0-4c38-4266-a726-e6d61ae76831 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:09.149115 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dbe5b0-4c38-4266-a726-e6d61ae76831 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:09.191717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 891/1778] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:08 2022] POST /identity/v3/users => generated 301 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:09.195714 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32764f-dd2a-42a1-9b24-204e991e8ddc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:09.213087 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32764f-dd2a-42a1-9b24-204e991e8ddc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:09.231249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63459e-ca31-49aa-a304-b57bce18da2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:09.250445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63459e-ca31-49aa-a304-b57bce18da2a admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:09.251618 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63459e-ca31-49aa-a304-b57bce18da2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:09.253212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee63459e-ca31-49aa-a304-b57bce18da2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:09.257424 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63459e-ca31-49aa-a304-b57bce18da2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:09.259147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee63459e-ca31-49aa-a304-b57bce18da2a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:09.300542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 888/1779] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:09.302030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbe5b0-4c38-4266-a726-e6d61ae76831 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:09.320396 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dbe5b0-4c38-4266-a726-e6d61ae76831 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:09.333090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333d708-6874-40a4-9c15-e8235fa3ecb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:09.333756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333d708-6874-40a4-9c15-e8235fa3ecb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:09.334040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333d708-6874-40a4-9c15-e8235fa3ecb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:09.334313 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333d708-6874-40a4-9c15-e8235fa3ecb9 admin admin] PATH_INFO: `/v3/projects/ededa3660fa144a3b19de6d6814abd14/users/d6a65ca692c047ddb1cd564023b88ab9/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:09.405925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333d708-6874-40a4-9c15-e8235fa3ecb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ededa3660fa144a3b19de6d6814abd14, user_id=d6a65ca692c047ddb1cd564023b88ab9, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:09.425032 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333d708-6874-40a4-9c15-e8235fa3ecb9 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:09.460711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 892/1780] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:09 2022] PUT /identity/v3/projects/ededa3660fa144a3b19de6d6814abd14/users/d6a65ca692c047ddb1cd564023b88ab9/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:09.464439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63459e-ca31-49aa-a304-b57bce18da2a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:09.490603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee63459e-ca31-49aa-a304-b57bce18da2a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:09.651500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df12ad8d-959a-4593-82b9-4886f63d6daa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:09.652204 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12ad8d-959a-4593-82b9-4886f63d6daa admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:09.652491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12ad8d-959a-4593-82b9-4886f63d6daa admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:09.653558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df12ad8d-959a-4593-82b9-4886f63d6daa admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:09.654298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12ad8d-959a-4593-82b9-4886f63d6daa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:09.656124 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df12ad8d-959a-4593-82b9-4886f63d6daa admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:09.685129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333d708-6874-40a4-9c15-e8235fa3ecb9 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:09.690824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 889/1781] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:09.700654 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333d708-6874-40a4-9c15-e8235fa3ecb9 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:09.717488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fb50b-fea5-4b4d-ab25-506661312713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:09.718255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fb50b-fea5-4b4d-ab25-506661312713 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:09.719225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fb50b-fea5-4b4d-ab25-506661312713 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:09.719715 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fb50b-fea5-4b4d-ab25-506661312713 admin admin] PATH_INFO: `/v3/projects/ededa3660fa144a3b19de6d6814abd14/users/d6a65ca692c047ddb1cd564023b88ab9/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:09.723121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fb50b-fea5-4b4d-ab25-506661312713 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ededa3660fa144a3b19de6d6814abd14, user_id=d6a65ca692c047ddb1cd564023b88ab9, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:09.725971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fb50b-fea5-4b4d-ab25-506661312713 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:09.751494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2aba15-1f6a-48d2-8fce-001994a765a7 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:09.752909 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2aba15-1f6a-48d2-8fce-001994a765a7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:09.753344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2aba15-1f6a-48d2-8fce-001994a765a7 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:09.755111 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 890/1782] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 13 06:38:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:38:09.780751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0146621-f266-4362-a57b-4fc32da9df04 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:09.781150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0146621-f266-4362-a57b-4fc32da9df04 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:09.781531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0146621-f266-4362-a57b-4fc32da9df04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:09.782386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 893/1783] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:09 2022] PUT /identity/v3/projects/ededa3660fa144a3b19de6d6814abd14/users/d6a65ca692c047ddb1cd564023b88ab9/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:09.843564 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c0146621-f266-4362-a57b-4fc32da9df04 None None] MFA Rules not processed for user `d6a65ca692c047ddb1cd564023b88ab9`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:09.848323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314bde9-1d3f-4849-8fef-90cf05febf90 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:09.848790 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314bde9-1d3f-4849-8fef-90cf05febf90 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:09.849181 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b314bde9-1d3f-4849-8fef-90cf05febf90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:09.850949 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c0146621-f266-4362-a57b-4fc32da9df04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:09.903064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b314bde9-1d3f-4849-8fef-90cf05febf90 None None] MFA Rules not processed for user `7fbb67072ba544e39073787eb25fcf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:09.905378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b314bde9-1d3f-4849-8fef-90cf05febf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:10.064017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 891/1784] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:09 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:10.065248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0146621-f266-4362-a57b-4fc32da9df04 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:10.067321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:10.068716 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c0146621-f266-4362-a57b-4fc32da9df04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:10.143738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 894/1785] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 13 06:38:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:38:10.147229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314bde9-1d3f-4849-8fef-90cf05febf90 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:10.153430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b314bde9-1d3f-4849-8fef-90cf05febf90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:10.164274 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:10.224646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0146621-f266-4362-a57b-4fc32da9df04 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:10.245570 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20ca45-d568-4c57-a0dd-c4a72a4ae632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:10.246017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20ca45-d568-4c57-a0dd-c4a72a4ae632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:10.246233 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20ca45-d568-4c57-a0dd-c4a72a4ae632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:10.246617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20ca45-d568-4c57-a0dd-c4a72a4ae632 admin admin] PATH_INFO: `/v3/users/bca8e77a60b5464585a2d025b5605573` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:10.249574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20ca45-d568-4c57-a0dd-c4a72a4ae632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bca8e77a60b5464585a2d025b5605573)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:10.254677 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c20ca45-d568-4c57-a0dd-c4a72a4ae632 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:10.339945 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b314bde9-1d3f-4849-8fef-90cf05febf90 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:10.353421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9601a6-033f-4327-9f17-3b9a82a59f2d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:10.354977 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9601a6-033f-4327-9f17-3b9a82a59f2d service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:10.357092 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9601a6-033f-4327-9f17-3b9a82a59f2d service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:10.357406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9601a6-033f-4327-9f17-3b9a82a59f2d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:10.386814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9601a6-033f-4327-9f17-3b9a82a59f2d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:10.391334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0c20ca45-d568-4c57-a0dd-c4a72a4ae632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bca8e77a60b5464585a2d025b5605573'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:10.398431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9601a6-033f-4327-9f17-3b9a82a59f2d service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:10.410173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0c20ca45-d568-4c57-a0dd-c4a72a4ae632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bca8e77a60b5464585a2d025b5605573'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:10.420396 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 895/1786] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:10 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:10.457275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0c20ca45-d568-4c57-a0dd-c4a72a4ae632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bca8e77a60b5464585a2d025b5605573'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:10.470096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0c20ca45-d568-4c57-a0dd-c4a72a4ae632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bca8e77a60b5464585a2d025b5605573'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:10.471198 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0c20ca45-d568-4c57-a0dd-c4a72a4ae632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bca8e77a60b5464585a2d025b5605573'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:10.480552 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 892/1787] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:10 2022] DELETE /identity/v3/users/bca8e77a60b5464585a2d025b5605573 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:10.489407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2b529-749c-4dec-bc8b-423ef00dc85e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:10.489407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2b529-749c-4dec-bc8b-423ef00dc85e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:10.489407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2b529-749c-4dec-bc8b-423ef00dc85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:10.534100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-79e2b529-749c-4dec-bc8b-423ef00dc85e None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:10.535525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-79e2b529-749c-4dec-bc8b-423ef00dc85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:10.685886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20ca45-d568-4c57-a0dd-c4a72a4ae632 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:10.687625 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0c20ca45-d568-4c57-a0dd-c4a72a4ae632 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:10.755426 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 896/1788] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:10.799367 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2b529-749c-4dec-bc8b-423ef00dc85e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:10.800924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-79e2b529-749c-4dec-bc8b-423ef00dc85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:10.924594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20ca45-d568-4c57-a0dd-c4a72a4ae632 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:10.932771 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c4baf-43f9-42c2-b7a5-670e7455a324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:10.933615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c4baf-43f9-42c2-b7a5-670e7455a324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:10.934688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c4baf-43f9-42c2-b7a5-670e7455a324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:10.935116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160c4baf-43f9-42c2-b7a5-670e7455a324 admin admin] PATH_INFO: `/v3/users/3fbbb49448c24c51a08442eefb7c228e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:10.943582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c4baf-43f9-42c2-b7a5-670e7455a324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fbbb49448c24c51a08442eefb7c228e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:10.947311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160c4baf-43f9-42c2-b7a5-670e7455a324 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:10.993400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2b529-749c-4dec-bc8b-423ef00dc85e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:11.002862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cda2c-b27f-43cf-849a-5fcf70734af9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:11.003729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cda2c-b27f-43cf-849a-5fcf70734af9 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:11.004146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cda2c-b27f-43cf-849a-5fcf70734af9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:11.004573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cda2c-b27f-43cf-849a-5fcf70734af9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:11.029192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cda2c-b27f-43cf-849a-5fcf70734af9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:11.031601 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cda2c-b27f-43cf-849a-5fcf70734af9 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:11.068891 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 897/1789] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:11.071975 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cda2c-b27f-43cf-849a-5fcf70734af9 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:11.072903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-160c4baf-43f9-42c2-b7a5-670e7455a324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fbbb49448c24c51a08442eefb7c228e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:11.075867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9a1cda2c-b27f-43cf-849a-5fcf70734af9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:11.086468 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-160c4baf-43f9-42c2-b7a5-670e7455a324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fbbb49448c24c51a08442eefb7c228e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:11.093897 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:11.150531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-160c4baf-43f9-42c2-b7a5-670e7455a324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fbbb49448c24c51a08442eefb7c228e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:11.156001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:11.177551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-160c4baf-43f9-42c2-b7a5-670e7455a324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fbbb49448c24c51a08442eefb7c228e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:11.178802 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-160c4baf-43f9-42c2-b7a5-670e7455a324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fbbb49448c24c51a08442eefb7c228e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:11.196587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 893/1790] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:10 2022] DELETE /identity/v3/users/3fbbb49448c24c51a08442eefb7c228e => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:11.204110 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c4baf-43f9-42c2-b7a5-670e7455a324 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:11.210684 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-160c4baf-43f9-42c2-b7a5-670e7455a324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:11.271432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cda2c-b27f-43cf-849a-5fcf70734af9 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:11.360299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160c4baf-43f9-42c2-b7a5-670e7455a324 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:11.376860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0fcbd-ad05-4c2f-aec5-0ce462205a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:11.377500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0fcbd-ad05-4c2f-aec5-0ce462205a48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:11.377834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0fcbd-ad05-4c2f-aec5-0ce462205a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:11.378110 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0fcbd-ad05-4c2f-aec5-0ce462205a48 admin admin] PATH_INFO: `/v3/users/3148ec0b28ec44098f4de4474c7db9c0` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:11.383571 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0fcbd-ad05-4c2f-aec5-0ce462205a48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3148ec0b28ec44098f4de4474c7db9c0)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:11.385901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae0fcbd-ad05-4c2f-aec5-0ce462205a48 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:11.475364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a43f2-35fc-49f9-ba5e-33ca3e314288 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:11.478287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a43f2-35fc-49f9-ba5e-33ca3e314288 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:11.479637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a43f2-35fc-49f9-ba5e-33ca3e314288 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:11.480580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a43f2-35fc-49f9-ba5e-33ca3e314288 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:11.490194 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5f0a43f2-35fc-49f9-ba5e-33ca3e314288 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:11.547515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a43f2-35fc-49f9-ba5e-33ca3e314288 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:11.556570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a43f2-35fc-49f9-ba5e-33ca3e314288 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:11.567503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9ae0fcbd-ad05-4c2f-aec5-0ce462205a48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3148ec0b28ec44098f4de4474c7db9c0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:11.613583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9ae0fcbd-ad05-4c2f-aec5-0ce462205a48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3148ec0b28ec44098f4de4474c7db9c0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:11.640998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 898/1791] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:11.644645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd3b69-ef95-43bd-942e-75336f4a6218 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:11.645825 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd3b69-ef95-43bd-942e-75336f4a6218 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:11.646823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd3b69-ef95-43bd-942e-75336f4a6218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:11.674943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9ae0fcbd-ad05-4c2f-aec5-0ce462205a48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3148ec0b28ec44098f4de4474c7db9c0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:11.736266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-fccd3b69-ef95-43bd-942e-75336f4a6218 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:11.741142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fccd3b69-ef95-43bd-942e-75336f4a6218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:11.761703 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9ae0fcbd-ad05-4c2f-aec5-0ce462205a48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3148ec0b28ec44098f4de4474c7db9c0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:11.770661 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 899/1792] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:11.770962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246bbc7-c1e6-4374-bb1e-530d68bebe5c None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:11.771114 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246bbc7-c1e6-4374-bb1e-530d68bebe5c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:11.772854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9246bbc7-c1e6-4374-bb1e-530d68bebe5c None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:11.773274 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9ae0fcbd-ad05-4c2f-aec5-0ce462205a48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3148ec0b28ec44098f4de4474c7db9c0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:11.776377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 900/1793] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 13 06:38:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:38:11.794888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16aa6e-0287-4bbe-9186-f84be73ce272 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:11.795187 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 894/1794] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:11 2022] DELETE /identity/v3/users/3148ec0b28ec44098f4de4474c7db9c0 => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:11.795280 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16aa6e-0287-4bbe-9186-f84be73ce272 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:11.795694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b16aa6e-0287-4bbe-9186-f84be73ce272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:11.837068 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6b16aa6e-0287-4bbe-9186-f84be73ce272 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:11.844914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6b16aa6e-0287-4bbe-9186-f84be73ce272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:11.884299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ea9b3-b4d5-4569-8948-cfad60b91f0c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:11.884775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ea9b3-b4d5-4569-8948-cfad60b91f0c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:11.885592 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9ea9b3-b4d5-4569-8948-cfad60b91f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:11.941720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fc9ea9b3-b4d5-4569-8948-cfad60b91f0c None None] MFA Rules not processed for user `7fbb67072ba544e39073787eb25fcf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:11.945487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fc9ea9b3-b4d5-4569-8948-cfad60b91f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:12.085012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 901/1795] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:38:12.092516 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16aa6e-0287-4bbe-9186-f84be73ce272 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:12.097033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6b16aa6e-0287-4bbe-9186-f84be73ce272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:12.143622 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:12.241523 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 895/1796] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 13 06:38:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:38:12.243218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ea9b3-b4d5-4569-8948-cfad60b91f0c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:12.246139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fc9ea9b3-b4d5-4569-8948-cfad60b91f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:12.327743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:12.373323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b16aa6e-0287-4bbe-9186-f84be73ce272 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:12.377865 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9bb6d-74b3-4bcb-a989-377502fbb4c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:12.378531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9bb6d-74b3-4bcb-a989-377502fbb4c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:12.378830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9bb6d-74b3-4bcb-a989-377502fbb4c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:12.379452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9bb6d-74b3-4bcb-a989-377502fbb4c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:12.383748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-88b9bb6d-74b3-4bcb-a989-377502fbb4c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:12.510099 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9bb6d-74b3-4bcb-a989-377502fbb4c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:12.520187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9bb6d-74b3-4bcb-a989-377502fbb4c1 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:12.549366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 902/1797] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:12.587207 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9ea9b3-b4d5-4569-8948-cfad60b91f0c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:12.600121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89224c0-8e9f-48ba-bc12-7cc8893bed10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:12.601395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89224c0-8e9f-48ba-bc12-7cc8893bed10 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:12.601626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89224c0-8e9f-48ba-bc12-7cc8893bed10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:12.601901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89224c0-8e9f-48ba-bc12-7cc8893bed10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:12.644016 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89224c0-8e9f-48ba-bc12-7cc8893bed10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:12.646585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89224c0-8e9f-48ba-bc12-7cc8893bed10 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:12.670334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 896/1798] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:13.403611 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9bb6d-74b3-4bcb-a989-377502fbb4c1 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:13.406113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-88b9bb6d-74b3-4bcb-a989-377502fbb4c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:13.441179 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9bb6d-74b3-4bcb-a989-377502fbb4c1 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:13.460017 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f473b-7da5-4e78-8b27-2bda1431d645 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:13.461030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f473b-7da5-4e78-8b27-2bda1431d645 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:13.461569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f473b-7da5-4e78-8b27-2bda1431d645 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:13.461967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f473b-7da5-4e78-8b27-2bda1431d645 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:13.491599 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f473b-7da5-4e78-8b27-2bda1431d645 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:13.493940 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f473b-7da5-4e78-8b27-2bda1431d645 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:13.534581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 903/1799] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:14.081045 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89224c0-8e9f-48ba-bc12-7cc8893bed10 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:14.082570 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d89224c0-8e9f-48ba-bc12-7cc8893bed10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:14.104406 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89224c0-8e9f-48ba-bc12-7cc8893bed10 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:14.122060 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e9732-85e5-40bc-92a4-856e15cfa1c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:14.122658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e9732-85e5-40bc-92a4-856e15cfa1c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:14.122925 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e9732-85e5-40bc-92a4-856e15cfa1c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:14.123202 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e9732-85e5-40bc-92a4-856e15cfa1c8 admin admin] PATH_INFO: `/v3/users/dbf32a1dd3914e6290d3dc661f6dbeef` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:14.124449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e9732-85e5-40bc-92a4-856e15cfa1c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbf32a1dd3914e6290d3dc661f6dbeef)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:14.126417 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e9732-85e5-40bc-92a4-856e15cfa1c8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:14.161449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f473b-7da5-4e78-8b27-2bda1431d645 service nova] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:14.163034 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c53f473b-7da5-4e78-8b27-2bda1431d645 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:14.179000 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f473b-7da5-4e78-8b27-2bda1431d645 service nova] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:14.186115 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:14.186813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:14.187477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:14.187765 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954 admin admin] PATH_INFO: `/v3/projects/665605b93086438a8fcd62b1c8440074` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:14.189595 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954 admin admin] RBAC: Authorizing `identity:delete_project(project_id=665605b93086438a8fcd62b1c8440074)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:14.191543 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:14.198655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-582e9732-85e5-40bc-92a4-856e15cfa1c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbf32a1dd3914e6290d3dc661f6dbeef'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.210591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-582e9732-85e5-40bc-92a4-856e15cfa1c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbf32a1dd3914e6290d3dc661f6dbeef'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.229561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-582e9732-85e5-40bc-92a4-856e15cfa1c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbf32a1dd3914e6290d3dc661f6dbeef'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.240139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-582e9732-85e5-40bc-92a4-856e15cfa1c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbf32a1dd3914e6290d3dc661f6dbeef'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.240981 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-582e9732-85e5-40bc-92a4-856e15cfa1c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbf32a1dd3914e6290d3dc661f6dbeef'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.250870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 897/1800] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:14 2022] DELETE /identity/v3/users/dbf32a1dd3914e6290d3dc661f6dbeef => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:14.255117 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f474-0b78-448d-9c3f-1d8b765e4697 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:14.255491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f474-0b78-448d-9c3f-1d8b765e4697 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:14.255843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f474-0b78-448d-9c3f-1d8b765e4697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:14.272660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '665605b93086438a8fcd62b1c8440074', 'request_id': 'req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.283460 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-84e3f474-0b78-448d-9c3f-1d8b765e4697 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:14.285352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-84e3f474-0b78-448d-9c3f-1d8b765e4697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:14.286301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '665605b93086438a8fcd62b1c8440074', 'request_id': 'req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.298440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '665605b93086438a8fcd62b1c8440074', 'request_id': 'req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.317379 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954 admin admin] The token cache is being invalidate because project 665605b93086438a8fcd62b1c8440074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:14.317735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.319104 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.324293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 904/1801] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:14 2022] DELETE /identity/v3/projects/665605b93086438a8fcd62b1c8440074 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:14.338276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:14.341818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:14.421485 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 898/1802] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:14.443446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3f474-0b78-448d-9c3f-1d8b765e4697 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:14.446056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-84e3f474-0b78-448d-9c3f-1d8b765e4697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:14.453527 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:14.482920 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea30b41-5b2b-4a68-bfd5-5cd3b4091954 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:14.494849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7c5f8-2d5e-4cc7-b765-2d87dcae83b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:14.495493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7c5f8-2d5e-4cc7-b765-2d87dcae83b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:14.495771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7c5f8-2d5e-4cc7-b765-2d87dcae83b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:14.496042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7c5f8-2d5e-4cc7-b765-2d87dcae83b6 admin admin] PATH_INFO: `/v3/users/c64026ff25914e30824bd2cf94d1fb8d` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:14.497323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7c5f8-2d5e-4cc7-b765-2d87dcae83b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c64026ff25914e30824bd2cf94d1fb8d)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:14.499245 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7c5f8-2d5e-4cc7-b765-2d87dcae83b6 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:14.547479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e3f474-0b78-448d-9c3f-1d8b765e4697 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:14.554506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e424a5d-8398-4829-a7fc-3e1268d9b107 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:14.555876 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e424a5d-8398-4829-a7fc-3e1268d9b107 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:14.557951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e424a5d-8398-4829-a7fc-3e1268d9b107 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:14.559525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e424a5d-8398-4829-a7fc-3e1268d9b107 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:14.571636 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ceb7c5f8-2d5e-4cc7-b765-2d87dcae83b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c64026ff25914e30824bd2cf94d1fb8d'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.579514 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e424a5d-8398-4829-a7fc-3e1268d9b107 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:14.581685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e424a5d-8398-4829-a7fc-3e1268d9b107 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:14.582024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ceb7c5f8-2d5e-4cc7-b765-2d87dcae83b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c64026ff25914e30824bd2cf94d1fb8d'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.585059 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:14.603256 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 899/1803] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:14.604745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e424a5d-8398-4829-a7fc-3e1268d9b107 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:14.606868 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ceb7c5f8-2d5e-4cc7-b765-2d87dcae83b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c64026ff25914e30824bd2cf94d1fb8d'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.607615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0e424a5d-8398-4829-a7fc-3e1268d9b107 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:14.608784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ceb7c5f8-2d5e-4cc7-b765-2d87dcae83b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c64026ff25914e30824bd2cf94d1fb8d'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.619488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ceb7c5f8-2d5e-4cc7-b765-2d87dcae83b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c64026ff25914e30824bd2cf94d1fb8d'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.628694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e424a5d-8398-4829-a7fc-3e1268d9b107 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:14.634308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 905/1804] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:14 2022] DELETE /identity/v3/users/c64026ff25914e30824bd2cf94d1fb8d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:14.643940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05ff68-3e96-46cd-807e-26c1d973014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:14.645074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05ff68-3e96-46cd-807e-26c1d973014e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:14.649358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05ff68-3e96-46cd-807e-26c1d973014e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:14.650072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05ff68-3e96-46cd-807e-26c1d973014e admin admin] PATH_INFO: `/v3/projects/783ff584357d41b098ba0efe5159ee0c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:14.651702 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05ff68-3e96-46cd-807e-26c1d973014e admin admin] RBAC: Authorizing `identity:delete_project(project_id=783ff584357d41b098ba0efe5159ee0c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:14.653966 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f05ff68-3e96-46cd-807e-26c1d973014e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:14.714048 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5f05ff68-3e96-46cd-807e-26c1d973014e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783ff584357d41b098ba0efe5159ee0c', 'request_id': 'req-5f05ff68-3e96-46cd-807e-26c1d973014e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.721000 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5f05ff68-3e96-46cd-807e-26c1d973014e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783ff584357d41b098ba0efe5159ee0c', 'request_id': 'req-5f05ff68-3e96-46cd-807e-26c1d973014e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.728162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5f05ff68-3e96-46cd-807e-26c1d973014e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783ff584357d41b098ba0efe5159ee0c', 'request_id': 'req-5f05ff68-3e96-46cd-807e-26c1d973014e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.745336 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5f05ff68-3e96-46cd-807e-26c1d973014e admin admin] The token cache is being invalidate because project 783ff584357d41b098ba0efe5159ee0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:14.746134 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5f05ff68-3e96-46cd-807e-26c1d973014e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.747488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5f05ff68-3e96-46cd-807e-26c1d973014e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:14.750499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 900/1805] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:14 2022] DELETE /identity/v3/projects/783ff584357d41b098ba0efe5159ee0c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:14.756834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7c5f8-2d5e-4cc7-b765-2d87dcae83b6 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:14.758654 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ceb7c5f8-2d5e-4cc7-b765-2d87dcae83b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:14.888790 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05ff68-3e96-46cd-807e-26c1d973014e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:14.890782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5f05ff68-3e96-46cd-807e-26c1d973014e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:14.923400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7c5f8-2d5e-4cc7-b765-2d87dcae83b6 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:15.000622 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05ff68-3e96-46cd-807e-26c1d973014e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:15.006283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22800c39-67e5-4a32-abba-a0354c9e3bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:15.006924 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22800c39-67e5-4a32-abba-a0354c9e3bde admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:15.007209 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22800c39-67e5-4a32-abba-a0354c9e3bde admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:15.007485 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22800c39-67e5-4a32-abba-a0354c9e3bde admin admin] PATH_INFO: `/v3/projects/1b713dbe0a1e4ff6937fc714a938bb71` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:15.008802 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22800c39-67e5-4a32-abba-a0354c9e3bde admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b713dbe0a1e4ff6937fc714a938bb71)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:15.010778 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22800c39-67e5-4a32-abba-a0354c9e3bde admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:15.023314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77a7c7-df3c-4a21-beb4-3979bf88d047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:15.024319 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77a7c7-df3c-4a21-beb4-3979bf88d047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:15.024830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77a7c7-df3c-4a21-beb4-3979bf88d047 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:15.025320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77a7c7-df3c-4a21-beb4-3979bf88d047 admin admin] PATH_INFO: `/v3/users/5300a9cda310489aa3b47ade1af9552b` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:15.026732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77a7c7-df3c-4a21-beb4-3979bf88d047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5300a9cda310489aa3b47ade1af9552b)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:15.030877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77a7c7-df3c-4a21-beb4-3979bf88d047 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:15.051597 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:15.071912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-22800c39-67e5-4a32-abba-a0354c9e3bde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b713dbe0a1e4ff6937fc714a938bb71', 'request_id': 'req-22800c39-67e5-4a32-abba-a0354c9e3bde'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.080829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-22800c39-67e5-4a32-abba-a0354c9e3bde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b713dbe0a1e4ff6937fc714a938bb71', 'request_id': 'req-22800c39-67e5-4a32-abba-a0354c9e3bde'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.091324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-22800c39-67e5-4a32-abba-a0354c9e3bde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b713dbe0a1e4ff6937fc714a938bb71', 'request_id': 'req-22800c39-67e5-4a32-abba-a0354c9e3bde'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.110859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-22800c39-67e5-4a32-abba-a0354c9e3bde admin admin] The token cache is being invalidate because project 1b713dbe0a1e4ff6937fc714a938bb71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:15.111334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-22800c39-67e5-4a32-abba-a0354c9e3bde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.111695 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9e77a7c7-df3c-4a21-beb4-3979bf88d047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5300a9cda310489aa3b47ade1af9552b'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.112872 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-22800c39-67e5-4a32-abba-a0354c9e3bde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.115141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 901/1806] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:14 2022] DELETE /identity/v3/projects/1b713dbe0a1e4ff6937fc714a938bb71 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:15.119886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22800c39-67e5-4a32-abba-a0354c9e3bde admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:15.123690 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-22800c39-67e5-4a32-abba-a0354c9e3bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:15.141769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9e77a7c7-df3c-4a21-beb4-3979bf88d047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5300a9cda310489aa3b47ade1af9552b'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.163089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9e77a7c7-df3c-4a21-beb4-3979bf88d047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5300a9cda310489aa3b47ade1af9552b'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.164252 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9e77a7c7-df3c-4a21-beb4-3979bf88d047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5300a9cda310489aa3b47ade1af9552b'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.177437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9e77a7c7-df3c-4a21-beb4-3979bf88d047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5300a9cda310489aa3b47ade1af9552b'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.188966 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 906/1807] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:14 2022] DELETE /identity/v3/users/5300a9cda310489aa3b47ade1af9552b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:15.243395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22800c39-67e5-4a32-abba-a0354c9e3bde admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:15.325543 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624bf59-92aa-4ebd-a914-96e7705a3262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:15.326307 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624bf59-92aa-4ebd-a914-96e7705a3262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:15.326644 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624bf59-92aa-4ebd-a914-96e7705a3262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:15.326988 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3624bf59-92aa-4ebd-a914-96e7705a3262 admin admin] PATH_INFO: `/v3/users/d6a65ca692c047ddb1cd564023b88ab9` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:15.328373 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624bf59-92aa-4ebd-a914-96e7705a3262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6a65ca692c047ddb1cd564023b88ab9)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:15.330683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3624bf59-92aa-4ebd-a914-96e7705a3262 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:15.403135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77a7c7-df3c-4a21-beb4-3979bf88d047 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:15.405877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9e77a7c7-df3c-4a21-beb4-3979bf88d047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:15.410334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3624bf59-92aa-4ebd-a914-96e7705a3262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6a65ca692c047ddb1cd564023b88ab9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.419376 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3624bf59-92aa-4ebd-a914-96e7705a3262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6a65ca692c047ddb1cd564023b88ab9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.422798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:15.433416 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77a7c7-df3c-4a21-beb4-3979bf88d047 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:15.450802 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:15.463838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3624bf59-92aa-4ebd-a914-96e7705a3262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6a65ca692c047ddb1cd564023b88ab9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.469660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d8114-77c9-4ac0-b768-ddba83f49090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:15.470313 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d8114-77c9-4ac0-b768-ddba83f49090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:15.470591 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d8114-77c9-4ac0-b768-ddba83f49090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:15.470864 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295d8114-77c9-4ac0-b768-ddba83f49090 admin admin] PATH_INFO: `/v3/projects/0a1392f593e64412ad50056443af48af` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:15.474139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d8114-77c9-4ac0-b768-ddba83f49090 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a1392f593e64412ad50056443af48af)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:15.476074 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295d8114-77c9-4ac0-b768-ddba83f49090 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:15.481591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3624bf59-92aa-4ebd-a914-96e7705a3262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6a65ca692c047ddb1cd564023b88ab9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.482350 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3624bf59-92aa-4ebd-a914-96e7705a3262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6a65ca692c047ddb1cd564023b88ab9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.492023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 902/1808] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:15 2022] DELETE /identity/v3/users/d6a65ca692c047ddb1cd564023b88ab9 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:15.560648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-295d8114-77c9-4ac0-b768-ddba83f49090 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a1392f593e64412ad50056443af48af', 'request_id': 'req-295d8114-77c9-4ac0-b768-ddba83f49090'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.570634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-295d8114-77c9-4ac0-b768-ddba83f49090 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a1392f593e64412ad50056443af48af', 'request_id': 'req-295d8114-77c9-4ac0-b768-ddba83f49090'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.579548 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-295d8114-77c9-4ac0-b768-ddba83f49090 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a1392f593e64412ad50056443af48af', 'request_id': 'req-295d8114-77c9-4ac0-b768-ddba83f49090'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.596131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-295d8114-77c9-4ac0-b768-ddba83f49090 admin admin] The token cache is being invalidate because project 0a1392f593e64412ad50056443af48af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:15.596708 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-295d8114-77c9-4ac0-b768-ddba83f49090 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.597639 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-295d8114-77c9-4ac0-b768-ddba83f49090 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.599894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 907/1809] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:15 2022] DELETE /identity/v3/projects/0a1392f593e64412ad50056443af48af => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:15.603958 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624bf59-92aa-4ebd-a914-96e7705a3262 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:15.605467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3624bf59-92aa-4ebd-a914-96e7705a3262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:15.716972 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3624bf59-92aa-4ebd-a914-96e7705a3262 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:15.733555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d8114-77c9-4ac0-b768-ddba83f49090 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:15.735148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-295d8114-77c9-4ac0-b768-ddba83f49090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:15.806795 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cedb52-edc6-4f8e-966d-f4b26ef14d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:15.807476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cedb52-edc6-4f8e-966d-f4b26ef14d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:15.808372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cedb52-edc6-4f8e-966d-f4b26ef14d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:15.808630 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cedb52-edc6-4f8e-966d-f4b26ef14d11 admin admin] PATH_INFO: `/v3/users/900e7a8885cd4e9f89acfe6caecce4c5` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:15.811326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cedb52-edc6-4f8e-966d-f4b26ef14d11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=900e7a8885cd4e9f89acfe6caecce4c5)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:15.813494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cedb52-edc6-4f8e-966d-f4b26ef14d11 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:15.837885 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295d8114-77c9-4ac0-b768-ddba83f49090 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:15.854099 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb536abf-26f3-4a80-b8d6-ad599c494dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:15.855143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb536abf-26f3-4a80-b8d6-ad599c494dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:15.855621 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb536abf-26f3-4a80-b8d6-ad599c494dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:15.856933 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb536abf-26f3-4a80-b8d6-ad599c494dfb admin admin] PATH_INFO: `/v3/projects/e39b237a9c7b478290566078ab2379c3` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:15.859295 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb536abf-26f3-4a80-b8d6-ad599c494dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39b237a9c7b478290566078ab2379c3)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:15.867345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb536abf-26f3-4a80-b8d6-ad599c494dfb admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:15.923060 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a2cedb52-edc6-4f8e-966d-f4b26ef14d11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '900e7a8885cd4e9f89acfe6caecce4c5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.934674 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a2cedb52-edc6-4f8e-966d-f4b26ef14d11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '900e7a8885cd4e9f89acfe6caecce4c5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.951678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a2cedb52-edc6-4f8e-966d-f4b26ef14d11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '900e7a8885cd4e9f89acfe6caecce4c5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.956258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-eb536abf-26f3-4a80-b8d6-ad599c494dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39b237a9c7b478290566078ab2379c3', 'request_id': 'req-eb536abf-26f3-4a80-b8d6-ad599c494dfb'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.966151 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a2cedb52-edc6-4f8e-966d-f4b26ef14d11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '900e7a8885cd4e9f89acfe6caecce4c5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.967134 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a2cedb52-edc6-4f8e-966d-f4b26ef14d11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '900e7a8885cd4e9f89acfe6caecce4c5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.973814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-eb536abf-26f3-4a80-b8d6-ad599c494dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39b237a9c7b478290566078ab2379c3', 'request_id': 'req-eb536abf-26f3-4a80-b8d6-ad599c494dfb'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.974480 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 903/1810] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:15 2022] DELETE /identity/v3/users/900e7a8885cd4e9f89acfe6caecce4c5 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:15.975356 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cedb52-edc6-4f8e-966d-f4b26ef14d11 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:15.977090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a2cedb52-edc6-4f8e-966d-f4b26ef14d11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:15.983759 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-eb536abf-26f3-4a80-b8d6-ad599c494dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39b237a9c7b478290566078ab2379c3', 'request_id': 'req-eb536abf-26f3-4a80-b8d6-ad599c494dfb'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.992112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:15.996836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-eb536abf-26f3-4a80-b8d6-ad599c494dfb admin admin] The token cache is being invalidate because project e39b237a9c7b478290566078ab2379c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:15.997131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-eb536abf-26f3-4a80-b8d6-ad599c494dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.997798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-eb536abf-26f3-4a80-b8d6-ad599c494dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:15.999591 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 908/1811] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:15 2022] DELETE /identity/v3/projects/e39b237a9c7b478290566078ab2379c3 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:16.003952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b290a5b-641d-471b-849e-b86a6fb453df None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.004411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b290a5b-641d-471b-849e-b86a6fb453df None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.004794 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b290a5b-641d-471b-849e-b86a6fb453df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.028284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-7b290a5b-641d-471b-849e-b86a6fb453df None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:16.029546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-7b290a5b-641d-471b-849e-b86a6fb453df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:16.039970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:16.078839 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cedb52-edc6-4f8e-966d-f4b26ef14d11 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:16.085672 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d21d855-464a-41f4-9f12-9a8c62f50aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:16.086710 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21d855-464a-41f4-9f12-9a8c62f50aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.086900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21d855-464a-41f4-9f12-9a8c62f50aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.087189 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d21d855-464a-41f4-9f12-9a8c62f50aff admin admin] PATH_INFO: `/v3/projects/8728e3d883cf40c89404463dbca2a267` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.088984 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21d855-464a-41f4-9f12-9a8c62f50aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=8728e3d883cf40c89404463dbca2a267)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:16.091995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d21d855-464a-41f4-9f12-9a8c62f50aff admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:16.113061 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 909/1812] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:38:16.116923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b290a5b-641d-471b-849e-b86a6fb453df None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:16.119716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-7b290a5b-641d-471b-849e-b86a6fb453df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:16.134331 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b290a5b-641d-471b-849e-b86a6fb453df None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:16.159220 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2dda3-e78f-46b1-a2d5-a2c3fc941527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:16.162229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2dda3-e78f-46b1-a2d5-a2c3fc941527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.163066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2dda3-e78f-46b1-a2d5-a2c3fc941527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.163349 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2dda3-e78f-46b1-a2d5-a2c3fc941527 admin admin] PATH_INFO: `/v3/projects/ededa3660fa144a3b19de6d6814abd14` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.167497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2dda3-e78f-46b1-a2d5-a2c3fc941527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ededa3660fa144a3b19de6d6814abd14)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:16.170945 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f2dda3-e78f-46b1-a2d5-a2c3fc941527 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:16.181894 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7d21d855-464a-41f4-9f12-9a8c62f50aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8728e3d883cf40c89404463dbca2a267', 'request_id': 'req-7d21d855-464a-41f4-9f12-9a8c62f50aff'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:16.193300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7d21d855-464a-41f4-9f12-9a8c62f50aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8728e3d883cf40c89404463dbca2a267', 'request_id': 'req-7d21d855-464a-41f4-9f12-9a8c62f50aff'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:16.209589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7d21d855-464a-41f4-9f12-9a8c62f50aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8728e3d883cf40c89404463dbca2a267', 'request_id': 'req-7d21d855-464a-41f4-9f12-9a8c62f50aff'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:16.238622 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7d21d855-464a-41f4-9f12-9a8c62f50aff admin admin] The token cache is being invalidate because project 8728e3d883cf40c89404463dbca2a267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:16.238917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7d21d855-464a-41f4-9f12-9a8c62f50aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:16.239629 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7d21d855-464a-41f4-9f12-9a8c62f50aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:16.250223 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 904/1813] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:15 2022] DELETE /identity/v3/projects/8728e3d883cf40c89404463dbca2a267 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:16.250223 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0a26e-7cbd-499b-a033-f68a166eb91f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.250980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0a26e-7cbd-499b-a033-f68a166eb91f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.251472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0a26e-7cbd-499b-a033-f68a166eb91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.257078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e7f2dda3-e78f-46b1-a2d5-a2c3fc941527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ededa3660fa144a3b19de6d6814abd14', 'request_id': 'req-e7f2dda3-e78f-46b1-a2d5-a2c3fc941527'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:16.272134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e7f2dda3-e78f-46b1-a2d5-a2c3fc941527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ededa3660fa144a3b19de6d6814abd14', 'request_id': 'req-e7f2dda3-e78f-46b1-a2d5-a2c3fc941527'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:16.281875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e7f2dda3-e78f-46b1-a2d5-a2c3fc941527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ededa3660fa144a3b19de6d6814abd14', 'request_id': 'req-e7f2dda3-e78f-46b1-a2d5-a2c3fc941527'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:16.313866 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0fa0a26e-7cbd-499b-a033-f68a166eb91f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:16.315281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e7f2dda3-e78f-46b1-a2d5-a2c3fc941527 admin admin] The token cache is being invalidate because project ededa3660fa144a3b19de6d6814abd14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:16.315415 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0fa0a26e-7cbd-499b-a033-f68a166eb91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:16.315630 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e7f2dda3-e78f-46b1-a2d5-a2c3fc941527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:16.316302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e7f2dda3-e78f-46b1-a2d5-a2c3fc941527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:16.321170 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 910/1814] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:16 2022] DELETE /identity/v3/projects/ededa3660fa144a3b19de6d6814abd14 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:16.321170 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1e845-ccc4-4033-b682-c24ec31541d2 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.321385 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1e845-ccc4-4033-b682-c24ec31541d2 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.321558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1e845-ccc4-4033-b682-c24ec31541d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.343493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-aaa1e845-ccc4-4033-b682-c24ec31541d2 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:16.345023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-aaa1e845-ccc4-4033-b682-c24ec31541d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:16.396389 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 905/1815] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:16.398194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032b108-190c-4010-9faa-35d7d7979e69 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.398378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032b108-190c-4010-9faa-35d7d7979e69 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.398634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032b108-190c-4010-9faa-35d7d7979e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.421629 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5032b108-190c-4010-9faa-35d7d7979e69 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:16.422812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 911/1816] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:16.423514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1e845-ccc4-4033-b682-c24ec31541d2 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:16.424962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5032b108-190c-4010-9faa-35d7d7979e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:16.438156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1e845-ccc4-4033-b682-c24ec31541d2 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:16.439141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 906/1817] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:16.440912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81ca90-90fd-42e6-a6fb-50cc6fbdfd8b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.441203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81ca90-90fd-42e6-a6fb-50cc6fbdfd8b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.441485 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81ca90-90fd-42e6-a6fb-50cc6fbdfd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.450293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74133c-067e-4e2b-a29e-8b527dbbd807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:16.452065 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74133c-067e-4e2b-a29e-8b527dbbd807 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.452547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74133c-067e-4e2b-a29e-8b527dbbd807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.453030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74133c-067e-4e2b-a29e-8b527dbbd807 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.453717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74133c-067e-4e2b-a29e-8b527dbbd807 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:16.454023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74133c-067e-4e2b-a29e-8b527dbbd807 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:16.455623 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e74133c-067e-4e2b-a29e-8b527dbbd807 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:16.464749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9f81ca90-90fd-42e6-a6fb-50cc6fbdfd8b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:16.467512 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9f81ca90-90fd-42e6-a6fb-50cc6fbdfd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:16.471444 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 912/1818] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:38:16.472396 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38916431-2c24-4cf4-bcaf-2ec34435d70d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.472690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38916431-2c24-4cf4-bcaf-2ec34435d70d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.473563 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38916431-2c24-4cf4-bcaf-2ec34435d70d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.484656 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 907/1819] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:16.484656 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81ca90-90fd-42e6-a6fb-50cc6fbdfd8b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:16.499651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-38916431-2c24-4cf4-bcaf-2ec34435d70d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:16.501178 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-38916431-2c24-4cf4-bcaf-2ec34435d70d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:16.503359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81ca90-90fd-42e6-a6fb-50cc6fbdfd8b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:16.509112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b2265-0ef8-4adc-ba3c-c6ac4a697208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:16.510086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b2265-0ef8-4adc-ba3c-c6ac4a697208 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.510287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b2265-0ef8-4adc-ba3c-c6ac4a697208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.510711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b2265-0ef8-4adc-ba3c-c6ac4a697208 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.511364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b2265-0ef8-4adc-ba3c-c6ac4a697208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:16.524715 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b2265-0ef8-4adc-ba3c-c6ac4a697208 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:16.533465 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 913/1820] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:16.533465 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38916431-2c24-4cf4-bcaf-2ec34435d70d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:16.550636 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38916431-2c24-4cf4-bcaf-2ec34435d70d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:16.555259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca28a5-1091-49f8-8acf-ba60a066d706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:16.555881 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca28a5-1091-49f8-8acf-ba60a066d706 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.556137 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca28a5-1091-49f8-8acf-ba60a066d706 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.556407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aca28a5-1091-49f8-8acf-ba60a066d706 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.557266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca28a5-1091-49f8-8acf-ba60a066d706 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:16.557388 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca28a5-1091-49f8-8acf-ba60a066d706 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:16.560736 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aca28a5-1091-49f8-8acf-ba60a066d706 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:16.561324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 908/1821] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:16 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:16.561324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b2265-0ef8-4adc-ba3c-c6ac4a697208 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:16.561782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-738b2265-0ef8-4adc-ba3c-c6ac4a697208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:16.572265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:16.572828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 914/1822] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:38:16.576720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca28a5-1091-49f8-8acf-ba60a066d706 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:16.586542 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aca28a5-1091-49f8-8acf-ba60a066d706 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:16.591202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:16.677844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b2265-0ef8-4adc-ba3c-c6ac4a697208 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:16.680642 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e9b18-1e0e-4a81-9859-631057c63766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:16.680827 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e9b18-1e0e-4a81-9859-631057c63766 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.681071 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e9b18-1e0e-4a81-9859-631057c63766 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.681560 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e9b18-1e0e-4a81-9859-631057c63766 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.682265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e9b18-1e0e-4a81-9859-631057c63766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:16.682572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e9b18-1e0e-4a81-9859-631057c63766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:16.684402 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e9b18-1e0e-4a81-9859-631057c63766 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:16.689586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706bc6f-f290-4404-bd80-c85008538608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:16.690565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706bc6f-f290-4404-bd80-c85008538608 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.691048 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706bc6f-f290-4404-bd80-c85008538608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.691664 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9706bc6f-f290-4404-bd80-c85008538608 admin admin] PATH_INFO: `/v3/projects/807c7fe9905c40bba1e102d187bf961c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.693791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706bc6f-f290-4404-bd80-c85008538608 admin admin] RBAC: Authorizing `identity:delete_project(project_id=807c7fe9905c40bba1e102d187bf961c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:16.696650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9706bc6f-f290-4404-bd80-c85008538608 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:16.704895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 915/1823] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:38:16.705903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e9b18-1e0e-4a81-9859-631057c63766 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:16.717562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e9b18-1e0e-4a81-9859-631057c63766 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:16.723609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f6816-9c8d-40ed-9196-266722449a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:16.724415 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f6816-9c8d-40ed-9196-266722449a56 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.724823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f6816-9c8d-40ed-9196-266722449a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.725211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2f6816-9c8d-40ed-9196-266722449a56 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.725948 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f6816-9c8d-40ed-9196-266722449a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:16.728014 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2f6816-9c8d-40ed-9196-266722449a56 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:16.758387 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 916/1824] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:16 2022] POST /identity/v3/users => generated 294 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:16.759237 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f6816-9c8d-40ed-9196-266722449a56 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:16.775063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2f6816-9c8d-40ed-9196-266722449a56 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:16.782735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9706bc6f-f290-4404-bd80-c85008538608 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '807c7fe9905c40bba1e102d187bf961c', 'request_id': 'req-9706bc6f-f290-4404-bd80-c85008538608'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:16.790883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9706bc6f-f290-4404-bd80-c85008538608 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '807c7fe9905c40bba1e102d187bf961c', 'request_id': 'req-9706bc6f-f290-4404-bd80-c85008538608'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:16.807457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9706bc6f-f290-4404-bd80-c85008538608 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '807c7fe9905c40bba1e102d187bf961c', 'request_id': 'req-9706bc6f-f290-4404-bd80-c85008538608'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:16.834946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9706bc6f-f290-4404-bd80-c85008538608 admin admin] The token cache is being invalidate because project 807c7fe9905c40bba1e102d187bf961c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:16.835241 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9706bc6f-f290-4404-bd80-c85008538608 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:16.835877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9706bc6f-f290-4404-bd80-c85008538608 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:16.837403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 909/1825] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:16 2022] DELETE /identity/v3/projects/807c7fe9905c40bba1e102d187bf961c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:16.838148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706bc6f-f290-4404-bd80-c85008538608 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:16.839433 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9706bc6f-f290-4404-bd80-c85008538608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:16.842904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f4a8f-ee3c-4cad-968f-05b9be330a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:16.843549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f4a8f-ee3c-4cad-968f-05b9be330a1b admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.843861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f4a8f-ee3c-4cad-968f-05b9be330a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.844136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1f4a8f-ee3c-4cad-968f-05b9be330a1b admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.844805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f4a8f-ee3c-4cad-968f-05b9be330a1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:16.846718 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1f4a8f-ee3c-4cad-968f-05b9be330a1b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:16.853339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9706bc6f-f290-4404-bd80-c85008538608 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:16.858118 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893d904-5144-4b0b-93e3-8732e5286818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:16.858783 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893d904-5144-4b0b-93e3-8732e5286818 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.859125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893d904-5144-4b0b-93e3-8732e5286818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.859467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893d904-5144-4b0b-93e3-8732e5286818 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.860173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893d904-5144-4b0b-93e3-8732e5286818 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:16.862181 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893d904-5144-4b0b-93e3-8732e5286818 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:16.877731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 917/1826] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:16 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:16.877731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f4a8f-ee3c-4cad-968f-05b9be330a1b admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:16.878982 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-bb1f4a8f-ee3c-4cad-968f-05b9be330a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:16.892705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 910/1827] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:16 2022] POST /identity/v3/projects => generated 377 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:16.892705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773e6db-dc3c-4666-8fdb-481b7d125ed4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.892705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773e6db-dc3c-4666-8fdb-481b7d125ed4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.892705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8773e6db-dc3c-4666-8fdb-481b7d125ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.910757 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8773e6db-dc3c-4666-8fdb-481b7d125ed4 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:16.911948 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8773e6db-dc3c-4666-8fdb-481b7d125ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:16.945896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1f4a8f-ee3c-4cad-968f-05b9be330a1b admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:16.958094 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:16.970671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 911/1828] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:16.971509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773e6db-dc3c-4666-8fdb-481b7d125ed4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:16.972895 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8773e6db-dc3c-4666-8fdb-481b7d125ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:16.984277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8773e6db-dc3c-4666-8fdb-481b7d125ed4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:16.989154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf69fd-02c6-4cdd-939d-934aeb4f5bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:16.989749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf69fd-02c6-4cdd-939d-934aeb4f5bb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:16.990031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf69fd-02c6-4cdd-939d-934aeb4f5bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:16.990306 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcf69fd-02c6-4cdd-939d-934aeb4f5bb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:16.990939 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf69fd-02c6-4cdd-939d-934aeb4f5bb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:16.993142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcf69fd-02c6-4cdd-939d-934aeb4f5bb8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.010768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:17.013345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d667183b-54e2-4733-8fc9-f61502179141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:17.013976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667183b-54e2-4733-8fc9-f61502179141 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.014258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667183b-54e2-4733-8fc9-f61502179141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.014528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d667183b-54e2-4733-8fc9-f61502179141 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.015169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667183b-54e2-4733-8fc9-f61502179141 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:17.016818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d667183b-54e2-4733-8fc9-f61502179141 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.020895 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 912/1829] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:16 2022] POST /identity/v3/users => generated 284 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:17.022010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf69fd-02c6-4cdd-939d-934aeb4f5bb8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:17.027041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 918/1830] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:17.028384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842a9c2-23b1-4b5d-8bbf-bb458ec2df0e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.028687 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842a9c2-23b1-4b5d-8bbf-bb458ec2df0e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.028972 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842a9c2-23b1-4b5d-8bbf-bb458ec2df0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.034760 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcf69fd-02c6-4cdd-939d-934aeb4f5bb8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:17.039603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee5153-9ae5-4429-a0d2-79fdea900b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:17.040200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee5153-9ae5-4429-a0d2-79fdea900b23 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.040479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee5153-9ae5-4429-a0d2-79fdea900b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.040789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ee5153-9ae5-4429-a0d2-79fdea900b23 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.041423 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee5153-9ae5-4429-a0d2-79fdea900b23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:17.043355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ee5153-9ae5-4429-a0d2-79fdea900b23 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.048097 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0842a9c2-23b1-4b5d-8bbf-bb458ec2df0e None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:17.049332 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0842a9c2-23b1-4b5d-8bbf-bb458ec2df0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:17.057529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 919/1831] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:17.058316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842a9c2-23b1-4b5d-8bbf-bb458ec2df0e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:17.067665 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 913/1832] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:17 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:17.068695 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842a9c2-23b1-4b5d-8bbf-bb458ec2df0e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:17.068854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee5153-9ae5-4429-a0d2-79fdea900b23 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:17.073373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a8339-3296-4ba5-b372-721d718fc4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:17.073969 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a8339-3296-4ba5-b372-721d718fc4bb admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.074251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a8339-3296-4ba5-b372-721d718fc4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.074583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15a8339-3296-4ba5-b372-721d718fc4bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.075848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a8339-3296-4ba5-b372-721d718fc4bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:17.077489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15a8339-3296-4ba5-b372-721d718fc4bb admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.079011 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ee5153-9ae5-4429-a0d2-79fdea900b23 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:17.083819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f02eb-d821-444b-887a-63103e42feb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:17.084494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f02eb-d821-444b-887a-63103e42feb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.084803 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f02eb-d821-444b-887a-63103e42feb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.085081 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0f02eb-d821-444b-887a-63103e42feb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.085776 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f02eb-d821-444b-887a-63103e42feb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:17.087344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0f02eb-d821-444b-887a-63103e42feb6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.089051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 920/1833] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:17.089926 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a8339-3296-4ba5-b372-721d718fc4bb admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:17.099340 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 914/1834] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:17.100187 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f02eb-d821-444b-887a-63103e42feb6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:17.100924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15a8339-3296-4ba5-b372-721d718fc4bb admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:17.106740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed81662-428f-4448-a8ae-0a022133e4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:17.106875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed81662-428f-4448-a8ae-0a022133e4ba admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.107081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed81662-428f-4448-a8ae-0a022133e4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.107350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed81662-428f-4448-a8ae-0a022133e4ba admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.107992 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed81662-428f-4448-a8ae-0a022133e4ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:17.108289 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed81662-428f-4448-a8ae-0a022133e4ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:17.109902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed81662-428f-4448-a8ae-0a022133e4ba admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.110013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0f02eb-d821-444b-887a-63103e42feb6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:17.114601 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e9b07-7666-4680-b597-9cdd0728dd31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:17.115196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e9b07-7666-4680-b597-9cdd0728dd31 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.115472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e9b07-7666-4680-b597-9cdd0728dd31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.115747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e9b07-7666-4680-b597-9cdd0728dd31 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.116382 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e9b07-7666-4680-b597-9cdd0728dd31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:17.118088 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e9b07-7666-4680-b597-9cdd0728dd31 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.125158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 921/1835] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:38:17.126039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed81662-428f-4448-a8ae-0a022133e4ba admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:17.128858 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 915/1836] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:17.129655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e9b07-7666-4680-b597-9cdd0728dd31 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:17.135682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed81662-428f-4448-a8ae-0a022133e4ba admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:17.141011 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937605a0-a85d-4826-a19b-b357a9c834c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:17.141144 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e9b07-7666-4680-b597-9cdd0728dd31 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:17.141970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937605a0-a85d-4826-a19b-b357a9c834c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.142435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937605a0-a85d-4826-a19b-b357a9c834c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.142903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937605a0-a85d-4826-a19b-b357a9c834c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.143647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937605a0-a85d-4826-a19b-b357a9c834c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:17.146253 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937605a0-a85d-4826-a19b-b357a9c834c0 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.146594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fd637-2143-48b6-9618-5d819c2ec6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:17.147612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fd637-2143-48b6-9618-5d819c2ec6de admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.147896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fd637-2143-48b6-9618-5d819c2ec6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.148168 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fd637-2143-48b6-9618-5d819c2ec6de admin admin] PATH_INFO: `/v3/projects/45f1692dd3b04dcdb5eca27a9658c267/users/a7fbba29274445c6a6277010243ef066/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.162489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 922/1837] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:17.162489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937605a0-a85d-4826-a19b-b357a9c834c0 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:17.167801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fd637-2143-48b6-9618-5d819c2ec6de admin admin] RBAC: Authorizing `identity:create_grant(project_id=45f1692dd3b04dcdb5eca27a9658c267, user_id=a7fbba29274445c6a6277010243ef066, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:17.170858 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fd637-2143-48b6-9618-5d819c2ec6de admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.172384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937605a0-a85d-4826-a19b-b357a9c834c0 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:17.178720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae55df-b62d-4327-a940-7ee75e13312c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:17.179324 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae55df-b62d-4327-a940-7ee75e13312c admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.179605 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae55df-b62d-4327-a940-7ee75e13312c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.179876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae55df-b62d-4327-a940-7ee75e13312c admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.180509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae55df-b62d-4327-a940-7ee75e13312c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:17.182448 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae55df-b62d-4327-a940-7ee75e13312c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.190321 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 916/1838] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:17 2022] PUT /identity/v3/projects/45f1692dd3b04dcdb5eca27a9658c267/users/a7fbba29274445c6a6277010243ef066/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:17.191103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fd637-2143-48b6-9618-5d819c2ec6de admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:17.227021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 923/1839] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:17 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:17.227021 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae55df-b62d-4327-a940-7ee75e13312c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:17.265964 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fd637-2143-48b6-9618-5d819c2ec6de admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:17.291658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae55df-b62d-4327-a940-7ee75e13312c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:17.297159 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ebf7b-64de-401c-99f7-eae6c74d12bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:17.297824 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ebf7b-64de-401c-99f7-eae6c74d12bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.298270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ebf7b-64de-401c-99f7-eae6c74d12bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.298513 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ebf7b-64de-401c-99f7-eae6c74d12bb admin admin] PATH_INFO: `/v3/projects/5409e4b7f8ad47d18baf935ffa7adeb0/users/a91a9c0b80cb44f4905dff83a9809d08/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.325156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ebf7b-64de-401c-99f7-eae6c74d12bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5409e4b7f8ad47d18baf935ffa7adeb0, user_id=a91a9c0b80cb44f4905dff83a9809d08, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:17.329729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ebf7b-64de-401c-99f7-eae6c74d12bb admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.338250 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb50d4-07c7-42ae-a98a-dcab5bbd470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:17.339042 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb50d4-07c7-42ae-a98a-dcab5bbd470b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.339627 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb50d4-07c7-42ae-a98a-dcab5bbd470b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.339885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb50d4-07c7-42ae-a98a-dcab5bbd470b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.340830 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb50d4-07c7-42ae-a98a-dcab5bbd470b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:17.342871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb50d4-07c7-42ae-a98a-dcab5bbd470b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.352108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 924/1840] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:17 2022] PUT /identity/v3/projects/5409e4b7f8ad47d18baf935ffa7adeb0/users/a91a9c0b80cb44f4905dff83a9809d08/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:17.353765 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc956090-811d-47f7-9d61-ab73cb82d53d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.354057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc956090-811d-47f7-9d61-ab73cb82d53d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.354333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc956090-811d-47f7-9d61-ab73cb82d53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.373089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 917/1841] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:17.374018 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb50d4-07c7-42ae-a98a-dcab5bbd470b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:17.392371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb50d4-07c7-42ae-a98a-dcab5bbd470b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:17.394260 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-fc956090-811d-47f7-9d61-ab73cb82d53d None None] MFA Rules not processed for user `a7fbba29274445c6a6277010243ef066`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:17.395605 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fc956090-811d-47f7-9d61-ab73cb82d53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:17.430024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:17.446568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:17.477474 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e126c5-5be1-4e52-864b-cb43338a6c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:17.478010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e126c5-5be1-4e52-864b-cb43338a6c0b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.478442 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e126c5-5be1-4e52-864b-cb43338a6c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.478721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e126c5-5be1-4e52-864b-cb43338a6c0b admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.479357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e126c5-5be1-4e52-864b-cb43338a6c0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:17.482313 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e126c5-5be1-4e52-864b-cb43338a6c0b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.495119 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 925/1842] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:17.497616 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9079da-9140-4349-bb4d-8217df5e25a5 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.498170 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9079da-9140-4349-bb4d-8217df5e25a5 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.498983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9079da-9140-4349-bb4d-8217df5e25a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.513439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 918/1843] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:17 2022] POST /identity/v3/users => generated 290 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:17.513439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e126c5-5be1-4e52-864b-cb43338a6c0b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:17.528058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e126c5-5be1-4e52-864b-cb43338a6c0b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:17.536801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3a02b-5141-4a7d-9b87-36f3115337d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:17.537608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ec9079da-9140-4349-bb4d-8217df5e25a5 None None] MFA Rules not processed for user `a91a9c0b80cb44f4905dff83a9809d08`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:17.538211 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3a02b-5141-4a7d-9b87-36f3115337d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.538934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3a02b-5141-4a7d-9b87-36f3115337d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.539044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ec9079da-9140-4349-bb4d-8217df5e25a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:17.539523 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3a02b-5141-4a7d-9b87-36f3115337d3 admin admin] PATH_INFO: `/v3/projects/99aee67549c3446d917f692a3df1a14a/users/2eca0b86fd544d83ac1f4e6ffa8c52d2/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.577873 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3a02b-5141-4a7d-9b87-36f3115337d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99aee67549c3446d917f692a3df1a14a, user_id=2eca0b86fd544d83ac1f4e6ffa8c52d2, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:17.583978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3a02b-5141-4a7d-9b87-36f3115337d3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.615306 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 919/1844] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:17 2022] PUT /identity/v3/projects/99aee67549c3446d917f692a3df1a14a/users/2eca0b86fd544d83ac1f4e6ffa8c52d2/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:17.616484 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3a02b-5141-4a7d-9b87-36f3115337d3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:17.678609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 926/1845] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:17.680274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9079da-9140-4349-bb4d-8217df5e25a5 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:17.705727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9079da-9140-4349-bb4d-8217df5e25a5 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:17.765428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3a02b-5141-4a7d-9b87-36f3115337d3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:17.771820 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5363edcb-2804-4c7b-9e09-506b79f9da10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:17.772620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363edcb-2804-4c7b-9e09-506b79f9da10 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.774430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363edcb-2804-4c7b-9e09-506b79f9da10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.774785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5363edcb-2804-4c7b-9e09-506b79f9da10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.775522 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363edcb-2804-4c7b-9e09-506b79f9da10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:17.779692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5363edcb-2804-4c7b-9e09-506b79f9da10 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.823444 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 920/1846] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:17 2022] POST /identity/v3/projects => generated 387 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:17.825450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921958a-7c72-4d87-92be-fb3cc0ef873a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.825752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921958a-7c72-4d87-92be-fb3cc0ef873a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.826033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a921958a-7c72-4d87-92be-fb3cc0ef873a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.852994 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e72f0-2715-4d31-96b5-8f419105848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:17.853614 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e72f0-2715-4d31-96b5-8f419105848f admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:17.853890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e72f0-2715-4d31-96b5-8f419105848f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:17.854157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050e72f0-2715-4d31-96b5-8f419105848f admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:17.854990 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e72f0-2715-4d31-96b5-8f419105848f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:17.856897 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050e72f0-2715-4d31-96b5-8f419105848f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:17.870704 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a921958a-7c72-4d87-92be-fb3cc0ef873a None None] MFA Rules not processed for user `2eca0b86fd544d83ac1f4e6ffa8c52d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:17.872557 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a921958a-7c72-4d87-92be-fb3cc0ef873a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:17.876597 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 927/1847] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:17.877709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e72f0-2715-4d31-96b5-8f419105848f admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:17.909237 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050e72f0-2715-4d31-96b5-8f419105848f admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:18.034763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:18.052380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088c827-65eb-4573-aa4a-bf7fc16f2b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:18.053073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088c827-65eb-4573-aa4a-bf7fc16f2b28 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.053357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088c827-65eb-4573-aa4a-bf7fc16f2b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.053629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f088c827-65eb-4573-aa4a-bf7fc16f2b28 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.054261 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088c827-65eb-4573-aa4a-bf7fc16f2b28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:18.056195 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f088c827-65eb-4573-aa4a-bf7fc16f2b28 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:18.063747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 921/1848] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:18.066204 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921958a-7c72-4d87-92be-fb3cc0ef873a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.085023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a921958a-7c72-4d87-92be-fb3cc0ef873a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:18.091571 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd279b-5340-4444-b393-d069b9d81277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:18.092507 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd279b-5340-4444-b393-d069b9d81277 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.093082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd279b-5340-4444-b393-d069b9d81277 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.094291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd279b-5340-4444-b393-d069b9d81277 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.095132 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd279b-5340-4444-b393-d069b9d81277 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:18.098149 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd279b-5340-4444-b393-d069b9d81277 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:18.102091 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 928/1849] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:17 2022] POST /identity/v3/projects => generated 365 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:18.103027 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088c827-65eb-4573-aa4a-bf7fc16f2b28 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.123269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:18.141551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 922/1850] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:18 2022] POST /identity/v3/users => generated 300 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:18.143154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd279b-5340-4444-b393-d069b9d81277 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.156137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd279b-5340-4444-b393-d069b9d81277 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:18.196542 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f088c827-65eb-4573-aa4a-bf7fc16f2b28 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:18.202025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd34c90-ffde-4293-a06c-7eb7aaaccb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:18.202721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd34c90-ffde-4293-a06c-7eb7aaaccb94 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.203010 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd34c90-ffde-4293-a06c-7eb7aaaccb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.203701 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd34c90-ffde-4293-a06c-7eb7aaaccb94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.204083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd34c90-ffde-4293-a06c-7eb7aaaccb94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:18.205803 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd34c90-ffde-4293-a06c-7eb7aaaccb94 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:18.218553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 929/1851] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:18.219783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd34c90-ffde-4293-a06c-7eb7aaaccb94 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.233834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd34c90-ffde-4293-a06c-7eb7aaaccb94 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:18.240470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdf2d0-2323-4ad7-8867-a941aad658f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:18.241595 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdf2d0-2323-4ad7-8867-a941aad658f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.242466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdf2d0-2323-4ad7-8867-a941aad658f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.242961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffdf2d0-2323-4ad7-8867-a941aad658f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.244696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdf2d0-2323-4ad7-8867-a941aad658f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:18.248308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffdf2d0-2323-4ad7-8867-a941aad658f7 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:18.275546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 930/1852] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:18 2022] POST /identity/v3/users => generated 289 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:18.276373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdf2d0-2323-4ad7-8867-a941aad658f7 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.289118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffdf2d0-2323-4ad7-8867-a941aad658f7 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:18.294922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a7a24-e33c-4cd0-967b-122147ddc30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:18.295699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a7a24-e33c-4cd0-967b-122147ddc30d admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.296023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a7a24-e33c-4cd0-967b-122147ddc30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.296300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a7a24-e33c-4cd0-967b-122147ddc30d admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.297035 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a7a24-e33c-4cd0-967b-122147ddc30d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:18.298065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a121db9-ea27-4e0a-9804-2832833148e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:18.298726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a7a24-e33c-4cd0-967b-122147ddc30d admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:18.298846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a121db9-ea27-4e0a-9804-2832833148e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.299055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a121db9-ea27-4e0a-9804-2832833148e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.299338 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a121db9-ea27-4e0a-9804-2832833148e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.300117 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a121db9-ea27-4e0a-9804-2832833148e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:18.302138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a121db9-ea27-4e0a-9804-2832833148e2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:18.318941 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 931/1853] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:18.319824 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a7a24-e33c-4cd0-967b-122147ddc30d admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.335459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a7a24-e33c-4cd0-967b-122147ddc30d admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:18.340872 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241828a0-57cf-4e11-b2b7-93651c7870a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:18.341844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241828a0-57cf-4e11-b2b7-93651c7870a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.342222 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241828a0-57cf-4e11-b2b7-93651c7870a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.342586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241828a0-57cf-4e11-b2b7-93651c7870a0 admin admin] PATH_INFO: `/v3/projects/c4dfa22083a245668cdc79464e6b2c5d/users/51b7026027d543f3a8f485f8951f064e/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.349830 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 923/1854] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:18 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:18.350996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a121db9-ea27-4e0a-9804-2832833148e2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.361345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241828a0-57cf-4e11-b2b7-93651c7870a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4dfa22083a245668cdc79464e6b2c5d, user_id=51b7026027d543f3a8f485f8951f064e, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:18.364485 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241828a0-57cf-4e11-b2b7-93651c7870a0 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:18.386979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 932/1855] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:18 2022] PUT /identity/v3/projects/c4dfa22083a245668cdc79464e6b2c5d/users/51b7026027d543f3a8f485f8951f064e/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:18.396375 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241828a0-57cf-4e11-b2b7-93651c7870a0 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.509338 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a121db9-ea27-4e0a-9804-2832833148e2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:18.546319 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241828a0-57cf-4e11-b2b7-93651c7870a0 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:18.563157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8a085-2981-4bff-922c-c2ca942779ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:18.563586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8a085-2981-4bff-922c-c2ca942779ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.563874 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8a085-2981-4bff-922c-c2ca942779ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.564153 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8a085-2981-4bff-922c-c2ca942779ec admin admin] PATH_INFO: `/v3/projects/76501dea40f347999a36b2af51dc7594/users/a7b792e788b14112a03fa60632a01c47/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.594720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b6ef9-62a1-488d-82e7-9c841f272468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:18.595621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b6ef9-62a1-488d-82e7-9c841f272468 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.595909 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b6ef9-62a1-488d-82e7-9c841f272468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.596531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2b6ef9-62a1-488d-82e7-9c841f272468 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.597751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b6ef9-62a1-488d-82e7-9c841f272468 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:18.599740 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2b6ef9-62a1-488d-82e7-9c841f272468 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:18.600735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8a085-2981-4bff-922c-c2ca942779ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=76501dea40f347999a36b2af51dc7594, user_id=a7b792e788b14112a03fa60632a01c47, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:18.603556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8a085-2981-4bff-922c-c2ca942779ec admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:18.613855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 924/1856] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:18.613855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b6ef9-62a1-488d-82e7-9c841f272468 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.624945 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2b6ef9-62a1-488d-82e7-9c841f272468 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:18.630718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb46b4-3fdf-4831-98ef-eb983182ed59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:18.630900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:18.631351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb46b4-3fdf-4831-98ef-eb983182ed59 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.631632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb46b4-3fdf-4831-98ef-eb983182ed59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.632267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb46b4-3fdf-4831-98ef-eb983182ed59 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.632962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb46b4-3fdf-4831-98ef-eb983182ed59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:18.635561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb46b4-3fdf-4831-98ef-eb983182ed59 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:18.646044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 933/1857] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:18 2022] PUT /identity/v3/projects/76501dea40f347999a36b2af51dc7594/users/a7b792e788b14112a03fa60632a01c47/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:18.650955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d05f9b-ac4a-4914-86c9-feaa4c34dd0e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.651722 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d05f9b-ac4a-4914-86c9-feaa4c34dd0e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.651722 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d05f9b-ac4a-4914-86c9-feaa4c34dd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.670113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 925/1858] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:18 2022] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:18.670113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb46b4-3fdf-4831-98ef-eb983182ed59 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.702468 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb46b4-3fdf-4831-98ef-eb983182ed59 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:18.727245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:18.729433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d1d05f9b-ac4a-4914-86c9-feaa4c34dd0e None None] MFA Rules not processed for user `51b7026027d543f3a8f485f8951f064e`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:18.731275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d1d05f9b-ac4a-4914-86c9-feaa4c34dd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:18.798387 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468cc60-c481-4ee3-babe-9911987288f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:18.799099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468cc60-c481-4ee3-babe-9911987288f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.799481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468cc60-c481-4ee3-babe-9911987288f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.799831 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468cc60-c481-4ee3-babe-9911987288f0 admin admin] PATH_INFO: `/v3/projects/78bf9e030213446aafd905f87f2abc1e/users/4910ce555e254cf7a69d8a0e5d4418d1/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.815934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 934/1859] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:18.815934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d05f9b-ac4a-4914-86c9-feaa4c34dd0e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.818207 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468cc60-c481-4ee3-babe-9911987288f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78bf9e030213446aafd905f87f2abc1e, user_id=4910ce555e254cf7a69d8a0e5d4418d1, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:18.821152 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b468cc60-c481-4ee3-babe-9911987288f0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:18.824930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d05f9b-ac4a-4914-86c9-feaa4c34dd0e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:18.830421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda0ec0-3541-4a56-abb5-a6330d1927a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:18.831024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda0ec0-3541-4a56-abb5-a6330d1927a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.831298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda0ec0-3541-4a56-abb5-a6330d1927a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.831568 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda0ec0-3541-4a56-abb5-a6330d1927a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.832204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda0ec0-3541-4a56-abb5-a6330d1927a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:18.833886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda0ec0-3541-4a56-abb5-a6330d1927a5 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:18.842582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 926/1860] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:18 2022] PUT /identity/v3/projects/78bf9e030213446aafd905f87f2abc1e/users/4910ce555e254cf7a69d8a0e5d4418d1/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:18.845562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468cc60-c481-4ee3-babe-9911987288f0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.845694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 935/1861] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:18.845694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda0ec0-3541-4a56-abb5-a6330d1927a5 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.856527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda0ec0-3541-4a56-abb5-a6330d1927a5 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:18.907990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b468cc60-c481-4ee3-babe-9911987288f0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:18.912601 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ea1e5-66a4-4438-851b-69e149345c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:18.912774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3dd98-99dd-4975-b31a-08df5546ee2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:18.913239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ea1e5-66a4-4438-851b-69e149345c89 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.913362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3dd98-99dd-4975-b31a-08df5546ee2a admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.913514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ea1e5-66a4-4438-851b-69e149345c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.913642 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3dd98-99dd-4975-b31a-08df5546ee2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.913777 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9ea1e5-66a4-4438-851b-69e149345c89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.913923 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b3dd98-99dd-4975-b31a-08df5546ee2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.914399 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ea1e5-66a4-4438-851b-69e149345c89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:18.914560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3dd98-99dd-4975-b31a-08df5546ee2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:18.916119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b3dd98-99dd-4975-b31a-08df5546ee2a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:18.916281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9ea1e5-66a4-4438-851b-69e149345c89 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:18.926775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 927/1862] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:18.927578 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3dd98-99dd-4975-b31a-08df5546ee2a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.937559 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b3dd98-99dd-4975-b31a-08df5546ee2a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:18.942169 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff3aeb-0cac-4725-8fc8-f67ae0e9fcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:18.942754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff3aeb-0cac-4725-8fc8-f67ae0e9fcc4 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:18.943036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff3aeb-0cac-4725-8fc8-f67ae0e9fcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:18.943325 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ff3aeb-0cac-4725-8fc8-f67ae0e9fcc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:18.943939 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff3aeb-0cac-4725-8fc8-f67ae0e9fcc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:18.944794 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 936/1863] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:18 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:18.945530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ff3aeb-0cac-4725-8fc8-f67ae0e9fcc4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:18.945867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ea1e5-66a4-4438-851b-69e149345c89 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.956703 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 928/1864] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:18.957453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff3aeb-0cac-4725-8fc8-f67ae0e9fcc4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:18.966791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ff3aeb-0cac-4725-8fc8-f67ae0e9fcc4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:19.008869 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9ea1e5-66a4-4438-851b-69e149345c89 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:19.014096 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d12e7-c9c7-4ad7-8ed3-dd858bdc334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:19.015180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d12e7-c9c7-4ad7-8ed3-dd858bdc334a admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.015282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d12e7-c9c7-4ad7-8ed3-dd858bdc334a admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.015664 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8d12e7-c9c7-4ad7-8ed3-dd858bdc334a admin admin] PATH_INFO: `/v3/projects/76501dea40f347999a36b2af51dc7594/users/a7b792e788b14112a03fa60632a01c47/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.017903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d12e7-c9c7-4ad7-8ed3-dd858bdc334a admin admin] RBAC: Authorizing `identity:create_grant(project_id=76501dea40f347999a36b2af51dc7594, user_id=a7b792e788b14112a03fa60632a01c47, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:19.020678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8d12e7-c9c7-4ad7-8ed3-dd858bdc334a admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:19.025574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:19.028439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac95d38-bbbd-4658-8196-ac66630b5725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:19.029245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95d38-bbbd-4658-8196-ac66630b5725 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.029788 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95d38-bbbd-4658-8196-ac66630b5725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.030067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac95d38-bbbd-4658-8196-ac66630b5725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.031066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac95d38-bbbd-4658-8196-ac66630b5725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:19.032816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac95d38-bbbd-4658-8196-ac66630b5725 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:19.040757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 937/1865] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:18 2022] PUT /identity/v3/projects/76501dea40f347999a36b2af51dc7594/users/a7b792e788b14112a03fa60632a01c47/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:19.041645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d12e7-c9c7-4ad7-8ed3-dd858bdc334a admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:19.045568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 929/1866] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:19.046387 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac95d38-bbbd-4658-8196-ac66630b5725 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:19.062973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac95d38-bbbd-4658-8196-ac66630b5725 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:19.076177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:19.131575 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8d12e7-c9c7-4ad7-8ed3-dd858bdc334a admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:19.136458 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c1a83-3c7c-4872-94f2-45111970223c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:19.137664 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c1a83-3c7c-4872-94f2-45111970223c admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.137969 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c1a83-3c7c-4872-94f2-45111970223c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.138237 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c1a83-3c7c-4872-94f2-45111970223c admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.138864 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c1a83-3c7c-4872-94f2-45111970223c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:19.140840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c1a83-3c7c-4872-94f2-45111970223c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:19.148840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c998e4-165e-4a28-89c7-bd6450fee592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:19.149704 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c998e4-165e-4a28-89c7-bd6450fee592 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.150063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c998e4-165e-4a28-89c7-bd6450fee592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.150403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c998e4-165e-4a28-89c7-bd6450fee592 admin admin] PATH_INFO: `/v3/projects/78bf9e030213446aafd905f87f2abc1e/users/4910ce555e254cf7a69d8a0e5d4418d1/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.153870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c998e4-165e-4a28-89c7-bd6450fee592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78bf9e030213446aafd905f87f2abc1e, user_id=4910ce555e254cf7a69d8a0e5d4418d1, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:19.156815 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c998e4-165e-4a28-89c7-bd6450fee592 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:19.167795 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 938/1867] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:19 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:19.170017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 930/1868] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:19 2022] PUT /identity/v3/projects/78bf9e030213446aafd905f87f2abc1e/users/4910ce555e254cf7a69d8a0e5d4418d1/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:19.170699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b1f7f-4a94-4107-bd0e-fd413e18d69b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.171039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c998e4-165e-4a28-89c7-bd6450fee592 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:19.171372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b1f7f-4a94-4107-bd0e-fd413e18d69b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.171817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b1f7f-4a94-4107-bd0e-fd413e18d69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.210499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b09b1f7f-4a94-4107-bd0e-fd413e18d69b None None] MFA Rules not processed for user `a7b792e788b14112a03fa60632a01c47`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:19.216846 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b09b1f7f-4a94-4107-bd0e-fd413e18d69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:19.261767 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c998e4-165e-4a28-89c7-bd6450fee592 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:19.266669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a2c76-b06b-4258-b9cf-747234da6590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:19.267332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a2c76-b06b-4258-b9cf-747234da6590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.267610 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a2c76-b06b-4258-b9cf-747234da6590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.267883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a2c76-b06b-4258-b9cf-747234da6590 admin admin] PATH_INFO: `/v3/projects/26cd1f530abd40a895d027015fbf0996/users/38eaedd60f0a478593d406f2ec0f7a53/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.283325 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a2c76-b06b-4258-b9cf-747234da6590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26cd1f530abd40a895d027015fbf0996, user_id=38eaedd60f0a478593d406f2ec0f7a53, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:19.286035 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a2c76-b06b-4258-b9cf-747234da6590 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:19.299372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 931/1869] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:19 2022] PUT /identity/v3/projects/26cd1f530abd40a895d027015fbf0996/users/38eaedd60f0a478593d406f2ec0f7a53/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:19.300300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a2c76-b06b-4258-b9cf-747234da6590 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:19.304261 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 939/1870] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:19 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:19.305628 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9cccf-d13a-42d1-aba3-06a071a5c89c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.305987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9cccf-d13a-42d1-aba3-06a071a5c89c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.306337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9cccf-d13a-42d1-aba3-06a071a5c89c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.334446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e5c9cccf-d13a-42d1-aba3-06a071a5c89c None None] MFA Rules not processed for user `4910ce555e254cf7a69d8a0e5d4418d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:19.335579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e5c9cccf-d13a-42d1-aba3-06a071a5c89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:19.375470 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a2c76-b06b-4258-b9cf-747234da6590 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:19.381081 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71333037-139b-4a5b-b671-ad74779591eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:19.381791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71333037-139b-4a5b-b671-ad74779591eb admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.382111 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71333037-139b-4a5b-b671-ad74779591eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.382446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71333037-139b-4a5b-b671-ad74779591eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.383315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71333037-139b-4a5b-b671-ad74779591eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:19.385332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71333037-139b-4a5b-b671-ad74779591eb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:19.396210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 932/1871] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:19.397573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf1ee-7f3b-47ba-b477-7cb20b3876d4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.397820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:19.398046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf1ee-7f3b-47ba-b477-7cb20b3876d4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.398430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf1ee-7f3b-47ba-b477-7cb20b3876d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.412315 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 940/1872] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:19 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:19.412315 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9cccf-d13a-42d1-aba3-06a071a5c89c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:19.413627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e5c9cccf-d13a-42d1-aba3-06a071a5c89c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:19.429116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-85abf1ee-7f3b-47ba-b477-7cb20b3876d4 None None] MFA Rules not processed for user `38eaedd60f0a478593d406f2ec0f7a53`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:19.430331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-85abf1ee-7f3b-47ba-b477-7cb20b3876d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:19.447495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:19.470227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9cccf-d13a-42d1-aba3-06a071a5c89c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:19.473808 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0571d-e129-49c5-8d66-050ef892b514 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:19.474439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0571d-e129-49c5-8d66-050ef892b514 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.474713 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0571d-e129-49c5-8d66-050ef892b514 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.474982 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0571d-e129-49c5-8d66-050ef892b514 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.503071 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 933/1873] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:19.504286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abf1ee-7f3b-47ba-b477-7cb20b3876d4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:19.541176 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abf1ee-7f3b-47ba-b477-7cb20b3876d4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:19.554958 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d5cf4-0236-44ba-8353-9ad1dcfbd481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:19.557667 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d5cf4-0236-44ba-8353-9ad1dcfbd481 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.559729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0571d-e129-49c5-8d66-050ef892b514 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:19.560120 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d5cf4-0236-44ba-8353-9ad1dcfbd481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.560479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511d5cf4-0236-44ba-8353-9ad1dcfbd481 admin admin] PATH_INFO: `/v3/projects/2dfc71d7c9944c8ab67391f7ef44cfc7/users/5ea5071e4f114f8db7084ae9822dbfdb/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.561842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c0571d-e129-49c5-8d66-050ef892b514 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:19.573555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 941/1874] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:19 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:19.574234 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0571d-e129-49c5-8d66-050ef892b514 service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:19.575606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-90c0571d-e129-49c5-8d66-050ef892b514 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:19.587639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d5cf4-0236-44ba-8353-9ad1dcfbd481 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dfc71d7c9944c8ab67391f7ef44cfc7, user_id=5ea5071e4f114f8db7084ae9822dbfdb, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:19.590602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0571d-e129-49c5-8d66-050ef892b514 service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:19.591207 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511d5cf4-0236-44ba-8353-9ad1dcfbd481 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:19.596288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b77b25-2b92-4ad5-ba66-2831b404527a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:19.597849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b77b25-2b92-4ad5-ba66-2831b404527a service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.598640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b77b25-2b92-4ad5-ba66-2831b404527a service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.598933 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b77b25-2b92-4ad5-ba66-2831b404527a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.611026 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b77b25-2b92-4ad5-ba66-2831b404527a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:19.612584 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b77b25-2b92-4ad5-ba66-2831b404527a service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:19.614479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 934/1875] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:19 2022] PUT /identity/v3/projects/2dfc71d7c9944c8ab67391f7ef44cfc7/users/5ea5071e4f114f8db7084ae9822dbfdb/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:19.615370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d5cf4-0236-44ba-8353-9ad1dcfbd481 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:19.641091 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 942/1876] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:19.641807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b77b25-2b92-4ad5-ba66-2831b404527a service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:19.664141 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b77b25-2b92-4ad5-ba66-2831b404527a service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:19.769452 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511d5cf4-0236-44ba-8353-9ad1dcfbd481 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:19.774643 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d79b8-e229-4619-8cff-face34ec1526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:19.775260 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d79b8-e229-4619-8cff-face34ec1526 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.775553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d79b8-e229-4619-8cff-face34ec1526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.775827 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d79b8-e229-4619-8cff-face34ec1526 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.776998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d79b8-e229-4619-8cff-face34ec1526 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:19.778311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef01e-60a6-4834-be82-d058d1d57cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:19.779582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d79b8-e229-4619-8cff-face34ec1526 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:19.779720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef01e-60a6-4834-be82-d058d1d57cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.780059 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef01e-60a6-4834-be82-d058d1d57cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.780435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8ef01e-60a6-4834-be82-d058d1d57cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.781263 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ef01e-60a6-4834-be82-d058d1d57cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:19.783054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8ef01e-60a6-4834-be82-d058d1d57cd5 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:19.798130 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 943/1877] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:19.798130 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef01e-60a6-4834-be82-d058d1d57cd5 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:19.806870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8ef01e-60a6-4834-be82-d058d1d57cd5 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:19.811846 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7078b-596d-49c2-bc7c-325578412ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:19.812661 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7078b-596d-49c2-bc7c-325578412ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.812815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7078b-596d-49c2-bc7c-325578412ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.813171 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b7078b-596d-49c2-bc7c-325578412ccd admin admin] PATH_INFO: `/v3/users/a7fbba29274445c6a6277010243ef066` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.814597 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7078b-596d-49c2-bc7c-325578412ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7fbba29274445c6a6277010243ef066)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:19.817888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b7078b-596d-49c2-bc7c-325578412ccd admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:19.830205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 935/1878] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:19 2022] POST /identity/v3/projects => generated 375 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:19.831940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d79b8-e229-4619-8cff-face34ec1526 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:19.885291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:19.937092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d79b8-e229-4619-8cff-face34ec1526 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:19.948888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e5b7078b-596d-49c2-bc7c-325578412ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7fbba29274445c6a6277010243ef066'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:19.952024 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319d037-4a81-4e32-81fa-120eac70332a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:19.953734 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d037-4a81-4e32-81fa-120eac70332a service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:19.955093 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d037-4a81-4e32-81fa-120eac70332a service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:19.955603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f319d037-4a81-4e32-81fa-120eac70332a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:19.958778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e5b7078b-596d-49c2-bc7c-325578412ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7fbba29274445c6a6277010243ef066'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:19.974657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e5b7078b-596d-49c2-bc7c-325578412ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7fbba29274445c6a6277010243ef066'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:19.975697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e5b7078b-596d-49c2-bc7c-325578412ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7fbba29274445c6a6277010243ef066'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:19.986730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e5b7078b-596d-49c2-bc7c-325578412ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7fbba29274445c6a6277010243ef066'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:20.000701 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 944/1879] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:19 2022] DELETE /identity/v3/users/a7fbba29274445c6a6277010243ef066 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:20.001779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7078b-596d-49c2-bc7c-325578412ccd admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:20.005807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e5b7078b-596d-49c2-bc7c-325578412ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:20.023009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:20.056876 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319d037-4a81-4e32-81fa-120eac70332a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:20.058909 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f319d037-4a81-4e32-81fa-120eac70332a service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:20.071030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 936/1880] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:20.071334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319d037-4a81-4e32-81fa-120eac70332a service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:20.169494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b7078b-596d-49c2-bc7c-325578412ccd admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:20.185302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8b1d8-17e5-4003-afa6-87636cbebb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:20.187394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8b1d8-17e5-4003-afa6-87636cbebb5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:20.188011 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8b1d8-17e5-4003-afa6-87636cbebb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:20.189164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8b1d8-17e5-4003-afa6-87636cbebb5b admin admin] PATH_INFO: `/v3/projects/2dfc71d7c9944c8ab67391f7ef44cfc7/users/5ea5071e4f114f8db7084ae9822dbfdb/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:20.195919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8b1d8-17e5-4003-afa6-87636cbebb5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dfc71d7c9944c8ab67391f7ef44cfc7, user_id=5ea5071e4f114f8db7084ae9822dbfdb, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:20.199962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8b1d8-17e5-4003-afa6-87636cbebb5b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:20.220146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f319d037-4a81-4e32-81fa-120eac70332a service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:20.239509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 945/1881] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:20 2022] PUT /identity/v3/projects/2dfc71d7c9944c8ab67391f7ef44cfc7/users/5ea5071e4f114f8db7084ae9822dbfdb/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:20.241156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8bbc9-5ad6-45d6-a7fa-eb21b9739a1a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:20.241522 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8bbc9-5ad6-45d6-a7fa-eb21b9739a1a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:20.241875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d8bbc9-5ad6-45d6-a7fa-eb21b9739a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:20.271171 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-95d8bbc9-5ad6-45d6-a7fa-eb21b9739a1a None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:20.273228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-95d8bbc9-5ad6-45d6-a7fa-eb21b9739a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:20.377370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7396022-4cef-4990-aab7-5babcc1a4a46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:20.378190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7396022-4cef-4990-aab7-5babcc1a4a46 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:20.378467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7396022-4cef-4990-aab7-5babcc1a4a46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:20.378741 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7396022-4cef-4990-aab7-5babcc1a4a46 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:20.381300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7396022-4cef-4990-aab7-5babcc1a4a46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:20.386000 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7396022-4cef-4990-aab7-5babcc1a4a46 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:20.406607 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 946/1882] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:20.410462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae34eb-e0a3-4ef8-a0fa-ec9feedbd63a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:20.411150 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae34eb-e0a3-4ef8-a0fa-ec9feedbd63a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:20.411672 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae34eb-e0a3-4ef8-a0fa-ec9feedbd63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:20.441824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 937/1883] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:20 2022] POST /identity/v3/users => generated 294 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:20.449025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77814b58-7ed0-4c09-8b25-5157790889e3 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:20.449341 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77814b58-7ed0-4c09-8b25-5157790889e3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:20.452004 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77814b58-7ed0-4c09-8b25-5157790889e3 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:20.454567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 938/1884] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 13 06:38:20 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:38:20.456091 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77814b58-7ed0-4c09-8b25-5157790889e3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:20.458273 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-77814b58-7ed0-4c09-8b25-5157790889e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:20.486772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6eae34eb-e0a3-4ef8-a0fa-ec9feedbd63a None None] MFA Rules not processed for user `5ea5071e4f114f8db7084ae9822dbfdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:20.488380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6eae34eb-e0a3-4ef8-a0fa-ec9feedbd63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:20.547483 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:20.587713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77814b58-7ed0-4c09-8b25-5157790889e3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:20.592648 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1ba263-e1eb-4f95-b9c6-5dfcd67fdbc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:20.593429 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ba263-e1eb-4f95-b9c6-5dfcd67fdbc0 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:20.593823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ba263-e1eb-4f95-b9c6-5dfcd67fdbc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:20.594330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1ba263-e1eb-4f95-b9c6-5dfcd67fdbc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:20.595931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 947/1885] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:20.597031 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae34eb-e0a3-4ef8-a0fa-ec9feedbd63a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:20.599360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6eae34eb-e0a3-4ef8-a0fa-ec9feedbd63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:20.632485 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae34eb-e0a3-4ef8-a0fa-ec9feedbd63a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:20.633925 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ba263-e1eb-4f95-b9c6-5dfcd67fdbc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:20.635648 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1ba263-e1eb-4f95-b9c6-5dfcd67fdbc0 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:20.645155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6926d8e-2693-47f9-ac77-8e55e559d47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:20.648278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6926d8e-2693-47f9-ac77-8e55e559d47c admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:20.648966 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6926d8e-2693-47f9-ac77-8e55e559d47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:20.649149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6926d8e-2693-47f9-ac77-8e55e559d47c admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:20.650659 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 939/1886] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:20.650798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6926d8e-2693-47f9-ac77-8e55e559d47c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:20.652449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c7575-dffa-42a6-9c2c-2804c09597e1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:20.652914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c7575-dffa-42a6-9c2c-2804c09597e1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:20.653229 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c7575-dffa-42a6-9c2c-2804c09597e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:20.656927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6926d8e-2693-47f9-ac77-8e55e559d47c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:20.680569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 948/1887] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:20.681541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6926d8e-2693-47f9-ac77-8e55e559d47c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:20.684367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7b7c7575-dffa-42a6-9c2c-2804c09597e1 None None] MFA Rules not processed for user `7fbb67072ba544e39073787eb25fcf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:20.686257 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7b7c7575-dffa-42a6-9c2c-2804c09597e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:20.689390 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e6926d8e-2693-47f9-ac77-8e55e559d47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:20.702885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:20.803145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6926d8e-2693-47f9-ac77-8e55e559d47c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:20.808150 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09a1ae-7824-4c02-b673-45158f40868a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:20.808498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09a1ae-7824-4c02-b673-45158f40868a service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:20.809309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09a1ae-7824-4c02-b673-45158f40868a service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:20.809587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09a1ae-7824-4c02-b673-45158f40868a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:20.811669 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-bf09a1ae-7824-4c02-b673-45158f40868a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:20.815046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 940/1888] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 13 06:38:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:20.816516 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c7575-dffa-42a6-9c2c-2804c09597e1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:20.829528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c7575-dffa-42a6-9c2c-2804c09597e1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:20.835373 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a853554-5cc3-411c-b5ee-3fadda99e52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:20.836117 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a853554-5cc3-411c-b5ee-3fadda99e52c admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:20.836576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a853554-5cc3-411c-b5ee-3fadda99e52c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:20.836957 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a853554-5cc3-411c-b5ee-3fadda99e52c admin admin] PATH_INFO: `/v3/projects/6bf1a7e9daa4475f84e8b924dc446df3/users/81fff4da780346dcab0c224bf20cf58b/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:20.856963 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a853554-5cc3-411c-b5ee-3fadda99e52c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf1a7e9daa4475f84e8b924dc446df3, user_id=81fff4da780346dcab0c224bf20cf58b, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:20.861354 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a853554-5cc3-411c-b5ee-3fadda99e52c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:20.880259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 941/1889] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:20 2022] PUT /identity/v3/projects/6bf1a7e9daa4475f84e8b924dc446df3/users/81fff4da780346dcab0c224bf20cf58b/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:20.881678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a853554-5cc3-411c-b5ee-3fadda99e52c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:20.884106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7a853554-5cc3-411c-b5ee-3fadda99e52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:20.926739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09a1ae-7824-4c02-b673-45158f40868a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:20.928484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09a1ae-7824-4c02-b673-45158f40868a service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:20.942726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 949/1890] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:20 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:20.943678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09a1ae-7824-4c02-b673-45158f40868a service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:20.957840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09a1ae-7824-4c02-b673-45158f40868a service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:21.042728 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d53ac-aa3c-4793-817d-34f847836989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:21.044445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d53ac-aa3c-4793-817d-34f847836989 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:21.044836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d53ac-aa3c-4793-817d-34f847836989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:21.046824 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3d53ac-aa3c-4793-817d-34f847836989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:21.047587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d53ac-aa3c-4793-817d-34f847836989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:21.049324 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3d53ac-aa3c-4793-817d-34f847836989 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:21.056092 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:21.063062 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 950/1891] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:21.067487 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d53ac-aa3c-4793-817d-34f847836989 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:21.067758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a853554-5cc3-411c-b5ee-3fadda99e52c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:21.078746 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0cc94-601d-4db5-8032-a5cda30d2c09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:21.081646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3d53ac-aa3c-4793-817d-34f847836989 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:21.081795 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0cc94-601d-4db5-8032-a5cda30d2c09 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:21.082220 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0cc94-601d-4db5-8032-a5cda30d2c09 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:21.082512 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0cc94-601d-4db5-8032-a5cda30d2c09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:21.088862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2386719c-7f56-469f-b877-53f22c9e8a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:21.089650 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386719c-7f56-469f-b877-53f22c9e8a3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:21.090053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386719c-7f56-469f-b877-53f22c9e8a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:21.090419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2386719c-7f56-469f-b877-53f22c9e8a3f admin admin] PATH_INFO: `/v3/projects/6bf1a7e9daa4475f84e8b924dc446df3/users/81fff4da780346dcab0c224bf20cf58b/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:21.092526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386719c-7f56-469f-b877-53f22c9e8a3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf1a7e9daa4475f84e8b924dc446df3, user_id=81fff4da780346dcab0c224bf20cf58b, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:21.095427 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2386719c-7f56-469f-b877-53f22c9e8a3f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:21.097237 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0cc94-601d-4db5-8032-a5cda30d2c09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:21.099870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0cc94-601d-4db5-8032-a5cda30d2c09 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:21.108047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 951/1892] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:21 2022] PUT /identity/v3/projects/6bf1a7e9daa4475f84e8b924dc446df3/users/81fff4da780346dcab0c224bf20cf58b/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:21.120797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953caff-ff00-442f-a912-eac44c72c5a6 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:21.121090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953caff-ff00-442f-a912-eac44c72c5a6 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:21.122001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9953caff-ff00-442f-a912-eac44c72c5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:21.152048 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 942/1893] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:21.169721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9953caff-ff00-442f-a912-eac44c72c5a6 None None] MFA Rules not processed for user `81fff4da780346dcab0c224bf20cf58b`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:21.171126 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9953caff-ff00-442f-a912-eac44c72c5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:21.219917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0cc94-601d-4db5-8032-a5cda30d2c09 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:21.225479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-89d0cc94-601d-4db5-8032-a5cda30d2c09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:21.253093 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0cc94-601d-4db5-8032-a5cda30d2c09 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:21.378788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 952/1894] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:21.388238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953caff-ff00-442f-a912-eac44c72c5a6 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:21.390207 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9953caff-ff00-442f-a912-eac44c72c5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:21.426262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc09ec5-587d-49b0-933e-9d8a2c063254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:21.429042 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09ec5-587d-49b0-933e-9d8a2c063254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:21.429325 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09ec5-587d-49b0-933e-9d8a2c063254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:21.429598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc09ec5-587d-49b0-933e-9d8a2c063254 admin admin] PATH_INFO: `/v3/projects/45f1692dd3b04dcdb5eca27a9658c267` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:21.435449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc09ec5-587d-49b0-933e-9d8a2c063254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45f1692dd3b04dcdb5eca27a9658c267)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:21.441215 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc09ec5-587d-49b0-933e-9d8a2c063254 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:21.463920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:21.537092 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9953caff-ff00-442f-a912-eac44c72c5a6 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:21.550997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bc6ea-1adb-45b5-ba44-f6ce476dd645 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:21.551676 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bc6ea-1adb-45b5-ba44-f6ce476dd645 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:21.552416 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bc6ea-1adb-45b5-ba44-f6ce476dd645 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:21.553627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bc6ea-1adb-45b5-ba44-f6ce476dd645 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:21.576945 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bc6ea-1adb-45b5-ba44-f6ce476dd645 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:21.578079 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dbc09ec5-587d-49b0-933e-9d8a2c063254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45f1692dd3b04dcdb5eca27a9658c267', 'request_id': 'req-dbc09ec5-587d-49b0-933e-9d8a2c063254'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:21.583328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bc6ea-1adb-45b5-ba44-f6ce476dd645 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:21.593422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dbc09ec5-587d-49b0-933e-9d8a2c063254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45f1692dd3b04dcdb5eca27a9658c267', 'request_id': 'req-dbc09ec5-587d-49b0-933e-9d8a2c063254'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:21.603761 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dbc09ec5-587d-49b0-933e-9d8a2c063254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45f1692dd3b04dcdb5eca27a9658c267', 'request_id': 'req-dbc09ec5-587d-49b0-933e-9d8a2c063254'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:21.618256 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 953/1895] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:21.633902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dbc09ec5-587d-49b0-933e-9d8a2c063254 admin admin] The token cache is being invalidate because project 45f1692dd3b04dcdb5eca27a9658c267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:21.634367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dbc09ec5-587d-49b0-933e-9d8a2c063254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:21.637718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dbc09ec5-587d-49b0-933e-9d8a2c063254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:21.641951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 943/1896] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:21 2022] DELETE /identity/v3/projects/45f1692dd3b04dcdb5eca27a9658c267 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:21.649288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bc6ea-1adb-45b5-ba44-f6ce476dd645 service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:21.686183 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc09ec5-587d-49b0-933e-9d8a2c063254 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:21.688090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-dbc09ec5-587d-49b0-933e-9d8a2c063254 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:21.694825 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bc6ea-1adb-45b5-ba44-f6ce476dd645 service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:21.810722 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc09ec5-587d-49b0-933e-9d8a2c063254 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:21.811678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785d691-5c5e-48a8-b01b-a191ccb72356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:21.812909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785d691-5c5e-48a8-b01b-a191ccb72356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:21.813614 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785d691-5c5e-48a8-b01b-a191ccb72356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:21.814546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785d691-5c5e-48a8-b01b-a191ccb72356 admin admin] PATH_INFO: `/v3/users/a7b792e788b14112a03fa60632a01c47` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:21.816062 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785d691-5c5e-48a8-b01b-a191ccb72356 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7b792e788b14112a03fa60632a01c47)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:21.818537 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4785d691-5c5e-48a8-b01b-a191ccb72356 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:21.822611 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ae4aa-19b4-4aba-9dd8-aba6c9df7844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:21.823320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ae4aa-19b4-4aba-9dd8-aba6c9df7844 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:21.823722 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ae4aa-19b4-4aba-9dd8-aba6c9df7844 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:21.824368 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26ae4aa-19b4-4aba-9dd8-aba6c9df7844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:21.827781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a26ae4aa-19b4-4aba-9dd8-aba6c9df7844 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:21.856539 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:21.921323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4785d691-5c5e-48a8-b01b-a191ccb72356 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7b792e788b14112a03fa60632a01c47'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:21.929753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4785d691-5c5e-48a8-b01b-a191ccb72356 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7b792e788b14112a03fa60632a01c47'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:21.932896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ae4aa-19b4-4aba-9dd8-aba6c9df7844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:21.937885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26ae4aa-19b4-4aba-9dd8-aba6c9df7844 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:21.945137 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4785d691-5c5e-48a8-b01b-a191ccb72356 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7b792e788b14112a03fa60632a01c47'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:21.945841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4785d691-5c5e-48a8-b01b-a191ccb72356 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7b792e788b14112a03fa60632a01c47'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:21.957223 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4785d691-5c5e-48a8-b01b-a191ccb72356 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7b792e788b14112a03fa60632a01c47'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:21.969880 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 954/1897] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:21 2022] DELETE /identity/v3/users/a7b792e788b14112a03fa60632a01c47 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:21.971887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 944/1898] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:22.444158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785d691-5c5e-48a8-b01b-a191ccb72356 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:22.445852 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4785d691-5c5e-48a8-b01b-a191ccb72356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:22.542496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785d691-5c5e-48a8-b01b-a191ccb72356 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:22.547823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9144eba-9624-4016-b00e-9643bc846ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:22.550083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9144eba-9624-4016-b00e-9643bc846ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:22.550382 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9144eba-9624-4016-b00e-9643bc846ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:22.550811 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9144eba-9624-4016-b00e-9643bc846ccd admin admin] PATH_INFO: `/v3/projects/76501dea40f347999a36b2af51dc7594` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:22.552069 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9144eba-9624-4016-b00e-9643bc846ccd admin admin] RBAC: Authorizing `identity:delete_project(project_id=76501dea40f347999a36b2af51dc7594)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:22.554011 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9144eba-9624-4016-b00e-9643bc846ccd admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:22.599574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ae4aa-19b4-4aba-9dd8-aba6c9df7844 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:22.601669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a26ae4aa-19b4-4aba-9dd8-aba6c9df7844 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:22.612823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26ae4aa-19b4-4aba-9dd8-aba6c9df7844 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:22.615310 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d9144eba-9624-4016-b00e-9643bc846ccd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76501dea40f347999a36b2af51dc7594', 'request_id': 'req-d9144eba-9624-4016-b00e-9643bc846ccd'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:22.630406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d9144eba-9624-4016-b00e-9643bc846ccd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76501dea40f347999a36b2af51dc7594', 'request_id': 'req-d9144eba-9624-4016-b00e-9643bc846ccd'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:22.638213 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d9144eba-9624-4016-b00e-9643bc846ccd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76501dea40f347999a36b2af51dc7594', 'request_id': 'req-d9144eba-9624-4016-b00e-9643bc846ccd'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:22.651147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d9144eba-9624-4016-b00e-9643bc846ccd admin admin] The token cache is being invalidate because project 76501dea40f347999a36b2af51dc7594 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:22.651967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d9144eba-9624-4016-b00e-9643bc846ccd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:22.653055 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d9144eba-9624-4016-b00e-9643bc846ccd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:22.656753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 955/1899] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:22 2022] DELETE /identity/v3/projects/76501dea40f347999a36b2af51dc7594 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:22.659496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62949736-f26a-4eb1-8e62-5231b70ddc2d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:22.659948 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62949736-f26a-4eb1-8e62-5231b70ddc2d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:22.660356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62949736-f26a-4eb1-8e62-5231b70ddc2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:22.683392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-62949736-f26a-4eb1-8e62-5231b70ddc2d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:22.685069 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-62949736-f26a-4eb1-8e62-5231b70ddc2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:22.686742 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a1c3e-d9ee-41d7-92df-87b3afe56579 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:22.687548 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a1c3e-d9ee-41d7-92df-87b3afe56579 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:22.688434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a1c3e-d9ee-41d7-92df-87b3afe56579 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:22.689148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a1c3e-d9ee-41d7-92df-87b3afe56579 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:22.693755 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-690a1c3e-d9ee-41d7-92df-87b3afe56579 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:22.701275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:22.705663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:22.767373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 956/1900] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:38:22.770957 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a1c3e-d9ee-41d7-92df-87b3afe56579 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:22.772406 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a1c3e-d9ee-41d7-92df-87b3afe56579 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:22.774932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a57a35-6664-406a-8237-fb6ea2b7c55b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:22.775283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a57a35-6664-406a-8237-fb6ea2b7c55b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:22.775622 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a57a35-6664-406a-8237-fb6ea2b7c55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:22.783337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 945/1901] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:22 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:22.799073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-08a57a35-6664-406a-8237-fb6ea2b7c55b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:22.800343 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-08a57a35-6664-406a-8237-fb6ea2b7c55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:22.808477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 957/1902] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:38:22.813371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a1c3e-d9ee-41d7-92df-87b3afe56579 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:22.823976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a1c3e-d9ee-41d7-92df-87b3afe56579 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:22.829133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae18aba-2fe7-4cd3-ae2a-5370843c71b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:22.829774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae18aba-2fe7-4cd3-ae2a-5370843c71b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:22.830007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae18aba-2fe7-4cd3-ae2a-5370843c71b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:22.830279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae18aba-2fe7-4cd3-ae2a-5370843c71b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:22.831032 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae18aba-2fe7-4cd3-ae2a-5370843c71b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:22.831337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae18aba-2fe7-4cd3-ae2a-5370843c71b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:22.832937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae18aba-2fe7-4cd3-ae2a-5370843c71b0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:22.848195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 946/1903] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:38:22.849259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a57a35-6664-406a-8237-fb6ea2b7c55b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:22.858561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a57a35-6664-406a-8237-fb6ea2b7c55b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:22.863449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4e151-6ecf-412c-80c0-75498b9fd246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:22.864118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4e151-6ecf-412c-80c0-75498b9fd246 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:22.864468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4e151-6ecf-412c-80c0-75498b9fd246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:22.864777 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4e151-6ecf-412c-80c0-75498b9fd246 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:22.865418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4e151-6ecf-412c-80c0-75498b9fd246 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:22.867325 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4e151-6ecf-412c-80c0-75498b9fd246 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:22.897705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 958/1904] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:22 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:38:22.901188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae18aba-2fe7-4cd3-ae2a-5370843c71b0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:22.913572 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae18aba-2fe7-4cd3-ae2a-5370843c71b0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:22.983568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bb7f3-90a0-4de8-8d38-199cbff98a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:22.984091 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bb7f3-90a0-4de8-8d38-199cbff98a0b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:22.984405 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bb7f3-90a0-4de8-8d38-199cbff98a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:22.984695 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772bb7f3-90a0-4de8-8d38-199cbff98a0b admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:22.985408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bb7f3-90a0-4de8-8d38-199cbff98a0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:22.987297 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772bb7f3-90a0-4de8-8d38-199cbff98a0b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:23.011056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 947/1905] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:22 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:38:23.015447 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4e151-6ecf-412c-80c0-75498b9fd246 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:23.025967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4e151-6ecf-412c-80c0-75498b9fd246 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:23.030758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b037f92-930c-4a2f-92e7-9b6c1ff5a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:23.031362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b037f92-930c-4a2f-92e7-9b6c1ff5a1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:23.031638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b037f92-930c-4a2f-92e7-9b6c1ff5a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:23.031909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b037f92-930c-4a2f-92e7-9b6c1ff5a1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:23.032547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b037f92-930c-4a2f-92e7-9b6c1ff5a1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:23.034186 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b037f92-930c-4a2f-92e7-9b6c1ff5a1a9 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:23.048959 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 959/1906] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:23.052369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bb7f3-90a0-4de8-8d38-199cbff98a0b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:23.066968 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772bb7f3-90a0-4de8-8d38-199cbff98a0b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:23.072180 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d234b7-de36-407b-b3ea-32b6968abdae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:23.072907 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d234b7-de36-407b-b3ea-32b6968abdae admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:23.073191 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d234b7-de36-407b-b3ea-32b6968abdae admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:23.073466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d234b7-de36-407b-b3ea-32b6968abdae admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:23.074111 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d234b7-de36-407b-b3ea-32b6968abdae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:23.076942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d234b7-de36-407b-b3ea-32b6968abdae admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:23.088533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 948/1907] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:38:23.092761 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b037f92-930c-4a2f-92e7-9b6c1ff5a1a9 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:23.102984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b037f92-930c-4a2f-92e7-9b6c1ff5a1a9 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:23.108188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b1559-4a69-4009-8ae4-6412261c5dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:23.108862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b1559-4a69-4009-8ae4-6412261c5dba admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:23.109142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b1559-4a69-4009-8ae4-6412261c5dba admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:23.109857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0b1559-4a69-4009-8ae4-6412261c5dba admin admin] PATH_INFO: `/v3/projects/6e7f6cc735e2407ebd429a86fc441600/users/2bfd7405debe4c25bcbaf3904f1e2b7c/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:23.125208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b1559-4a69-4009-8ae4-6412261c5dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7f6cc735e2407ebd429a86fc441600, user_id=2bfd7405debe4c25bcbaf3904f1e2b7c, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:23.127829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0b1559-4a69-4009-8ae4-6412261c5dba admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:23.141678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 960/1908] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:23 2022] PUT /identity/v3/projects/6e7f6cc735e2407ebd429a86fc441600/users/2bfd7405debe4c25bcbaf3904f1e2b7c/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:23.151929 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3bbfc-9c52-40b9-a752-222cffa325d4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:23.152213 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3bbfc-9c52-40b9-a752-222cffa325d4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:23.152570 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3bbfc-9c52-40b9-a752-222cffa325d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:23.182537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9fc3bbfc-9c52-40b9-a752-222cffa325d4 None None] MFA Rules not processed for user `2bfd7405debe4c25bcbaf3904f1e2b7c`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:23.186308 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9fc3bbfc-9c52-40b9-a752-222cffa325d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:23.249457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:23.260502 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 949/1909] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:23.265130 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b1559-4a69-4009-8ae4-6412261c5dba admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:23.338295 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0b1559-4a69-4009-8ae4-6412261c5dba admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:23.345308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde667e-7bfc-4a5b-8777-bbd0a8ba3f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:23.346177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde667e-7bfc-4a5b-8777-bbd0a8ba3f82 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:23.346558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde667e-7bfc-4a5b-8777-bbd0a8ba3f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:23.346934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bde667e-7bfc-4a5b-8777-bbd0a8ba3f82 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:23.347682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde667e-7bfc-4a5b-8777-bbd0a8ba3f82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:23.349705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bde667e-7bfc-4a5b-8777-bbd0a8ba3f82 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:23.387073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 961/1910] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:23 2022] POST /identity/v3/projects => generated 387 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:23.388491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3bbfc-9c52-40b9-a752-222cffa325d4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:23.406252 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3bbfc-9c52-40b9-a752-222cffa325d4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:23.473237 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c5978-f930-44f8-b2b1-1ff2d9cba083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:23.473913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c5978-f930-44f8-b2b1-1ff2d9cba083 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:23.474312 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c5978-f930-44f8-b2b1-1ff2d9cba083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:23.474654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c5978-f930-44f8-b2b1-1ff2d9cba083 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:23.475401 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c5978-f930-44f8-b2b1-1ff2d9cba083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:23.477670 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c5978-f930-44f8-b2b1-1ff2d9cba083 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:23.501289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 950/1911] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:23 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:38:23.505087 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde667e-7bfc-4a5b-8777-bbd0a8ba3f82 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:23.515834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bde667e-7bfc-4a5b-8777-bbd0a8ba3f82 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:23.524191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad98c9-f7fb-46f8-a9a9-4e213c81868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:23.524955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad98c9-f7fb-46f8-a9a9-4e213c81868e admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:23.525304 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad98c9-f7fb-46f8-a9a9-4e213c81868e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:23.525712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad98c9-f7fb-46f8-a9a9-4e213c81868e admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:23.526429 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad98c9-f7fb-46f8-a9a9-4e213c81868e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:23.528906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ad98c9-f7fb-46f8-a9a9-4e213c81868e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:23.540548 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 962/1912] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:23.545391 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c5978-f930-44f8-b2b1-1ff2d9cba083 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:23.557615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c5978-f930-44f8-b2b1-1ff2d9cba083 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:23.564509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b810c1e-4dc7-460b-8216-6ce08bdee371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:23.565363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b810c1e-4dc7-460b-8216-6ce08bdee371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:23.565648 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b810c1e-4dc7-460b-8216-6ce08bdee371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:23.565954 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b810c1e-4dc7-460b-8216-6ce08bdee371 admin admin] PATH_INFO: `/v3/projects/c8b6ffee730c4bb7a1c46295087f49ee/users/4887daa1eb074f86983a091e5d2b8513/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:23.585434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b810c1e-4dc7-460b-8216-6ce08bdee371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b6ffee730c4bb7a1c46295087f49ee, user_id=4887daa1eb074f86983a091e5d2b8513, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:23.587990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b810c1e-4dc7-460b-8216-6ce08bdee371 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:23.609944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 951/1913] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:23 2022] PUT /identity/v3/projects/c8b6ffee730c4bb7a1c46295087f49ee/users/4887daa1eb074f86983a091e5d2b8513/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:23.614309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad98c9-f7fb-46f8-a9a9-4e213c81868e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:23.645061 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad98c9-f7fb-46f8-a9a9-4e213c81868e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:23.701018 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:23.740635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f748b8a5-2b34-40c2-a14a-91f679e30826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:23.741475 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748b8a5-2b34-40c2-a14a-91f679e30826 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:23.741595 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748b8a5-2b34-40c2-a14a-91f679e30826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:23.741846 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f748b8a5-2b34-40c2-a14a-91f679e30826 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:23.742680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748b8a5-2b34-40c2-a14a-91f679e30826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:23.744813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f748b8a5-2b34-40c2-a14a-91f679e30826 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:23.758329 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 963/1914] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:23 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:38:23.763253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b810c1e-4dc7-460b-8216-6ce08bdee371 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:23.784052 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b810c1e-4dc7-460b-8216-6ce08bdee371 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:23.795750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005664c-1611-4626-ad13-98493355bb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:23.797462 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005664c-1611-4626-ad13-98493355bb8f admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:23.798917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005664c-1611-4626-ad13-98493355bb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:23.799632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e005664c-1611-4626-ad13-98493355bb8f admin admin] PATH_INFO: `/v3/projects/c8b6ffee730c4bb7a1c46295087f49ee/users/4887daa1eb074f86983a091e5d2b8513/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:23.805832 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005664c-1611-4626-ad13-98493355bb8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b6ffee730c4bb7a1c46295087f49ee, user_id=4887daa1eb074f86983a091e5d2b8513, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:23.812946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e005664c-1611-4626-ad13-98493355bb8f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:23.839374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 952/1915] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:23 2022] PUT /identity/v3/projects/c8b6ffee730c4bb7a1c46295087f49ee/users/4887daa1eb074f86983a091e5d2b8513/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:23.853540 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0119cf1-c72a-4f2b-b978-28ea5f6a217f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:23.854056 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0119cf1-c72a-4f2b-b978-28ea5f6a217f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:23.854389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0119cf1-c72a-4f2b-b978-28ea5f6a217f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:23.913308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-c0119cf1-c72a-4f2b-b978-28ea5f6a217f None None] MFA Rules not processed for user `4887daa1eb074f86983a091e5d2b8513`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:23.914588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c0119cf1-c72a-4f2b-b978-28ea5f6a217f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:24.036717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 964/1916] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:23 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:24.120543 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005664c-1611-4626-ad13-98493355bb8f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:24.122918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e005664c-1611-4626-ad13-98493355bb8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:24.228254 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e005664c-1611-4626-ad13-98493355bb8f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:24.247550 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0aa778-e062-4895-93f9-c26e97c73852 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:24.248811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0aa778-e062-4895-93f9-c26e97c73852 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:24.249113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0aa778-e062-4895-93f9-c26e97c73852 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:24.250491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0aa778-e062-4895-93f9-c26e97c73852 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:24.270912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0aa778-e062-4895-93f9-c26e97c73852 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:24.272617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0aa778-e062-4895-93f9-c26e97c73852 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:24.297601 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 953/1917] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:24 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:24.546451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0119cf1-c72a-4f2b-b978-28ea5f6a217f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:24.681109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0119cf1-c72a-4f2b-b978-28ea5f6a217f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:24.699905 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf185b4a-3e64-427a-8e98-b58aeb59bc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:24.700719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf185b4a-3e64-427a-8e98-b58aeb59bc03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:24.700952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf185b4a-3e64-427a-8e98-b58aeb59bc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:24.701224 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf185b4a-3e64-427a-8e98-b58aeb59bc03 admin admin] PATH_INFO: `/v3/users/2bfd7405debe4c25bcbaf3904f1e2b7c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:24.705164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf185b4a-3e64-427a-8e98-b58aeb59bc03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bfd7405debe4c25bcbaf3904f1e2b7c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:24.727537 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf185b4a-3e64-427a-8e98-b58aeb59bc03 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:24.842895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-cf185b4a-3e64-427a-8e98-b58aeb59bc03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bfd7405debe4c25bcbaf3904f1e2b7c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:24.854838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-cf185b4a-3e64-427a-8e98-b58aeb59bc03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bfd7405debe4c25bcbaf3904f1e2b7c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:24.858875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:24.882324 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-cf185b4a-3e64-427a-8e98-b58aeb59bc03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bfd7405debe4c25bcbaf3904f1e2b7c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:24.883100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-cf185b4a-3e64-427a-8e98-b58aeb59bc03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bfd7405debe4c25bcbaf3904f1e2b7c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:24.895064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-cf185b4a-3e64-427a-8e98-b58aeb59bc03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bfd7405debe4c25bcbaf3904f1e2b7c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:24.904186 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 965/1918] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:24 2022] DELETE /identity/v3/users/2bfd7405debe4c25bcbaf3904f1e2b7c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:24.909466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731bae3-c6d7-489c-a1b3-71f4aa506210 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:24.910013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731bae3-c6d7-489c-a1b3-71f4aa506210 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:24.910103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731bae3-c6d7-489c-a1b3-71f4aa506210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:24.948475 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c731bae3-c6d7-489c-a1b3-71f4aa506210 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:24.957890 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c731bae3-c6d7-489c-a1b3-71f4aa506210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:25.038238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:25.101926 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 954/1919] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:25.120518 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf185b4a-3e64-427a-8e98-b58aeb59bc03 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:25.123510 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-cf185b4a-3e64-427a-8e98-b58aeb59bc03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:25.264645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf185b4a-3e64-427a-8e98-b58aeb59bc03 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:25.269402 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102e3fa-89da-476d-8a6b-cb166093814c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:25.269504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102e3fa-89da-476d-8a6b-cb166093814c service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:25.269932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102e3fa-89da-476d-8a6b-cb166093814c service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:25.270345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102e3fa-89da-476d-8a6b-cb166093814c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:25.281159 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102e3fa-89da-476d-8a6b-cb166093814c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:25.282655 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102e3fa-89da-476d-8a6b-cb166093814c service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:25.294297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 966/1920] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:25.606808 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731bae3-c6d7-489c-a1b3-71f4aa506210 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:25.608420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c731bae3-c6d7-489c-a1b3-71f4aa506210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:25.620809 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c731bae3-c6d7-489c-a1b3-71f4aa506210 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:25.627198 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5de5376-0fbe-4bab-bc9d-2b038f0bfe1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:25.628277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de5376-0fbe-4bab-bc9d-2b038f0bfe1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:25.628698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de5376-0fbe-4bab-bc9d-2b038f0bfe1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:25.628992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5de5376-0fbe-4bab-bc9d-2b038f0bfe1d admin admin] PATH_INFO: `/v3/users/2eca0b86fd544d83ac1f4e6ffa8c52d2` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:25.630368 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de5376-0fbe-4bab-bc9d-2b038f0bfe1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eca0b86fd544d83ac1f4e6ffa8c52d2)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:25.632496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5de5376-0fbe-4bab-bc9d-2b038f0bfe1d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:25.682331 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102e3fa-89da-476d-8a6b-cb166093814c service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:25.684489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3102e3fa-89da-476d-8a6b-cb166093814c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:25.697597 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c5de5376-0fbe-4bab-bc9d-2b038f0bfe1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eca0b86fd544d83ac1f4e6ffa8c52d2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:25.701407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102e3fa-89da-476d-8a6b-cb166093814c service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:25.706974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b11466-5227-4c8c-a31c-3db5375bcdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:25.707251 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c5de5376-0fbe-4bab-bc9d-2b038f0bfe1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eca0b86fd544d83ac1f4e6ffa8c52d2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:25.708005 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b11466-5227-4c8c-a31c-3db5375bcdf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:25.708289 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b11466-5227-4c8c-a31c-3db5375bcdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:25.708987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b11466-5227-4c8c-a31c-3db5375bcdf4 admin admin] PATH_INFO: `/v3/projects/6e7f6cc735e2407ebd429a86fc441600` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:25.711145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b11466-5227-4c8c-a31c-3db5375bcdf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e7f6cc735e2407ebd429a86fc441600)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:25.713701 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b11466-5227-4c8c-a31c-3db5375bcdf4 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:25.726207 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c5de5376-0fbe-4bab-bc9d-2b038f0bfe1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eca0b86fd544d83ac1f4e6ffa8c52d2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:25.741356 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c5de5376-0fbe-4bab-bc9d-2b038f0bfe1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eca0b86fd544d83ac1f4e6ffa8c52d2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:25.742294 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c5de5376-0fbe-4bab-bc9d-2b038f0bfe1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eca0b86fd544d83ac1f4e6ffa8c52d2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:25.752230 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 955/1921] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:25 2022] DELETE /identity/v3/users/2eca0b86fd544d83ac1f4e6ffa8c52d2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:25.757545 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce26d6-74c6-4a2b-a41b-1daad144a856 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:25.759471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce26d6-74c6-4a2b-a41b-1daad144a856 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:25.759842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ce26d6-74c6-4a2b-a41b-1daad144a856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:25.782991 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d5ce26d6-74c6-4a2b-a41b-1daad144a856 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:25.784506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d5ce26d6-74c6-4a2b-a41b-1daad144a856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:25.788549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b5b11466-5227-4c8c-a31c-3db5375bcdf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e7f6cc735e2407ebd429a86fc441600', 'request_id': 'req-b5b11466-5227-4c8c-a31c-3db5375bcdf4'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:25.797298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b5b11466-5227-4c8c-a31c-3db5375bcdf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e7f6cc735e2407ebd429a86fc441600', 'request_id': 'req-b5b11466-5227-4c8c-a31c-3db5375bcdf4'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:25.803581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b5b11466-5227-4c8c-a31c-3db5375bcdf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e7f6cc735e2407ebd429a86fc441600', 'request_id': 'req-b5b11466-5227-4c8c-a31c-3db5375bcdf4'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:25.817629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b5b11466-5227-4c8c-a31c-3db5375bcdf4 admin admin] The token cache is being invalidate because project 6e7f6cc735e2407ebd429a86fc441600 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:25.817958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b5b11466-5227-4c8c-a31c-3db5375bcdf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:25.818597 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b5b11466-5227-4c8c-a31c-3db5375bcdf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:25.820154 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 967/1922] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:25 2022] DELETE /identity/v3/projects/6e7f6cc735e2407ebd429a86fc441600 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:25.824067 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b11466-5227-4c8c-a31c-3db5375bcdf4 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:25.826081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b5b11466-5227-4c8c-a31c-3db5375bcdf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:25.860903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 956/1923] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:25.867654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce26d6-74c6-4a2b-a41b-1daad144a856 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:25.870571 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d5ce26d6-74c6-4a2b-a41b-1daad144a856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:25.918819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b11466-5227-4c8c-a31c-3db5375bcdf4 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:25.924736 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97a7dd-afb5-4bc3-9ec4-e83274823afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:25.926278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97a7dd-afb5-4bc3-9ec4-e83274823afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:25.926537 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97a7dd-afb5-4bc3-9ec4-e83274823afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:25.927167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97a7dd-afb5-4bc3-9ec4-e83274823afd admin admin] PATH_INFO: `/v3/users/4887daa1eb074f86983a091e5d2b8513` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:25.928577 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97a7dd-afb5-4bc3-9ec4-e83274823afd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4887daa1eb074f86983a091e5d2b8513)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:25.930643 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97a7dd-afb5-4bc3-9ec4-e83274823afd admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:25.934920 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:25.965620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ce26d6-74c6-4a2b-a41b-1daad144a856 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:25.973934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712afdb6-cbca-48d6-86f9-58b5dc93ff12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:25.974693 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712afdb6-cbca-48d6-86f9-58b5dc93ff12 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:25.975190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712afdb6-cbca-48d6-86f9-58b5dc93ff12 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:25.975675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712afdb6-cbca-48d6-86f9-58b5dc93ff12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:25.989558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712afdb6-cbca-48d6-86f9-58b5dc93ff12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:25.992010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712afdb6-cbca-48d6-86f9-58b5dc93ff12 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:26.004956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-0e97a7dd-afb5-4bc3-9ec4-e83274823afd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4887daa1eb074f86983a091e5d2b8513'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:26.010662 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 957/1924] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:26.014578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-0e97a7dd-afb5-4bc3-9ec4-e83274823afd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4887daa1eb074f86983a091e5d2b8513'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:26.033988 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-0e97a7dd-afb5-4bc3-9ec4-e83274823afd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4887daa1eb074f86983a091e5d2b8513'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:26.034765 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-0e97a7dd-afb5-4bc3-9ec4-e83274823afd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4887daa1eb074f86983a091e5d2b8513'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:26.045229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-0e97a7dd-afb5-4bc3-9ec4-e83274823afd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4887daa1eb074f86983a091e5d2b8513'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:26.053922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 968/1925] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:25 2022] DELETE /identity/v3/users/4887daa1eb074f86983a091e5d2b8513 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:26.521923 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712afdb6-cbca-48d6-86f9-58b5dc93ff12 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:26.523436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-712afdb6-cbca-48d6-86f9-58b5dc93ff12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:26.538250 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712afdb6-cbca-48d6-86f9-58b5dc93ff12 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:26.542868 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:26.576721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97a7dd-afb5-4bc3-9ec4-e83274823afd admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:26.578261 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0e97a7dd-afb5-4bc3-9ec4-e83274823afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:26.720415 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97a7dd-afb5-4bc3-9ec4-e83274823afd admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:26.726153 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba85df-e839-4265-9fd2-152873764f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:26.726804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba85df-e839-4265-9fd2-152873764f2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:26.727317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba85df-e839-4265-9fd2-152873764f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:26.727654 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba85df-e839-4265-9fd2-152873764f2e admin admin] PATH_INFO: `/v3/projects/99aee67549c3446d917f692a3df1a14a` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:26.728936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba85df-e839-4265-9fd2-152873764f2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=99aee67549c3446d917f692a3df1a14a)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:26.730951 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ba85df-e839-4265-9fd2-152873764f2e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:26.745324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd269aa1-a621-43f2-b163-3b8e497ce5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:26.745998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd269aa1-a621-43f2-b163-3b8e497ce5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:26.746282 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd269aa1-a621-43f2-b163-3b8e497ce5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:26.746555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd269aa1-a621-43f2-b163-3b8e497ce5b6 admin admin] PATH_INFO: `/v3/users/a91a9c0b80cb44f4905dff83a9809d08` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:26.753021 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd269aa1-a621-43f2-b163-3b8e497ce5b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a91a9c0b80cb44f4905dff83a9809d08)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:26.755203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd269aa1-a621-43f2-b163-3b8e497ce5b6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:26.822156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b5ba85df-e839-4265-9fd2-152873764f2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99aee67549c3446d917f692a3df1a14a', 'request_id': 'req-b5ba85df-e839-4265-9fd2-152873764f2e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:26.835566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b5ba85df-e839-4265-9fd2-152873764f2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99aee67549c3446d917f692a3df1a14a', 'request_id': 'req-b5ba85df-e839-4265-9fd2-152873764f2e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:26.849597 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b5ba85df-e839-4265-9fd2-152873764f2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99aee67549c3446d917f692a3df1a14a', 'request_id': 'req-b5ba85df-e839-4265-9fd2-152873764f2e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:26.877087 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b5ba85df-e839-4265-9fd2-152873764f2e admin admin] The token cache is being invalidate because project 99aee67549c3446d917f692a3df1a14a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:26.880642 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b5ba85df-e839-4265-9fd2-152873764f2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:26.881795 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b5ba85df-e839-4265-9fd2-152873764f2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:26.882472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fd269aa1-a621-43f2-b163-3b8e497ce5b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a91a9c0b80cb44f4905dff83a9809d08'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:26.885806 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 969/1926] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:26 2022] DELETE /identity/v3/projects/99aee67549c3446d917f692a3df1a14a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:26.887345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba85df-e839-4265-9fd2-152873764f2e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:26.888872 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b5ba85df-e839-4265-9fd2-152873764f2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:26.898248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fd269aa1-a621-43f2-b163-3b8e497ce5b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a91a9c0b80cb44f4905dff83a9809d08'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:26.923586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:26.931681 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fd269aa1-a621-43f2-b163-3b8e497ce5b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a91a9c0b80cb44f4905dff83a9809d08'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:26.961303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fd269aa1-a621-43f2-b163-3b8e497ce5b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a91a9c0b80cb44f4905dff83a9809d08'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:26.962516 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-fd269aa1-a621-43f2-b163-3b8e497ce5b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a91a9c0b80cb44f4905dff83a9809d08'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:26.984776 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 958/1927] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:26 2022] DELETE /identity/v3/users/a91a9c0b80cb44f4905dff83a9809d08 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:27.003567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd269aa1-a621-43f2-b163-3b8e497ce5b6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:27.009482 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fd269aa1-a621-43f2-b163-3b8e497ce5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:27.045327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ba85df-e839-4265-9fd2-152873764f2e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:27.144031 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f47367-90fc-4ca1-b19d-39c800c11660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:27.144813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f47367-90fc-4ca1-b19d-39c800c11660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:27.145093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f47367-90fc-4ca1-b19d-39c800c11660 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:27.145363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f47367-90fc-4ca1-b19d-39c800c11660 admin admin] PATH_INFO: `/v3/projects/c8b6ffee730c4bb7a1c46295087f49ee` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:27.146891 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f47367-90fc-4ca1-b19d-39c800c11660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b6ffee730c4bb7a1c46295087f49ee)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:27.148843 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f47367-90fc-4ca1-b19d-39c800c11660 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:27.158835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd269aa1-a621-43f2-b163-3b8e497ce5b6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:27.174909 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801eaf62-3816-4d36-ba05-2c5e0498cf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:27.175594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eaf62-3816-4d36-ba05-2c5e0498cf2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:27.175945 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eaf62-3816-4d36-ba05-2c5e0498cf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:27.176290 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801eaf62-3816-4d36-ba05-2c5e0498cf2f admin admin] PATH_INFO: `/v3/users/38eaedd60f0a478593d406f2ec0f7a53` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:27.178894 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801eaf62-3816-4d36-ba05-2c5e0498cf2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=38eaedd60f0a478593d406f2ec0f7a53)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:27.183184 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801eaf62-3816-4d36-ba05-2c5e0498cf2f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:27.224030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d5f47367-90fc-4ca1-b19d-39c800c11660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b6ffee730c4bb7a1c46295087f49ee', 'request_id': 'req-d5f47367-90fc-4ca1-b19d-39c800c11660'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:27.229442 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:27.233638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d5f47367-90fc-4ca1-b19d-39c800c11660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b6ffee730c4bb7a1c46295087f49ee', 'request_id': 'req-d5f47367-90fc-4ca1-b19d-39c800c11660'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:27.241597 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d5f47367-90fc-4ca1-b19d-39c800c11660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b6ffee730c4bb7a1c46295087f49ee', 'request_id': 'req-d5f47367-90fc-4ca1-b19d-39c800c11660'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:27.256858 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-801eaf62-3816-4d36-ba05-2c5e0498cf2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38eaedd60f0a478593d406f2ec0f7a53'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:27.257769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d5f47367-90fc-4ca1-b19d-39c800c11660 admin admin] The token cache is being invalidate because project c8b6ffee730c4bb7a1c46295087f49ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:27.258293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d5f47367-90fc-4ca1-b19d-39c800c11660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:27.259479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d5f47367-90fc-4ca1-b19d-39c800c11660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:27.261363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 970/1928] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:26 2022] DELETE /identity/v3/projects/c8b6ffee730c4bb7a1c46295087f49ee => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:27.263463 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02788202-dfd5-4b26-a9fb-da6f37d7ce8e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:27.263896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02788202-dfd5-4b26-a9fb-da6f37d7ce8e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:27.264343 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02788202-dfd5-4b26-a9fb-da6f37d7ce8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:27.268756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-801eaf62-3816-4d36-ba05-2c5e0498cf2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38eaedd60f0a478593d406f2ec0f7a53'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:27.283806 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-801eaf62-3816-4d36-ba05-2c5e0498cf2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38eaedd60f0a478593d406f2ec0f7a53'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:27.289523 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-02788202-dfd5-4b26-a9fb-da6f37d7ce8e None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:27.290897 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-02788202-dfd5-4b26-a9fb-da6f37d7ce8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:27.294074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-801eaf62-3816-4d36-ba05-2c5e0498cf2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38eaedd60f0a478593d406f2ec0f7a53'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:27.294859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-801eaf62-3816-4d36-ba05-2c5e0498cf2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38eaedd60f0a478593d406f2ec0f7a53'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:27.302629 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 959/1929] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:26 2022] DELETE /identity/v3/users/38eaedd60f0a478593d406f2ec0f7a53 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:27.303880 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801eaf62-3816-4d36-ba05-2c5e0498cf2f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:27.305456 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-801eaf62-3816-4d36-ba05-2c5e0498cf2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:27.385202 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801eaf62-3816-4d36-ba05-2c5e0498cf2f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:27.387802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:27.395209 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418e183-48e7-41b5-abe7-5f8a5a7c6fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:27.396218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418e183-48e7-41b5-abe7-5f8a5a7c6fbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:27.396761 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418e183-48e7-41b5-abe7-5f8a5a7c6fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:27.398103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418e183-48e7-41b5-abe7-5f8a5a7c6fbc admin admin] PATH_INFO: `/v3/users/51b7026027d543f3a8f485f8951f064e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:27.401172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418e183-48e7-41b5-abe7-5f8a5a7c6fbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b7026027d543f3a8f485f8951f064e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:27.403892 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f418e183-48e7-41b5-abe7-5f8a5a7c6fbc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:27.418663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 971/1930] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:27.418663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8139f-526c-4ff9-b17b-acb95b3e3db4 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:27.418663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8139f-526c-4ff9-b17b-acb95b3e3db4 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:27.418663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8139f-526c-4ff9-b17b-acb95b3e3db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:27.442844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8bd8139f-526c-4ff9-b17b-acb95b3e3db4 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:27.444159 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8bd8139f-526c-4ff9-b17b-acb95b3e3db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:27.455710 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 972/1931] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:27.463974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df5bd9-589a-4a7b-b45a-6832024d2d93 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:27.464269 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df5bd9-589a-4a7b-b45a-6832024d2d93 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:27.464897 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07df5bd9-589a-4a7b-b45a-6832024d2d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:27.485925 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f418e183-48e7-41b5-abe7-5f8a5a7c6fbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b7026027d543f3a8f485f8951f064e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:27.489743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-07df5bd9-589a-4a7b-b45a-6832024d2d93 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:27.490659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-07df5bd9-589a-4a7b-b45a-6832024d2d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:27.497567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f418e183-48e7-41b5-abe7-5f8a5a7c6fbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b7026027d543f3a8f485f8951f064e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:27.502319 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 973/1932] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:38:27.503328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df5bd9-589a-4a7b-b45a-6832024d2d93 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:27.504731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-07df5bd9-589a-4a7b-b45a-6832024d2d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:27.520855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f418e183-48e7-41b5-abe7-5f8a5a7c6fbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b7026027d543f3a8f485f8951f064e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:27.532167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f418e183-48e7-41b5-abe7-5f8a5a7c6fbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b7026027d543f3a8f485f8951f064e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:27.532999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f418e183-48e7-41b5-abe7-5f8a5a7c6fbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b7026027d543f3a8f485f8951f064e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:27.545318 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 960/1933] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:27 2022] DELETE /identity/v3/users/51b7026027d543f3a8f485f8951f064e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:27.546383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418e183-48e7-41b5-abe7-5f8a5a7c6fbc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:27.547587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f418e183-48e7-41b5-abe7-5f8a5a7c6fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:27.603723 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07df5bd9-589a-4a7b-b45a-6832024d2d93 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:27.629179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:27.682757 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418e183-48e7-41b5-abe7-5f8a5a7c6fbc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:27.690331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57fbd29-4636-4782-8fb2-a1cb96065339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:27.691263 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fbd29-4636-4782-8fb2-a1cb96065339 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:27.691950 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fbd29-4636-4782-8fb2-a1cb96065339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:27.692336 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57fbd29-4636-4782-8fb2-a1cb96065339 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:27.693900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fbd29-4636-4782-8fb2-a1cb96065339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:27.693900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fbd29-4636-4782-8fb2-a1cb96065339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:27.695767 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57fbd29-4636-4782-8fb2-a1cb96065339 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:27.697690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebabab-af16-4bd9-88b6-ca7a92944af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:27.698463 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebabab-af16-4bd9-88b6-ca7a92944af0 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:27.698809 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebabab-af16-4bd9-88b6-ca7a92944af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:27.699201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebabab-af16-4bd9-88b6-ca7a92944af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:27.705938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-deebabab-af16-4bd9-88b6-ca7a92944af0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:27.711102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 961/1934] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:38:27.712649 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950c0f-6a0a-4b03-a6a1-369194d8da7a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:27.713058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950c0f-6a0a-4b03-a6a1-369194d8da7a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:27.713405 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92950c0f-6a0a-4b03-a6a1-369194d8da7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:27.719624 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebabab-af16-4bd9-88b6-ca7a92944af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:27.721106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebabab-af16-4bd9-88b6-ca7a92944af0 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:27.733388 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 974/1935] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:27.734202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebabab-af16-4bd9-88b6-ca7a92944af0 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:27.739346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-92950c0f-6a0a-4b03-a6a1-369194d8da7a None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:27.741393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-92950c0f-6a0a-4b03-a6a1-369194d8da7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:27.747376 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebabab-af16-4bd9-88b6-ca7a92944af0 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:27.751443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 962/1936] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:27.753051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56124088-73bd-4867-bfba-58ae654d8139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:27.753662 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56124088-73bd-4867-bfba-58ae654d8139 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:27.753942 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56124088-73bd-4867-bfba-58ae654d8139 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:27.754211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56124088-73bd-4867-bfba-58ae654d8139 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:27.754841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56124088-73bd-4867-bfba-58ae654d8139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:27.756834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56124088-73bd-4867-bfba-58ae654d8139 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:27.773370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92950c0f-6a0a-4b03-a6a1-369194d8da7a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:27.780031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-92950c0f-6a0a-4b03-a6a1-369194d8da7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:27.791930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 975/1937] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:27 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:27.798997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92950c0f-6a0a-4b03-a6a1-369194d8da7a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:27.807386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56124088-73bd-4867-bfba-58ae654d8139 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:27.872453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cffc31-5435-4b59-9f53-44809f806607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:27.873081 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cffc31-5435-4b59-9f53-44809f806607 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:27.873364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cffc31-5435-4b59-9f53-44809f806607 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:27.873659 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cffc31-5435-4b59-9f53-44809f806607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:27.915573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56124088-73bd-4867-bfba-58ae654d8139 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:27.948457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595efc12-b96e-480a-80e7-6459fc6442a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:27.950197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595efc12-b96e-480a-80e7-6459fc6442a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:27.950494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595efc12-b96e-480a-80e7-6459fc6442a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:27.950768 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595efc12-b96e-480a-80e7-6459fc6442a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:27.951415 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595efc12-b96e-480a-80e7-6459fc6442a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:27.953400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595efc12-b96e-480a-80e7-6459fc6442a0 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:27.972598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cffc31-5435-4b59-9f53-44809f806607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:27.974077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cffc31-5435-4b59-9f53-44809f806607 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:27.978787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 976/1938] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:27 2022] POST /identity/v3/users => generated 292 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:27.980747 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595efc12-b96e-480a-80e7-6459fc6442a0 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:27.983083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-595efc12-b96e-480a-80e7-6459fc6442a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:27.984527 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 963/1939] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:27.985522 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cffc31-5435-4b59-9f53-44809f806607 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:27.993831 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:27.996682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cffc31-5435-4b59-9f53-44809f806607 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:28.001785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225f50a-36f2-45c2-9c34-f23d9cc584b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:28.002395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225f50a-36f2-45c2-9c34-f23d9cc584b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:28.002676 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225f50a-36f2-45c2-9c34-f23d9cc584b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:28.003349 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d225f50a-36f2-45c2-9c34-f23d9cc584b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:28.004003 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225f50a-36f2-45c2-9c34-f23d9cc584b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:28.004824 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595efc12-b96e-480a-80e7-6459fc6442a0 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:28.005772 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d225f50a-36f2-45c2-9c34-f23d9cc584b2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:28.017870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04e70f-363d-4389-b5d1-2d8dbe02207e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:28.020114 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04e70f-363d-4389-b5d1-2d8dbe02207e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:28.020242 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 964/1940] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:28.020814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04e70f-363d-4389-b5d1-2d8dbe02207e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:28.021279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04e70f-363d-4389-b5d1-2d8dbe02207e admin admin] PATH_INFO: `/v3/projects/26cd1f530abd40a895d027015fbf0996` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:28.022863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04e70f-363d-4389-b5d1-2d8dbe02207e admin admin] RBAC: Authorizing `identity:delete_project(project_id=26cd1f530abd40a895d027015fbf0996)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:28.025041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225f50a-36f2-45c2-9c34-f23d9cc584b2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:28.025167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04e70f-363d-4389-b5d1-2d8dbe02207e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:28.038142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d225f50a-36f2-45c2-9c34-f23d9cc584b2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:28.045164 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e2447-68bf-45e9-b109-8c51d95213ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:28.045848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e2447-68bf-45e9-b109-8c51d95213ad admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:28.046336 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e2447-68bf-45e9-b109-8c51d95213ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:28.046682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e2447-68bf-45e9-b109-8c51d95213ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:28.047412 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e2447-68bf-45e9-b109-8c51d95213ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:28.049498 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e2447-68bf-45e9-b109-8c51d95213ad admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:28.070795 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 965/1941] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:28 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:28.077333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e2447-68bf-45e9-b109-8c51d95213ad admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:28.099505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e2447-68bf-45e9-b109-8c51d95213ad admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:28.105389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bb04e70f-363d-4389-b5d1-2d8dbe02207e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26cd1f530abd40a895d027015fbf0996', 'request_id': 'req-bb04e70f-363d-4389-b5d1-2d8dbe02207e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.134762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bb04e70f-363d-4389-b5d1-2d8dbe02207e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26cd1f530abd40a895d027015fbf0996', 'request_id': 'req-bb04e70f-363d-4389-b5d1-2d8dbe02207e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.146421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bb04e70f-363d-4389-b5d1-2d8dbe02207e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26cd1f530abd40a895d027015fbf0996', 'request_id': 'req-bb04e70f-363d-4389-b5d1-2d8dbe02207e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.172104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:28.180060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bb04e70f-363d-4389-b5d1-2d8dbe02207e admin admin] The token cache is being invalidate because project 26cd1f530abd40a895d027015fbf0996 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:28.180760 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bb04e70f-363d-4389-b5d1-2d8dbe02207e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.194225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bb04e70f-363d-4389-b5d1-2d8dbe02207e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.201942 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 977/1942] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:27 2022] DELETE /identity/v3/projects/26cd1f530abd40a895d027015fbf0996 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:28.203987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04e70f-363d-4389-b5d1-2d8dbe02207e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:28.212306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-bb04e70f-363d-4389-b5d1-2d8dbe02207e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:28.215262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb410a6e-b421-4aa9-b5fe-157f6fe43b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:28.215935 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb410a6e-b421-4aa9-b5fe-157f6fe43b0e admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:28.216218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb410a6e-b421-4aa9-b5fe-157f6fe43b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:28.216493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb410a6e-b421-4aa9-b5fe-157f6fe43b0e admin admin] PATH_INFO: `/v3/projects/3d72bca740f145088395f3318fb362ee/users/aa256ec5b4e3493598a22f9c9963a6df/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:28.232356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04e70f-363d-4389-b5d1-2d8dbe02207e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:28.238575 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb410a6e-b421-4aa9-b5fe-157f6fe43b0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d72bca740f145088395f3318fb362ee, user_id=aa256ec5b4e3493598a22f9c9963a6df, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:28.243046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb410a6e-b421-4aa9-b5fe-157f6fe43b0e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:28.249631 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdefc8-3b18-4c67-a205-be9accb5d6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:28.250819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdefc8-3b18-4c67-a205-be9accb5d6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:28.251367 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdefc8-3b18-4c67-a205-be9accb5d6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:28.251991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fdefc8-3b18-4c67-a205-be9accb5d6bd admin admin] PATH_INFO: `/v3/users/81fff4da780346dcab0c224bf20cf58b` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:28.255161 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdefc8-3b18-4c67-a205-be9accb5d6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=81fff4da780346dcab0c224bf20cf58b)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:28.261282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fdefc8-3b18-4c67-a205-be9accb5d6bd admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:28.273528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 966/1943] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:28 2022] PUT /identity/v3/projects/3d72bca740f145088395f3318fb362ee/users/aa256ec5b4e3493598a22f9c9963a6df/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:28.275851 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb49ea-64a6-431f-bd7f-74cb71c43dcf None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:28.276371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb49ea-64a6-431f-bd7f-74cb71c43dcf None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:28.276948 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eb49ea-64a6-431f-bd7f-74cb71c43dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:28.315102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-12eb49ea-64a6-431f-bd7f-74cb71c43dcf None None] MFA Rules not processed for user `aa256ec5b4e3493598a22f9c9963a6df`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:28.316890 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-12eb49ea-64a6-431f-bd7f-74cb71c43dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:28.341129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-93fdefc8-3b18-4c67-a205-be9accb5d6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81fff4da780346dcab0c224bf20cf58b'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.349944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-93fdefc8-3b18-4c67-a205-be9accb5d6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81fff4da780346dcab0c224bf20cf58b'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.365290 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-93fdefc8-3b18-4c67-a205-be9accb5d6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81fff4da780346dcab0c224bf20cf58b'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.366479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-93fdefc8-3b18-4c67-a205-be9accb5d6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81fff4da780346dcab0c224bf20cf58b'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.378527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-93fdefc8-3b18-4c67-a205-be9accb5d6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81fff4da780346dcab0c224bf20cf58b'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.388197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 978/1944] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:28 2022] DELETE /identity/v3/users/81fff4da780346dcab0c224bf20cf58b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:28.423470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdefc8-3b18-4c67-a205-be9accb5d6bd admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:28.427764 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-93fdefc8-3b18-4c67-a205-be9accb5d6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:28.432612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 967/1945] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:38:28.439643 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb49ea-64a6-431f-bd7f-74cb71c43dcf None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:28.442399 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-12eb49ea-64a6-431f-bd7f-74cb71c43dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:28.515512 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:28.528013 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fdefc8-3b18-4c67-a205-be9accb5d6bd admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:28.542208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ab689-fda2-40ba-a637-f1dfff95a05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:28.543501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ab689-fda2-40ba-a637-f1dfff95a05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:28.543705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ab689-fda2-40ba-a637-f1dfff95a05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:28.543981 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955ab689-fda2-40ba-a637-f1dfff95a05a admin admin] PATH_INFO: `/v3/projects/c4dfa22083a245668cdc79464e6b2c5d` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:28.547576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ab689-fda2-40ba-a637-f1dfff95a05a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4dfa22083a245668cdc79464e6b2c5d)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:28.551368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955ab689-fda2-40ba-a637-f1dfff95a05a admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:28.551856 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eb49ea-64a6-431f-bd7f-74cb71c43dcf None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:28.562689 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ddfc4-f01c-4238-82b3-44a63047f104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:28.564647 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ddfc4-f01c-4238-82b3-44a63047f104 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:28.565050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ddfc4-f01c-4238-82b3-44a63047f104 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:28.565400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ddfc4-f01c-4238-82b3-44a63047f104 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:28.566282 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ddfc4-f01c-4238-82b3-44a63047f104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:28.568763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11ddfc4-f01c-4238-82b3-44a63047f104 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:28.625157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 968/1946] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:28 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:28.627842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ddfc4-f01c-4238-82b3-44a63047f104 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:28.634555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f11ddfc4-f01c-4238-82b3-44a63047f104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:28.639840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-955ab689-fda2-40ba-a637-f1dfff95a05a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4dfa22083a245668cdc79464e6b2c5d', 'request_id': 'req-955ab689-fda2-40ba-a637-f1dfff95a05a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.652241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-955ab689-fda2-40ba-a637-f1dfff95a05a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4dfa22083a245668cdc79464e6b2c5d', 'request_id': 'req-955ab689-fda2-40ba-a637-f1dfff95a05a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.665205 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-955ab689-fda2-40ba-a637-f1dfff95a05a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4dfa22083a245668cdc79464e6b2c5d', 'request_id': 'req-955ab689-fda2-40ba-a637-f1dfff95a05a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.681543 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-955ab689-fda2-40ba-a637-f1dfff95a05a admin admin] The token cache is being invalidate because project c4dfa22083a245668cdc79464e6b2c5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:28.682579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-955ab689-fda2-40ba-a637-f1dfff95a05a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.684190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-955ab689-fda2-40ba-a637-f1dfff95a05a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.686969 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 979/1947] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:28 2022] DELETE /identity/v3/projects/c4dfa22083a245668cdc79464e6b2c5d => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:28.688428 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ab689-fda2-40ba-a637-f1dfff95a05a admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:28.691435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-955ab689-fda2-40ba-a637-f1dfff95a05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:28.727340 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:28.780381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ddfc4-f01c-4238-82b3-44a63047f104 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:28.786949 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73b667-a1bb-4a7c-aef1-d03246190066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:28.787830 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73b667-a1bb-4a7c-aef1-d03246190066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:28.788257 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73b667-a1bb-4a7c-aef1-d03246190066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:28.789046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba73b667-a1bb-4a7c-aef1-d03246190066 admin admin] PATH_INFO: `/v3/projects/5409e4b7f8ad47d18baf935ffa7adeb0` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:28.790341 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73b667-a1bb-4a7c-aef1-d03246190066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5409e4b7f8ad47d18baf935ffa7adeb0)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:28.792799 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba73b667-a1bb-4a7c-aef1-d03246190066 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:28.843230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955ab689-fda2-40ba-a637-f1dfff95a05a admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:28.850224 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e1e05-8460-4af5-b6de-98d7d0e0d268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:28.851374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e1e05-8460-4af5-b6de-98d7d0e0d268 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:28.851721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e1e05-8460-4af5-b6de-98d7d0e0d268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:28.852205 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678e1e05-8460-4af5-b6de-98d7d0e0d268 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:28.854750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e1e05-8460-4af5-b6de-98d7d0e0d268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:28.857541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678e1e05-8460-4af5-b6de-98d7d0e0d268 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:28.891409 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ba73b667-a1bb-4a7c-aef1-d03246190066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5409e4b7f8ad47d18baf935ffa7adeb0', 'request_id': 'req-ba73b667-a1bb-4a7c-aef1-d03246190066'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.899336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 980/1948] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:28 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:28.899336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e1e05-8460-4af5-b6de-98d7d0e0d268 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:28.899560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ba73b667-a1bb-4a7c-aef1-d03246190066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5409e4b7f8ad47d18baf935ffa7adeb0', 'request_id': 'req-ba73b667-a1bb-4a7c-aef1-d03246190066'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.902795 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-678e1e05-8460-4af5-b6de-98d7d0e0d268 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:28.907674 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ba73b667-a1bb-4a7c-aef1-d03246190066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5409e4b7f8ad47d18baf935ffa7adeb0', 'request_id': 'req-ba73b667-a1bb-4a7c-aef1-d03246190066'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.918404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678e1e05-8460-4af5-b6de-98d7d0e0d268 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:28.924838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ba73b667-a1bb-4a7c-aef1-d03246190066 admin admin] The token cache is being invalidate because project 5409e4b7f8ad47d18baf935ffa7adeb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:28.925346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ba73b667-a1bb-4a7c-aef1-d03246190066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.926315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ba73b667-a1bb-4a7c-aef1-d03246190066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:28.930859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 969/1949] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:28 2022] DELETE /identity/v3/projects/5409e4b7f8ad47d18baf935ffa7adeb0 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:28.930859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73b667-a1bb-4a7c-aef1-d03246190066 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:28.930859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ba73b667-a1bb-4a7c-aef1-d03246190066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:28.994575 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b452a7-0c33-407e-9004-48c6e019c4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:28.995495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b452a7-0c33-407e-9004-48c6e019c4ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:28.995914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b452a7-0c33-407e-9004-48c6e019c4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:28.996287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b452a7-0c33-407e-9004-48c6e019c4ea admin admin] PATH_INFO: `/v3/users/5ea5071e4f114f8db7084ae9822dbfdb` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:28.998118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b452a7-0c33-407e-9004-48c6e019c4ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ea5071e4f114f8db7084ae9822dbfdb)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:29.000221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b452a7-0c33-407e-9004-48c6e019c4ea admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:29.030510 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba73b667-a1bb-4a7c-aef1-d03246190066 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:29.033183 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:29.038673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331ae60-96e4-47e2-8583-91d0d60f2ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:29.039678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331ae60-96e4-47e2-8583-91d0d60f2ea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:29.040264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331ae60-96e4-47e2-8583-91d0d60f2ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:29.040783 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331ae60-96e4-47e2-8583-91d0d60f2ea9 admin admin] PATH_INFO: `/v3/projects/6bf1a7e9daa4475f84e8b924dc446df3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:29.042526 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331ae60-96e4-47e2-8583-91d0d60f2ea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf1a7e9daa4475f84e8b924dc446df3)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:29.044946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331ae60-96e4-47e2-8583-91d0d60f2ea9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:29.082198 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-f2b452a7-0c33-407e-9004-48c6e019c4ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ea5071e4f114f8db7084ae9822dbfdb'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:29.112694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-f2b452a7-0c33-407e-9004-48c6e019c4ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ea5071e4f114f8db7084ae9822dbfdb'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:29.130664 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2331ae60-96e4-47e2-8583-91d0d60f2ea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf1a7e9daa4475f84e8b924dc446df3', 'request_id': 'req-2331ae60-96e4-47e2-8583-91d0d60f2ea9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:29.133991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-f2b452a7-0c33-407e-9004-48c6e019c4ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ea5071e4f114f8db7084ae9822dbfdb'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:29.134923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-f2b452a7-0c33-407e-9004-48c6e019c4ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ea5071e4f114f8db7084ae9822dbfdb'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:29.142617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2331ae60-96e4-47e2-8583-91d0d60f2ea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf1a7e9daa4475f84e8b924dc446df3', 'request_id': 'req-2331ae60-96e4-47e2-8583-91d0d60f2ea9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:29.149653 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-f2b452a7-0c33-407e-9004-48c6e019c4ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ea5071e4f114f8db7084ae9822dbfdb'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:29.164440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 981/1950] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:28 2022] DELETE /identity/v3/users/5ea5071e4f114f8db7084ae9822dbfdb => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:29.164554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2331ae60-96e4-47e2-8583-91d0d60f2ea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf1a7e9daa4475f84e8b924dc446df3', 'request_id': 'req-2331ae60-96e4-47e2-8583-91d0d60f2ea9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:29.164633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b452a7-0c33-407e-9004-48c6e019c4ea admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:29.164633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f2b452a7-0c33-407e-9004-48c6e019c4ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:29.189425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:29.196128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2331ae60-96e4-47e2-8583-91d0d60f2ea9 admin admin] The token cache is being invalidate because project 6bf1a7e9daa4475f84e8b924dc446df3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:29.196428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2331ae60-96e4-47e2-8583-91d0d60f2ea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:29.199545 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2331ae60-96e4-47e2-8583-91d0d60f2ea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:29.209731 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 970/1951] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:28 2022] DELETE /identity/v3/projects/6bf1a7e9daa4475f84e8b924dc446df3 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:29.210701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331ae60-96e4-47e2-8583-91d0d60f2ea9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:29.223540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2331ae60-96e4-47e2-8583-91d0d60f2ea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:29.300782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b452a7-0c33-407e-9004-48c6e019c4ea admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:29.342642 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebd3160-a483-49d7-a389-7ddd414dcc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:29.348158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3160-a483-49d7-a389-7ddd414dcc79 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:29.352518 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3160-a483-49d7-a389-7ddd414dcc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:29.353374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebd3160-a483-49d7-a389-7ddd414dcc79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:29.354423 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd3160-a483-49d7-a389-7ddd414dcc79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:29.360161 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebd3160-a483-49d7-a389-7ddd414dcc79 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:29.394054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 982/1952] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:29.395038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c700f-16d8-4c61-8cfc-4c50d42d1fdc None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:29.395678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c700f-16d8-4c61-8cfc-4c50d42d1fdc None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:29.395858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4c700f-16d8-4c61-8cfc-4c50d42d1fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:29.415627 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331ae60-96e4-47e2-8583-91d0d60f2ea9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:29.421509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa30aa2-fd9d-47df-9109-6978a717b47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:29.422161 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa30aa2-fd9d-47df-9109-6978a717b47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:29.422892 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa30aa2-fd9d-47df-9109-6978a717b47c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:29.422892 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa30aa2-fd9d-47df-9109-6978a717b47c admin admin] PATH_INFO: `/v3/users/4910ce555e254cf7a69d8a0e5d4418d1` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:29.423889 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa30aa2-fd9d-47df-9109-6978a717b47c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4910ce555e254cf7a69d8a0e5d4418d1)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:29.426123 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa30aa2-fd9d-47df-9109-6978a717b47c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:29.457943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6a4c700f-16d8-4c61-8cfc-4c50d42d1fdc None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:29.463716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6a4c700f-16d8-4c61-8cfc-4c50d42d1fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:29.482333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 983/1953] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:29.483629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c700f-16d8-4c61-8cfc-4c50d42d1fdc None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:29.485088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6a4c700f-16d8-4c61-8cfc-4c50d42d1fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:29.506776 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4c700f-16d8-4c61-8cfc-4c50d42d1fdc None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:29.509942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2fa30aa2-fd9d-47df-9109-6978a717b47c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4910ce555e254cf7a69d8a0e5d4418d1'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:29.515952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d878ea-c290-4ba0-b357-d19d131c853f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:29.516830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d878ea-c290-4ba0-b357-d19d131c853f admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:29.517293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d878ea-c290-4ba0-b357-d19d131c853f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:29.517728 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d878ea-c290-4ba0-b357-d19d131c853f admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:29.518658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d878ea-c290-4ba0-b357-d19d131c853f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:29.519745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2fa30aa2-fd9d-47df-9109-6978a717b47c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4910ce555e254cf7a69d8a0e5d4418d1'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:29.520707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d878ea-c290-4ba0-b357-d19d131c853f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:29.535757 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2fa30aa2-fd9d-47df-9109-6978a717b47c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4910ce555e254cf7a69d8a0e5d4418d1'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:29.543842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 984/1954] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:29.543842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a7f4b-51bc-4ffb-bec7-cb9324fb4c7b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:29.543842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a7f4b-51bc-4ffb-bec7-cb9324fb4c7b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:29.543842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a7f4b-51bc-4ffb-bec7-cb9324fb4c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:29.547459 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2fa30aa2-fd9d-47df-9109-6978a717b47c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4910ce555e254cf7a69d8a0e5d4418d1'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:29.549784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2fa30aa2-fd9d-47df-9109-6978a717b47c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4910ce555e254cf7a69d8a0e5d4418d1'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:29.562098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 971/1955] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:29 2022] DELETE /identity/v3/users/4910ce555e254cf7a69d8a0e5d4418d1 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:29.562098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa30aa2-fd9d-47df-9109-6978a717b47c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:29.562405 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2fa30aa2-fd9d-47df-9109-6978a717b47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:29.591921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ae1a7f4b-51bc-4ffb-bec7-cb9324fb4c7b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:29.594051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ae1a7f4b-51bc-4ffb-bec7-cb9324fb4c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:29.682097 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 985/1956] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:29.688974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a7f4b-51bc-4ffb-bec7-cb9324fb4c7b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:29.708527 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa30aa2-fd9d-47df-9109-6978a717b47c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:29.714379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b878d2d0-595d-4e9d-a02c-d558b04398e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:29.715747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878d2d0-595d-4e9d-a02c-d558b04398e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:29.716099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878d2d0-595d-4e9d-a02c-d558b04398e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:29.716441 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b878d2d0-595d-4e9d-a02c-d558b04398e9 admin admin] PATH_INFO: `/v3/projects/ad3a9ba7849d4c888736e1d770376ec6/users/af1901e85e7b4dfcb8e45c289f8a5584/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:29.721677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a7f4b-51bc-4ffb-bec7-cb9324fb4c7b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:29.732228 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb89d1-6173-4e77-8ca0-0a74f4476e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:29.733036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb89d1-6173-4e77-8ca0-0a74f4476e3b admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:29.733592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb89d1-6173-4e77-8ca0-0a74f4476e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:29.733886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bb89d1-6173-4e77-8ca0-0a74f4476e3b admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:29.734767 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb89d1-6173-4e77-8ca0-0a74f4476e3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:29.735075 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb89d1-6173-4e77-8ca0-0a74f4476e3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:29.741809 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bb89d1-6173-4e77-8ca0-0a74f4476e3b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:29.747000 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878d2d0-595d-4e9d-a02c-d558b04398e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad3a9ba7849d4c888736e1d770376ec6, user_id=af1901e85e7b4dfcb8e45c289f8a5584, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:29.751540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b878d2d0-595d-4e9d-a02c-d558b04398e9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:29.771560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:29.772380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 986/1957] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:38:29.778869 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb89d1-6173-4e77-8ca0-0a74f4476e3b admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:29.785944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 972/1958] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:29 2022] PUT /identity/v3/projects/ad3a9ba7849d4c888736e1d770376ec6/users/af1901e85e7b4dfcb8e45c289f8a5584/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:29.800976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541250d-8ea6-4246-8e49-a9476c948d18 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:29.801736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541250d-8ea6-4246-8e49-a9476c948d18 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:29.801736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e541250d-8ea6-4246-8e49-a9476c948d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:29.805791 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:29.820067 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bb89d1-6173-4e77-8ca0-0a74f4476e3b admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:29.841611 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e541250d-8ea6-4246-8e49-a9476c948d18 None None] MFA Rules not processed for user `af1901e85e7b4dfcb8e45c289f8a5584`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:29.843136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e541250d-8ea6-4246-8e49-a9476c948d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:29.943872 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff17629-7ad4-4de4-b40c-24661e8e99b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:29.944367 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff17629-7ad4-4de4-b40c-24661e8e99b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:29.944647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff17629-7ad4-4de4-b40c-24661e8e99b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:29.944947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff17629-7ad4-4de4-b40c-24661e8e99b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:29.945581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff17629-7ad4-4de4-b40c-24661e8e99b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:29.947546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff17629-7ad4-4de4-b40c-24661e8e99b5 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:29.970671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 973/1959] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:29.975651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541250d-8ea6-4246-8e49-a9476c948d18 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:29.978231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e541250d-8ea6-4246-8e49-a9476c948d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:30.000954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 987/1960] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:29 2022] POST /identity/v3/projects => generated 377 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:30.002113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff17629-7ad4-4de4-b40c-24661e8e99b5 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:30.002842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e541250d-8ea6-4246-8e49-a9476c948d18 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:30.075074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76077604-09be-4b86-b18a-8f3bf7384a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:30.075775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76077604-09be-4b86-b18a-8f3bf7384a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.075999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76077604-09be-4b86-b18a-8f3bf7384a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.076241 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76077604-09be-4b86-b18a-8f3bf7384a8b admin admin] PATH_INFO: `/v3/projects/2dfc71d7c9944c8ab67391f7ef44cfc7` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.078833 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76077604-09be-4b86-b18a-8f3bf7384a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dfc71d7c9944c8ab67391f7ef44cfc7)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:30.081047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76077604-09be-4b86-b18a-8f3bf7384a8b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:30.081700 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff17629-7ad4-4de4-b40c-24661e8e99b5 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:30.086459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea00317-e6fc-40a3-9f19-85f404df044e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:30.087181 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea00317-e6fc-40a3-9f19-85f404df044e admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.087483 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea00317-e6fc-40a3-9f19-85f404df044e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.087758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea00317-e6fc-40a3-9f19-85f404df044e admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.088779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea00317-e6fc-40a3-9f19-85f404df044e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:30.090843 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea00317-e6fc-40a3-9f19-85f404df044e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:30.121617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 988/1961] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:30 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:30.125845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea00317-e6fc-40a3-9f19-85f404df044e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:30.137423 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-76077604-09be-4b86-b18a-8f3bf7384a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dfc71d7c9944c8ab67391f7ef44cfc7', 'request_id': 'req-76077604-09be-4b86-b18a-8f3bf7384a8b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:30.143586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-76077604-09be-4b86-b18a-8f3bf7384a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dfc71d7c9944c8ab67391f7ef44cfc7', 'request_id': 'req-76077604-09be-4b86-b18a-8f3bf7384a8b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:30.149637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-76077604-09be-4b86-b18a-8f3bf7384a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dfc71d7c9944c8ab67391f7ef44cfc7', 'request_id': 'req-76077604-09be-4b86-b18a-8f3bf7384a8b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:30.165168 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-76077604-09be-4b86-b18a-8f3bf7384a8b admin admin] The token cache is being invalidate because project 2dfc71d7c9944c8ab67391f7ef44cfc7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:30.165465 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-76077604-09be-4b86-b18a-8f3bf7384a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:30.166137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-76077604-09be-4b86-b18a-8f3bf7384a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:30.172129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 974/1962] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:29 2022] DELETE /identity/v3/projects/2dfc71d7c9944c8ab67391f7ef44cfc7 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:30.172129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76077604-09be-4b86-b18a-8f3bf7384a8b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:30.172129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-76077604-09be-4b86-b18a-8f3bf7384a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:30.197659 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:30.198750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea00317-e6fc-40a3-9f19-85f404df044e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:30.217903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:30.251579 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76077604-09be-4b86-b18a-8f3bf7384a8b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:30.260893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a9982-049d-4cfc-b777-fc88cc9fcbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:30.262582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a9982-049d-4cfc-b777-fc88cc9fcbe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.262877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a9982-049d-4cfc-b777-fc88cc9fcbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.263164 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a9982-049d-4cfc-b777-fc88cc9fcbe4 admin admin] PATH_INFO: `/v3/projects/78bf9e030213446aafd905f87f2abc1e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.264884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a9982-049d-4cfc-b777-fc88cc9fcbe4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78bf9e030213446aafd905f87f2abc1e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:30.265442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ba557-2b83-4276-843e-3349f8a31f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:30.266061 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ba557-2b83-4276-843e-3349f8a31f15 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.266387 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ba557-2b83-4276-843e-3349f8a31f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.266666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ba557-2b83-4276-843e-3349f8a31f15 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.267204 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a9982-049d-4cfc-b777-fc88cc9fcbe4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:30.267319 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ba557-2b83-4276-843e-3349f8a31f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:30.269301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ba557-2b83-4276-843e-3349f8a31f15 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:30.296656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 989/1963] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:30 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:30.297625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ba557-2b83-4276-843e-3349f8a31f15 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:30.301333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-614ba557-2b83-4276-843e-3349f8a31f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:30.317096 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ba557-2b83-4276-843e-3349f8a31f15 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:30.331993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-046a9982-049d-4cfc-b777-fc88cc9fcbe4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78bf9e030213446aafd905f87f2abc1e', 'request_id': 'req-046a9982-049d-4cfc-b777-fc88cc9fcbe4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:30.339223 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-046a9982-049d-4cfc-b777-fc88cc9fcbe4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78bf9e030213446aafd905f87f2abc1e', 'request_id': 'req-046a9982-049d-4cfc-b777-fc88cc9fcbe4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:30.349169 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-046a9982-049d-4cfc-b777-fc88cc9fcbe4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78bf9e030213446aafd905f87f2abc1e', 'request_id': 'req-046a9982-049d-4cfc-b777-fc88cc9fcbe4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:30.375682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-046a9982-049d-4cfc-b777-fc88cc9fcbe4 admin admin] The token cache is being invalidate because project 78bf9e030213446aafd905f87f2abc1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:30.376072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-046a9982-049d-4cfc-b777-fc88cc9fcbe4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:30.376993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-046a9982-049d-4cfc-b777-fc88cc9fcbe4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:30.378719 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 975/1964] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:30 2022] DELETE /identity/v3/projects/78bf9e030213446aafd905f87f2abc1e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:30.380868 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31557b47-a5dc-43b8-800d-b533fcf07cc5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.381378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31557b47-a5dc-43b8-800d-b533fcf07cc5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.381868 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31557b47-a5dc-43b8-800d-b533fcf07cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.406411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad335cf8-7478-4057-9f3c-22e3235ef259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:30.407088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad335cf8-7478-4057-9f3c-22e3235ef259 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.407567 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad335cf8-7478-4057-9f3c-22e3235ef259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.408281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad335cf8-7478-4057-9f3c-22e3235ef259 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.409088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad335cf8-7478-4057-9f3c-22e3235ef259 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:30.411363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad335cf8-7478-4057-9f3c-22e3235ef259 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:30.437788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 990/1965] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:30 2022] POST /identity/v3/users => generated 299 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:30.438710 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad335cf8-7478-4057-9f3c-22e3235ef259 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:30.440785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ad335cf8-7478-4057-9f3c-22e3235ef259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:30.455013 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad335cf8-7478-4057-9f3c-22e3235ef259 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:30.460734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2605f-591c-4b70-ac41-7eba9fb61436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:30.461421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2605f-591c-4b70-ac41-7eba9fb61436 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.461681 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-31557b47-a5dc-43b8-800d-b533fcf07cc5 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:30.461793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2605f-591c-4b70-ac41-7eba9fb61436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.461967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2605f-591c-4b70-ac41-7eba9fb61436 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.462701 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2605f-591c-4b70-ac41-7eba9fb61436 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:30.463209 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-31557b47-a5dc-43b8-800d-b533fcf07cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:30.464459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2605f-591c-4b70-ac41-7eba9fb61436 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:30.481129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 991/1966] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:30.482192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74e202-201f-4542-a093-57baeeb4b9a7 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.482339 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74e202-201f-4542-a093-57baeeb4b9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.482613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df74e202-201f-4542-a093-57baeeb4b9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.491768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 976/1967] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:30.493840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31557b47-a5dc-43b8-800d-b533fcf07cc5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:30.500044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-31557b47-a5dc-43b8-800d-b533fcf07cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:30.522007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31557b47-a5dc-43b8-800d-b533fcf07cc5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:30.524960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-df74e202-201f-4542-a093-57baeeb4b9a7 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:30.526433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-df74e202-201f-4542-a093-57baeeb4b9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:30.532280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ea02c9-857d-400a-b156-62f425d9a451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:30.533007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea02c9-857d-400a-b156-62f425d9a451 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.533289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea02c9-857d-400a-b156-62f425d9a451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.533564 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ea02c9-857d-400a-b156-62f425d9a451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.534219 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea02c9-857d-400a-b156-62f425d9a451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:30.535878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ea02c9-857d-400a-b156-62f425d9a451 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:30.539896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 992/1968] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:30.541304 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74e202-201f-4542-a093-57baeeb4b9a7 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:30.554022 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df74e202-201f-4542-a093-57baeeb4b9a7 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:30.559491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 977/1969] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:30.559683 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e99af28-fde3-4a4d-83e0-329c688ce61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:30.560259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99af28-fde3-4a4d-83e0-329c688ce61d admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.560697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99af28-fde3-4a4d-83e0-329c688ce61d admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.560921 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13007a51-7293-4d5f-b05b-53eefc241f76 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.561214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13007a51-7293-4d5f-b05b-53eefc241f76 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.561322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e99af28-fde3-4a4d-83e0-329c688ce61d admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.561487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13007a51-7293-4d5f-b05b-53eefc241f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.561862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99af28-fde3-4a4d-83e0-329c688ce61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:30.563593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e99af28-fde3-4a4d-83e0-329c688ce61d admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:30.576486 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 993/1970] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:30.580812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250b0e-6ccc-4e67-a68c-e1b3adb48aef None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.581270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250b0e-6ccc-4e67-a68c-e1b3adb48aef None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.581545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa250b0e-6ccc-4e67-a68c-e1b3adb48aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.586013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-13007a51-7293-4d5f-b05b-53eefc241f76 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:30.587644 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-13007a51-7293-4d5f-b05b-53eefc241f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:30.598084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 978/1971] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:30.599030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13007a51-7293-4d5f-b05b-53eefc241f76 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:30.603392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-fa250b0e-6ccc-4e67-a68c-e1b3adb48aef None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:30.604488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fa250b0e-6ccc-4e67-a68c-e1b3adb48aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:30.612589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13007a51-7293-4d5f-b05b-53eefc241f76 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:30.617509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab9cf2-fe94-44be-b195-6b916edf3828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:30.618244 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab9cf2-fe94-44be-b195-6b916edf3828 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.618529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab9cf2-fe94-44be-b195-6b916edf3828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.618805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab9cf2-fe94-44be-b195-6b916edf3828 admin admin] PATH_INFO: `/v3/projects/b63befde38554c929cc17d05c57fa78e/users/e9e2e70e53174422a1deaf08e08aa223/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.624191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 994/1972] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:30.624191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa250b0e-6ccc-4e67-a68c-e1b3adb48aef None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:30.635001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa250b0e-6ccc-4e67-a68c-e1b3adb48aef None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:30.635227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab9cf2-fe94-44be-b195-6b916edf3828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63befde38554c929cc17d05c57fa78e, user_id=e9e2e70e53174422a1deaf08e08aa223, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:30.638469 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab9cf2-fe94-44be-b195-6b916edf3828 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:30.640136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b17c0-7cb0-4420-a2eb-f129b000f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:30.640837 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b17c0-7cb0-4420-a2eb-f129b000f330 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.641118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b17c0-7cb0-4420-a2eb-f129b000f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.641384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0b17c0-7cb0-4420-a2eb-f129b000f330 admin admin] PATH_INFO: `/v3/projects/781a70ae526347d4be315cad116d580a/users/f6e865f851874163b407688f406efcdf/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.656380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 979/1973] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:30 2022] PUT /identity/v3/projects/b63befde38554c929cc17d05c57fa78e/users/e9e2e70e53174422a1deaf08e08aa223/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:30.657332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab9cf2-fe94-44be-b195-6b916edf3828 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:30.662848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b17c0-7cb0-4420-a2eb-f129b000f330 admin admin] RBAC: Authorizing `identity:create_grant(project_id=781a70ae526347d4be315cad116d580a, user_id=f6e865f851874163b407688f406efcdf, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:30.666065 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0b17c0-7cb0-4420-a2eb-f129b000f330 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:30.682413 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 995/1974] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:30 2022] PUT /identity/v3/projects/781a70ae526347d4be315cad116d580a/users/f6e865f851874163b407688f406efcdf/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:30.683545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b17c0-7cb0-4420-a2eb-f129b000f330 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:30.740071 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab9cf2-fe94-44be-b195-6b916edf3828 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:30.743161 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:30.746749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:30.775038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0b17c0-7cb0-4420-a2eb-f129b000f330 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:30.781781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4daa5-e3c5-47f4-80fa-88a76c724ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:30.782452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4daa5-e3c5-47f4-80fa-88a76c724ecd admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.782737 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4daa5-e3c5-47f4-80fa-88a76c724ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.783009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4daa5-e3c5-47f4-80fa-88a76c724ecd admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.783815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4daa5-e3c5-47f4-80fa-88a76c724ecd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:30.784107 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4daa5-e3c5-47f4-80fa-88a76c724ecd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:30.785733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf4daa5-e3c5-47f4-80fa-88a76c724ecd admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:30.800404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 996/1975] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:38:30.801407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4daa5-e3c5-47f4-80fa-88a76c724ecd admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:30.813552 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4daa5-e3c5-47f4-80fa-88a76c724ecd admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:30.818830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce40e16-4282-45d6-b898-de7482cb269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:30.819487 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce40e16-4282-45d6-b898-de7482cb269f admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.819776 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce40e16-4282-45d6-b898-de7482cb269f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.820051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce40e16-4282-45d6-b898-de7482cb269f admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.820929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce40e16-4282-45d6-b898-de7482cb269f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:30.823349 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4162ea-b147-4cf9-a2cb-61822e3dbaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:30.824789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4162ea-b147-4cf9-a2cb-61822e3dbaff admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.825293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce40e16-4282-45d6-b898-de7482cb269f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:30.825585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4162ea-b147-4cf9-a2cb-61822e3dbaff admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.826043 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4162ea-b147-4cf9-a2cb-61822e3dbaff admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.826989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4162ea-b147-4cf9-a2cb-61822e3dbaff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:30.827484 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4162ea-b147-4cf9-a2cb-61822e3dbaff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:30.829383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4162ea-b147-4cf9-a2cb-61822e3dbaff admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:30.840852 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 997/1976] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:30.842611 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4304ca-2d0d-4c9d-acff-ffeca127925c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.843988 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4304ca-2d0d-4c9d-acff-ffeca127925c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.844258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4304ca-2d0d-4c9d-acff-ffeca127925c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.852350 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 980/1977] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:38:30.852350 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4162ea-b147-4cf9-a2cb-61822e3dbaff admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:30.861972 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4162ea-b147-4cf9-a2cb-61822e3dbaff admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:30.873008 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c159aa3-1722-412a-8c9f-0cf89deed966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:30.873637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c159aa3-1722-412a-8c9f-0cf89deed966 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:30.873921 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c159aa3-1722-412a-8c9f-0cf89deed966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:30.874202 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c159aa3-1722-412a-8c9f-0cf89deed966 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:30.874843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c159aa3-1722-412a-8c9f-0cf89deed966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:30.876945 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c159aa3-1722-412a-8c9f-0cf89deed966 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:30.888500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6b4304ca-2d0d-4c9d-acff-ffeca127925c None None] MFA Rules not processed for user `f6e865f851874163b407688f406efcdf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:30.890861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6b4304ca-2d0d-4c9d-acff-ffeca127925c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:30.915482 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 981/1978] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:30 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:30.916414 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c159aa3-1722-412a-8c9f-0cf89deed966 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:31.007560 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 998/1979] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:31.008514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4304ca-2d0d-4c9d-acff-ffeca127925c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:31.021019 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4304ca-2d0d-4c9d-acff-ffeca127925c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:31.025675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c159aa3-1722-412a-8c9f-0cf89deed966 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:31.026448 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5a781-fb9a-4670-ae31-f190a0a3ea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:31.027782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5a781-fb9a-4670-ae31-f190a0a3ea0d admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.027894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5a781-fb9a-4670-ae31-f190a0a3ea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.028141 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5a781-fb9a-4670-ae31-f190a0a3ea0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.028822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5a781-fb9a-4670-ae31-f190a0a3ea0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:31.030968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5a781-fb9a-4670-ae31-f190a0a3ea0d admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:31.031753 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d711c6b-d687-48f1-a185-cefb53cb55c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:31.032486 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d711c6b-d687-48f1-a185-cefb53cb55c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.032874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d711c6b-d687-48f1-a185-cefb53cb55c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.033225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d711c6b-d687-48f1-a185-cefb53cb55c3 admin admin] PATH_INFO: `/v3/projects/b63befde38554c929cc17d05c57fa78e/users/e9e2e70e53174422a1deaf08e08aa223/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.035229 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d711c6b-d687-48f1-a185-cefb53cb55c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b63befde38554c929cc17d05c57fa78e, user_id=e9e2e70e53174422a1deaf08e08aa223, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:31.038560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d711c6b-d687-48f1-a185-cefb53cb55c3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:31.053398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 982/1980] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:30 2022] PUT /identity/v3/projects/b63befde38554c929cc17d05c57fa78e/users/e9e2e70e53174422a1deaf08e08aa223/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:31.056953 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d711c6b-d687-48f1-a185-cefb53cb55c3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:31.066095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 999/1981] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:31 2022] POST /identity/v3/projects => generated 401 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:31.067219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5a781-fb9a-4670-ae31-f190a0a3ea0d admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:31.071617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d5f5a781-fb9a-4670-ae31-f190a0a3ea0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:31.128517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d711c6b-d687-48f1-a185-cefb53cb55c3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:31.153066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:31.163187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5a781-fb9a-4670-ae31-f190a0a3ea0d admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:31.169450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf82e1-36eb-4c7e-a60c-7525053d41e5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc0c92f881e40c9abe067d3a6d4251b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:31.170162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf82e1-36eb-4c7e-a60c-7525053d41e5 service glance] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.170330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf82e1-36eb-4c7e-a60c-7525053d41e5 service glance] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.170599 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf82e1-36eb-4c7e-a60c-7525053d41e5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.194128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3690c38-ccb6-4e9e-a673-dd1fc069df8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:31.194754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3690c38-ccb6-4e9e-a673-dd1fc069df8c admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.195103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3690c38-ccb6-4e9e-a673-dd1fc069df8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.195386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3690c38-ccb6-4e9e-a673-dd1fc069df8c admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.196022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3690c38-ccb6-4e9e-a673-dd1fc069df8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:31.196184 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:31.197968 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3690c38-ccb6-4e9e-a673-dd1fc069df8c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:31.220803 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 983/1982] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:31 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:31.221915 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c042d4e-5087-4ac1-a288-b0ff90665a8c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.222195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c042d4e-5087-4ac1-a288-b0ff90665a8c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.222473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c042d4e-5087-4ac1-a288-b0ff90665a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.233364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf82e1-36eb-4c7e-a60c-7525053d41e5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:31.234838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf82e1-36eb-4c7e-a60c-7525053d41e5 service glance] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:31.243738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1000/1983] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:31.244891 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf82e1-36eb-4c7e-a60c-7525053d41e5 service glance] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:31.249782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4c042d4e-5087-4ac1-a288-b0ff90665a8c None None] MFA Rules not processed for user `e9e2e70e53174422a1deaf08e08aa223`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:31.250995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4c042d4e-5087-4ac1-a288-b0ff90665a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:31.256633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf82e1-36eb-4c7e-a60c-7525053d41e5 service glance] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:31.262667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8408c-ca4e-4c7a-8da0-7593a34c32b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:31.263653 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8408c-ca4e-4c7a-8da0-7593a34c32b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.264152 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8408c-ca4e-4c7a-8da0-7593a34c32b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.264576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d8408c-ca4e-4c7a-8da0-7593a34c32b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.265637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8408c-ca4e-4c7a-8da0-7593a34c32b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:31.269014 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d8408c-ca4e-4c7a-8da0-7593a34c32b8 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:31.298951 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1001/1984] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:31 2022] POST /identity/v3/users => generated 301 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:31.298951 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8408c-ca4e-4c7a-8da0-7593a34c32b8 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:31.315774 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d8408c-ca4e-4c7a-8da0-7593a34c32b8 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:31.321172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6074f9f-3db9-4860-ac5e-0dec36097163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:31.321849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074f9f-3db9-4860-ac5e-0dec36097163 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.322134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074f9f-3db9-4860-ac5e-0dec36097163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.322407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6074f9f-3db9-4860-ac5e-0dec36097163 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.323090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6074f9f-3db9-4860-ac5e-0dec36097163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:31.325180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6074f9f-3db9-4860-ac5e-0dec36097163 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:31.336212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1002/1985] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:31.336873 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6074f9f-3db9-4860-ac5e-0dec36097163 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:31.348965 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6074f9f-3db9-4860-ac5e-0dec36097163 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:31.350171 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 984/1986] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:31.354482 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c042d4e-5087-4ac1-a288-b0ff90665a8c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:31.356207 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fab00-be10-49d9-95fd-97a3113df672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:31.356982 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fab00-be10-49d9-95fd-97a3113df672 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.357329 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fab00-be10-49d9-95fd-97a3113df672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.357669 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131fab00-be10-49d9-95fd-97a3113df672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.358505 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fab00-be10-49d9-95fd-97a3113df672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:31.360369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131fab00-be10-49d9-95fd-97a3113df672 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:31.377835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c042d4e-5087-4ac1-a288-b0ff90665a8c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:31.379867 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1003/1987] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:31.383527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fab00-be10-49d9-95fd-97a3113df672 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:31.385610 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-131fab00-be10-49d9-95fd-97a3113df672 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:31.387941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989e206-dccc-4d23-adc0-7816a3662138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:31.388921 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989e206-dccc-4d23-adc0-7816a3662138 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.389046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989e206-dccc-4d23-adc0-7816a3662138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.389506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989e206-dccc-4d23-adc0-7816a3662138 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.390340 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989e206-dccc-4d23-adc0-7816a3662138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:31.392374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989e206-dccc-4d23-adc0-7816a3662138 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:31.406826 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 985/1988] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:31.407678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989e206-dccc-4d23-adc0-7816a3662138 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:31.418939 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989e206-dccc-4d23-adc0-7816a3662138 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:31.424156 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e1333-ed3b-4ce4-8bf8-9043ef2a65d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:31.424792 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e1333-ed3b-4ce4-8bf8-9043ef2a65d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.425076 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e1333-ed3b-4ce4-8bf8-9043ef2a65d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.425350 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866e1333-ed3b-4ce4-8bf8-9043ef2a65d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.425997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e1333-ed3b-4ce4-8bf8-9043ef2a65d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:31.427860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866e1333-ed3b-4ce4-8bf8-9043ef2a65d3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:31.451126 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 986/1989] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:31.452413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e1333-ed3b-4ce4-8bf8-9043ef2a65d3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:31.467356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131fab00-be10-49d9-95fd-97a3113df672 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:31.471383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866e1333-ed3b-4ce4-8bf8-9043ef2a65d3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:31.478210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3821084-936b-4150-a57d-4cf2702eb95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:31.478985 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3821084-936b-4150-a57d-4cf2702eb95e admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.479401 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3821084-936b-4150-a57d-4cf2702eb95e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.479767 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3821084-936b-4150-a57d-4cf2702eb95e admin admin] PATH_INFO: `/v3/projects/4dd5067abb2f49b2899f5b481de1238d/users/1eb38ffbf5cd454e9de1849f0b781094/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.483724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7ee48-5c18-4ef9-9b2a-1af8b4cf541a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:31.485164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7ee48-5c18-4ef9-9b2a-1af8b4cf541a service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.485710 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7ee48-5c18-4ef9-9b2a-1af8b4cf541a service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.487429 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d7ee48-5c18-4ef9-9b2a-1af8b4cf541a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.505671 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7ee48-5c18-4ef9-9b2a-1af8b4cf541a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:31.507153 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3821084-936b-4150-a57d-4cf2702eb95e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dd5067abb2f49b2899f5b481de1238d, user_id=1eb38ffbf5cd454e9de1849f0b781094, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:31.507285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d7ee48-5c18-4ef9-9b2a-1af8b4cf541a service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:31.511065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3821084-936b-4150-a57d-4cf2702eb95e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:31.519947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1004/1990] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:31.520961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7ee48-5c18-4ef9-9b2a-1af8b4cf541a service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:31.531793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d7ee48-5c18-4ef9-9b2a-1af8b4cf541a service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:31.535476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 987/1991] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:31 2022] PUT /identity/v3/projects/4dd5067abb2f49b2899f5b481de1238d/users/1eb38ffbf5cd454e9de1849f0b781094/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:31.550605 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b50eed-d8cf-4689-baae-9b5ce3754439 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.550980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b50eed-d8cf-4689-baae-9b5ce3754439 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.551332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b50eed-d8cf-4689-baae-9b5ce3754439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.586341 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-76b50eed-d8cf-4689-baae-9b5ce3754439 None None] MFA Rules not processed for user `1eb38ffbf5cd454e9de1849f0b781094`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:31.587500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-76b50eed-d8cf-4689-baae-9b5ce3754439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:31.620319 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434a455-d39c-43fb-b116-ab2dbe71f4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:31.621845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434a455-d39c-43fb-b116-ab2dbe71f4d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.622340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434a455-d39c-43fb-b116-ab2dbe71f4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.622684 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5434a455-d39c-43fb-b116-ab2dbe71f4d4 admin admin] PATH_INFO: `/v3/projects/b1c4d7f33a984d478fc33c83543d7b43/users/ee477f2bc9884d60be75775420536753/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.653088 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:31.668304 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434a455-d39c-43fb-b116-ab2dbe71f4d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c4d7f33a984d478fc33c83543d7b43, user_id=ee477f2bc9884d60be75775420536753, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:31.672139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5434a455-d39c-43fb-b116-ab2dbe71f4d4 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:31.696499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 988/1992] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:38:31.702643 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1005/1993] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:31 2022] PUT /identity/v3/projects/b1c4d7f33a984d478fc33c83543d7b43/users/ee477f2bc9884d60be75775420536753/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:31.715342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830a01b-4f1f-4e84-98b6-c3d50befe889 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.716033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830a01b-4f1f-4e84-98b6-c3d50befe889 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.716333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2830a01b-4f1f-4e84-98b6-c3d50befe889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.719073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434a455-d39c-43fb-b116-ab2dbe71f4d4 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:31.736051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:31.758157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2830a01b-4f1f-4e84-98b6-c3d50befe889 None None] MFA Rules not processed for user `ee477f2bc9884d60be75775420536753`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:31.759806 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2830a01b-4f1f-4e84-98b6-c3d50befe889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:31.800203 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5434a455-d39c-43fb-b116-ab2dbe71f4d4 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:31.804330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596194d-1b0a-43db-9f2f-10a3fbeaae23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:31.804969 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596194d-1b0a-43db-9f2f-10a3fbeaae23 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:31.805317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596194d-1b0a-43db-9f2f-10a3fbeaae23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:31.805660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d596194d-1b0a-43db-9f2f-10a3fbeaae23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:31.902477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596194d-1b0a-43db-9f2f-10a3fbeaae23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:31.904697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d596194d-1b0a-43db-9f2f-10a3fbeaae23 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:31.918230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1006/1994] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:31.945356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596194d-1b0a-43db-9f2f-10a3fbeaae23 service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:31.957959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 989/1995] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:31 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:31.963419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830a01b-4f1f-4e84-98b6-c3d50befe889 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:32.103486 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d596194d-1b0a-43db-9f2f-10a3fbeaae23 service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:32.122588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00a2ddb-fd80-4ee1-be81-0daa4ec2a864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:32.124361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a2ddb-fd80-4ee1-be81-0daa4ec2a864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:32.125377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a2ddb-fd80-4ee1-be81-0daa4ec2a864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:32.126502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00a2ddb-fd80-4ee1-be81-0daa4ec2a864 admin admin] PATH_INFO: `/v3/users/1eb38ffbf5cd454e9de1849f0b781094` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:32.130263 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a2ddb-fd80-4ee1-be81-0daa4ec2a864 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1eb38ffbf5cd454e9de1849f0b781094)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:32.134055 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00a2ddb-fd80-4ee1-be81-0daa4ec2a864 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:32.182264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2830a01b-4f1f-4e84-98b6-c3d50befe889 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:32.188417 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eca5c-ef52-434b-8a3d-855920f1fb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:32.189479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eca5c-ef52-434b-8a3d-855920f1fb68 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:32.189479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eca5c-ef52-434b-8a3d-855920f1fb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:32.189771 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eca5c-ef52-434b-8a3d-855920f1fb68 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:32.198005 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eca5c-ef52-434b-8a3d-855920f1fb68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:32.207716 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eca5c-ef52-434b-8a3d-855920f1fb68 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:32.296934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b00a2ddb-fd80-4ee1-be81-0daa4ec2a864 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1eb38ffbf5cd454e9de1849f0b781094'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:32.311990 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b00a2ddb-fd80-4ee1-be81-0daa4ec2a864 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1eb38ffbf5cd454e9de1849f0b781094'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:32.323605 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:32.336405 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b00a2ddb-fd80-4ee1-be81-0daa4ec2a864 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1eb38ffbf5cd454e9de1849f0b781094'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:32.337499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b00a2ddb-fd80-4ee1-be81-0daa4ec2a864 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1eb38ffbf5cd454e9de1849f0b781094'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:32.367187 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 990/1996] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:31 2022] POST /identity/v3/projects => generated 401 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:32.378350 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eca5c-ef52-434b-8a3d-855920f1fb68 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:32.385679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b00a2ddb-fd80-4ee1-be81-0daa4ec2a864 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1eb38ffbf5cd454e9de1849f0b781094'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:32.422736 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1007/1997] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:31 2022] DELETE /identity/v3/users/1eb38ffbf5cd454e9de1849f0b781094 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:32.427392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b2e64-42af-4e76-b1e8-03c861fb566b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:32.427943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b2e64-42af-4e76-b1e8-03c861fb566b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:32.428385 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127b2e64-42af-4e76-b1e8-03c861fb566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:32.493590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-127b2e64-42af-4e76-b1e8-03c861fb566b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:32.496521 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-127b2e64-42af-4e76-b1e8-03c861fb566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:32.593276 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:32.602121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eca5c-ef52-434b-8a3d-855920f1fb68 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:32.746100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1008/1998] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:38:32.793722 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b2e64-42af-4e76-b1e8-03c861fb566b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:32.799340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-127b2e64-42af-4e76-b1e8-03c861fb566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:32.816417 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443d697-1ff3-4851-9425-0ad708bfe5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:32.817196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443d697-1ff3-4851-9425-0ad708bfe5ca admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:32.817481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443d697-1ff3-4851-9425-0ad708bfe5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:32.817908 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443d697-1ff3-4851-9425-0ad708bfe5ca admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:32.818563 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443d697-1ff3-4851-9425-0ad708bfe5ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:32.820608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7443d697-1ff3-4851-9425-0ad708bfe5ca admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:32.863167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 991/1999] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:32 2022] POST /identity/v3/users => generated 307 bytes in 485 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:32.867349 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443d697-1ff3-4851-9425-0ad708bfe5ca admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:32.870485 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7443d697-1ff3-4851-9425-0ad708bfe5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:32.888325 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443d697-1ff3-4851-9425-0ad708bfe5ca admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:32.910654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c209c54-1f8f-458c-96ff-ab945ed73f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:32.911371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c209c54-1f8f-458c-96ff-ab945ed73f87 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:32.911747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c209c54-1f8f-458c-96ff-ab945ed73f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:32.924877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c209c54-1f8f-458c-96ff-ab945ed73f87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:32.927092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c209c54-1f8f-458c-96ff-ab945ed73f87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:32.930059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c209c54-1f8f-458c-96ff-ab945ed73f87 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:32.947103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127b2e64-42af-4e76-b1e8-03c861fb566b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:32.952542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 992/2000] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:32.953790 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c209c54-1f8f-458c-96ff-ab945ed73f87 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:32.958255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc421c33-62c6-4621-ae33-30536df5e0f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:32.958890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc421c33-62c6-4621-ae33-30536df5e0f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:32.959174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc421c33-62c6-4621-ae33-30536df5e0f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:32.959452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc421c33-62c6-4621-ae33-30536df5e0f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:32.966315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c209c54-1f8f-458c-96ff-ab945ed73f87 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:32.971339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cd422-bdea-4d4b-b220-6591a869c26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:32.972890 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cd422-bdea-4d4b-b220-6591a869c26e admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:32.973209 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cd422-bdea-4d4b-b220-6591a869c26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:32.973484 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5cd422-bdea-4d4b-b220-6591a869c26e admin admin] PATH_INFO: `/v3/projects/b6c4834806de46d4b0875f9e06ac23a2/users/39e029db394349599bc83127d66ea8f8/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:32.985092 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc421c33-62c6-4621-ae33-30536df5e0f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:32.986569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc421c33-62c6-4621-ae33-30536df5e0f1 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:33.000053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1009/2001] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:33.001805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cd422-bdea-4d4b-b220-6591a869c26e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c4834806de46d4b0875f9e06ac23a2, user_id=39e029db394349599bc83127d66ea8f8, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:33.004489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5cd422-bdea-4d4b-b220-6591a869c26e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:33.034537 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc421c33-62c6-4621-ae33-30536df5e0f1 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:33.035162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 993/2002] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:32 2022] PUT /identity/v3/projects/b6c4834806de46d4b0875f9e06ac23a2/users/39e029db394349599bc83127d66ea8f8/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:33.059607 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc421c33-62c6-4621-ae33-30536df5e0f1 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:33.071826 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cd422-bdea-4d4b-b220-6591a869c26e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:33.073942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8e5cd422-bdea-4d4b-b220-6591a869c26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:33.144014 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25a1a7-0031-475b-ba93-1b6e4e26cc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:33.145569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25a1a7-0031-475b-ba93-1b6e4e26cc80 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:33.145569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25a1a7-0031-475b-ba93-1b6e4e26cc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:33.145569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25a1a7-0031-475b-ba93-1b6e4e26cc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:33.146279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25a1a7-0031-475b-ba93-1b6e4e26cc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:33.157245 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25a1a7-0031-475b-ba93-1b6e4e26cc80 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:33.179224 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1010/2003] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:33.189808 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25a1a7-0031-475b-ba93-1b6e4e26cc80 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:33.202781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25a1a7-0031-475b-ba93-1b6e4e26cc80 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:33.217876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc953bd-bb66-4a00-b308-66bd6332cf38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:33.218506 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc953bd-bb66-4a00-b308-66bd6332cf38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:33.218795 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc953bd-bb66-4a00-b308-66bd6332cf38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:33.219057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc953bd-bb66-4a00-b308-66bd6332cf38 admin admin] PATH_INFO: `/v3/projects/b6c4834806de46d4b0875f9e06ac23a2/users/39e029db394349599bc83127d66ea8f8/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:33.222226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc953bd-bb66-4a00-b308-66bd6332cf38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c4834806de46d4b0875f9e06ac23a2, user_id=39e029db394349599bc83127d66ea8f8, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:33.224935 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc953bd-bb66-4a00-b308-66bd6332cf38 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:33.249788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1011/2004] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:33 2022] PUT /identity/v3/projects/b6c4834806de46d4b0875f9e06ac23a2/users/39e029db394349599bc83127d66ea8f8/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:33.260850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856546f-5ffa-43f9-ba4e-81394c329423 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:33.260850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856546f-5ffa-43f9-ba4e-81394c329423 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:33.260850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0856546f-5ffa-43f9-ba4e-81394c329423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:33.307253 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:33.314686 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5cd422-bdea-4d4b-b220-6591a869c26e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:33.323254 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0856546f-5ffa-43f9-ba4e-81394c329423 None None] MFA Rules not processed for user `39e029db394349599bc83127d66ea8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:33.329131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0856546f-5ffa-43f9-ba4e-81394c329423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:33.397321 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b058a45-d9eb-46e3-ad4d-d56604f5a6c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:33.398408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b058a45-d9eb-46e3-ad4d-d56604f5a6c1 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:33.398713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b058a45-d9eb-46e3-ad4d-d56604f5a6c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:33.399211 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b058a45-d9eb-46e3-ad4d-d56604f5a6c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:33.404319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8b058a45-d9eb-46e3-ad4d-d56604f5a6c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:33.452491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:33.458497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1012/2005] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:33 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:38:33.460496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856546f-5ffa-43f9-ba4e-81394c329423 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:33.461984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0856546f-5ffa-43f9-ba4e-81394c329423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:33.477266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0856546f-5ffa-43f9-ba4e-81394c329423 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:33.481969 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341af9c1-072c-4843-84f1-7de7138d97e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:33.482598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341af9c1-072c-4843-84f1-7de7138d97e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:33.483107 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341af9c1-072c-4843-84f1-7de7138d97e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:33.483630 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341af9c1-072c-4843-84f1-7de7138d97e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:33.497007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341af9c1-072c-4843-84f1-7de7138d97e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:33.498467 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341af9c1-072c-4843-84f1-7de7138d97e0 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:33.498584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b058a45-d9eb-46e3-ad4d-d56604f5a6c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:33.499917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b058a45-d9eb-46e3-ad4d-d56604f5a6c1 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:33.526023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1013/2006] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:33 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:33.528980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 994/2007] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:33.641708 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341af9c1-072c-4843-84f1-7de7138d97e0 service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:33.652805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341af9c1-072c-4843-84f1-7de7138d97e0 service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:33.658143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e98a71-7127-449b-b18b-63448bfbdbe1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:33.658748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e98a71-7127-449b-b18b-63448bfbdbe1 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:33.659025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e98a71-7127-449b-b18b-63448bfbdbe1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:33.659463 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e98a71-7127-449b-b18b-63448bfbdbe1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:33.661808 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-81e98a71-7127-449b-b18b-63448bfbdbe1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:33.732312 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e98a71-7127-449b-b18b-63448bfbdbe1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:33.733969 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e98a71-7127-449b-b18b-63448bfbdbe1 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:33.744975 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1014/2008] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:33 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:34.085416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b058a45-d9eb-46e3-ad4d-d56604f5a6c1 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:34.086943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8b058a45-d9eb-46e3-ad4d-d56604f5a6c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:34.180420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b058a45-d9eb-46e3-ad4d-d56604f5a6c1 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:34.185219 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc473bbe-bee3-411c-a629-a0d6494b7118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:34.185953 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc473bbe-bee3-411c-a629-a0d6494b7118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:34.186281 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc473bbe-bee3-411c-a629-a0d6494b7118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:34.186563 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc473bbe-bee3-411c-a629-a0d6494b7118 admin admin] PATH_INFO: `/v3/projects/4dd5067abb2f49b2899f5b481de1238d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:34.188283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc473bbe-bee3-411c-a629-a0d6494b7118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dd5067abb2f49b2899f5b481de1238d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:34.190788 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc473bbe-bee3-411c-a629-a0d6494b7118 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:34.260706 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cc473bbe-bee3-411c-a629-a0d6494b7118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dd5067abb2f49b2899f5b481de1238d', 'request_id': 'req-cc473bbe-bee3-411c-a629-a0d6494b7118'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:34.267487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cc473bbe-bee3-411c-a629-a0d6494b7118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dd5067abb2f49b2899f5b481de1238d', 'request_id': 'req-cc473bbe-bee3-411c-a629-a0d6494b7118'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:34.274442 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cc473bbe-bee3-411c-a629-a0d6494b7118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dd5067abb2f49b2899f5b481de1238d', 'request_id': 'req-cc473bbe-bee3-411c-a629-a0d6494b7118'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:34.289051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cc473bbe-bee3-411c-a629-a0d6494b7118 admin admin] The token cache is being invalidate because project 4dd5067abb2f49b2899f5b481de1238d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:34.289664 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cc473bbe-bee3-411c-a629-a0d6494b7118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:34.290554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cc473bbe-bee3-411c-a629-a0d6494b7118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:34.298160 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 995/2009] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:34 2022] DELETE /identity/v3/projects/4dd5067abb2f49b2899f5b481de1238d => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:34.302946 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e623e-f8b9-4f47-908b-a321e9822388 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:34.303474 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e623e-f8b9-4f47-908b-a321e9822388 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:34.303474 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3e623e-f8b9-4f47-908b-a321e9822388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:34.323276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-4d3e623e-f8b9-4f47-908b-a321e9822388 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:34.324507 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4d3e623e-f8b9-4f47-908b-a321e9822388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:34.387234 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1015/2010] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:34.395055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355e43-8eaa-4dde-bc4d-063975cb9f29 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:34.395624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355e43-8eaa-4dde-bc4d-063975cb9f29 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:34.395890 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4355e43-8eaa-4dde-bc4d-063975cb9f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:34.416420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d4355e43-8eaa-4dde-bc4d-063975cb9f29 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:34.418322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d4355e43-8eaa-4dde-bc4d-063975cb9f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:34.426743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 996/2011] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:34.431125 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e623e-f8b9-4f47-908b-a321e9822388 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:34.441444 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3e623e-f8b9-4f47-908b-a321e9822388 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:34.446519 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11638a-3853-4c8d-8a31-bc54e71c4639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:34.447258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11638a-3853-4c8d-8a31-bc54e71c4639 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:34.447485 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11638a-3853-4c8d-8a31-bc54e71c4639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:34.447776 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11638a-3853-4c8d-8a31-bc54e71c4639 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:34.448512 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11638a-3853-4c8d-8a31-bc54e71c4639 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:34.448702 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11638a-3853-4c8d-8a31-bc54e71c4639 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:34.450506 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11638a-3853-4c8d-8a31-bc54e71c4639 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:34.468125 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1016/2012] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:38:34.472502 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4355e43-8eaa-4dde-bc4d-063975cb9f29 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:34.483098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4355e43-8eaa-4dde-bc4d-063975cb9f29 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:34.491913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac3a1d-9de2-4c88-a8dc-a37928920e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:34.492994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac3a1d-9de2-4c88-a8dc-a37928920e31 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:34.493559 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac3a1d-9de2-4c88-a8dc-a37928920e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:34.493877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac3a1d-9de2-4c88-a8dc-a37928920e31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:34.495093 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac3a1d-9de2-4c88-a8dc-a37928920e31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:34.497744 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac3a1d-9de2-4c88-a8dc-a37928920e31 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:34.529436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 997/2013] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:34 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:34.533734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11638a-3853-4c8d-8a31-bc54e71c4639 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:34.545442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11638a-3853-4c8d-8a31-bc54e71c4639 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:34.550837 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:34.609728 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7602b0c-3d46-4694-930b-facee9d5b76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:34.610352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7602b0c-3d46-4694-930b-facee9d5b76c admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:34.610634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7602b0c-3d46-4694-930b-facee9d5b76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:34.610912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7602b0c-3d46-4694-930b-facee9d5b76c admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:34.611556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7602b0c-3d46-4694-930b-facee9d5b76c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:34.613530 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7602b0c-3d46-4694-930b-facee9d5b76c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:34.645943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1017/2014] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:34 2022] POST /identity/v3/users => generated 283 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:34.647038 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac3a1d-9de2-4c88-a8dc-a37928920e31 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:34.658618 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac3a1d-9de2-4c88-a8dc-a37928920e31 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:34.708496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf0ae9-df02-481f-bca5-d0c9d1b3262f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:34.709254 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf0ae9-df02-481f-bca5-d0c9d1b3262f admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:34.709725 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf0ae9-df02-481f-bca5-d0c9d1b3262f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:34.710224 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf0ae9-df02-481f-bca5-d0c9d1b3262f admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:34.711169 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf0ae9-df02-481f-bca5-d0c9d1b3262f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:34.712978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf0ae9-df02-481f-bca5-d0c9d1b3262f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:34.733255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 998/2015] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:34.737440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7602b0c-3d46-4694-930b-facee9d5b76c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:34.749505 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7602b0c-3d46-4694-930b-facee9d5b76c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:34.754300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946e011-18b2-45b3-b541-8ad8861aed73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:34.755057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e011-18b2-45b3-b541-8ad8861aed73 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:34.755339 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e011-18b2-45b3-b541-8ad8861aed73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:34.755610 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946e011-18b2-45b3-b541-8ad8861aed73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:34.756259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946e011-18b2-45b3-b541-8ad8861aed73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:34.757910 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946e011-18b2-45b3-b541-8ad8861aed73 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:34.770487 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1018/2016] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:34.774488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf0ae9-df02-481f-bca5-d0c9d1b3262f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:34.785278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf0ae9-df02-481f-bca5-d0c9d1b3262f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:34.792005 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80261327-dd9a-4927-9036-e1ebb364be4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:34.793275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80261327-dd9a-4927-9036-e1ebb364be4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:34.793558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80261327-dd9a-4927-9036-e1ebb364be4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:34.793835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80261327-dd9a-4927-9036-e1ebb364be4e admin admin] PATH_INFO: `/v3/projects/bcdb57d3109345a48a890511a5f3bb1d/users/1105afef62244fa58efdea30eb36dbb2/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:34.814860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80261327-dd9a-4927-9036-e1ebb364be4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcdb57d3109345a48a890511a5f3bb1d, user_id=1105afef62244fa58efdea30eb36dbb2, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:34.818282 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80261327-dd9a-4927-9036-e1ebb364be4e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:34.821014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:34.837594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 999/2017] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:34 2022] PUT /identity/v3/projects/bcdb57d3109345a48a890511a5f3bb1d/users/1105afef62244fa58efdea30eb36dbb2/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:34.848440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b445f-e678-4aea-aae8-3284497ff5e3 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:34.848756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b445f-e678-4aea-aae8-3284497ff5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:34.849030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b445f-e678-4aea-aae8-3284497ff5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:34.882366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-3e6b445f-e678-4aea-aae8-3284497ff5e3 None None] MFA Rules not processed for user `1105afef62244fa58efdea30eb36dbb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:34.883593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3e6b445f-e678-4aea-aae8-3284497ff5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:34.990463 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1019/2018] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:34 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:35.001356 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80261327-dd9a-4927-9036-e1ebb364be4e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:35.003873 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-80261327-dd9a-4927-9036-e1ebb364be4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:35.079541 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80261327-dd9a-4927-9036-e1ebb364be4e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:35.085035 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e982479-414c-4a89-967c-b80c16a9acd9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:35.085672 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e982479-414c-4a89-967c-b80c16a9acd9 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:35.085952 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e982479-414c-4a89-967c-b80c16a9acd9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:35.086256 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e982479-414c-4a89-967c-b80c16a9acd9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:35.104033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e982479-414c-4a89-967c-b80c16a9acd9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:35.104033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e982479-414c-4a89-967c-b80c16a9acd9 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:35.115759 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1000/2019] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:38.001614 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b445f-e678-4aea-aae8-3284497ff5e3 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:38.003083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3e6b445f-e678-4aea-aae8-3284497ff5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:38.015398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b445f-e678-4aea-aae8-3284497ff5e3 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:38.019107 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1686a-23fb-4c95-b6b5-8514f6791995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:38.019711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1686a-23fb-4c95-b6b5-8514f6791995 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:38.019989 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1686a-23fb-4c95-b6b5-8514f6791995 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:38.020260 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1686a-23fb-4c95-b6b5-8514f6791995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:38.022050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1ff1686a-23fb-4c95-b6b5-8514f6791995 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:38.086394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1686a-23fb-4c95-b6b5-8514f6791995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:38.087836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1686a-23fb-4c95-b6b5-8514f6791995 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:38.096760 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1020/2020] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:38.607432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e982479-414c-4a89-967c-b80c16a9acd9 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:38.612828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8e982479-414c-4a89-967c-b80c16a9acd9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:38.726997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e982479-414c-4a89-967c-b80c16a9acd9 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:38.741295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4bfad-e879-4b4f-ad03-49e40bf6fb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:38.741295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4bfad-e879-4b4f-ad03-49e40bf6fb7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:38.741295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4bfad-e879-4b4f-ad03-49e40bf6fb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:38.741295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f4bfad-e879-4b4f-ad03-49e40bf6fb7a admin admin] PATH_INFO: `/v3/users/ee477f2bc9884d60be75775420536753` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:38.741566 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4bfad-e879-4b4f-ad03-49e40bf6fb7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee477f2bc9884d60be75775420536753)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:38.741566 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f4bfad-e879-4b4f-ad03-49e40bf6fb7a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:38.815447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-82f4bfad-e879-4b4f-ad03-49e40bf6fb7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee477f2bc9884d60be75775420536753'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:38.825570 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-82f4bfad-e879-4b4f-ad03-49e40bf6fb7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee477f2bc9884d60be75775420536753'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:38.857463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-82f4bfad-e879-4b4f-ad03-49e40bf6fb7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee477f2bc9884d60be75775420536753'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:38.865345 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-82f4bfad-e879-4b4f-ad03-49e40bf6fb7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee477f2bc9884d60be75775420536753'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:38.866139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-82f4bfad-e879-4b4f-ad03-49e40bf6fb7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee477f2bc9884d60be75775420536753'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:38.874394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1001/2021] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:38 2022] DELETE /identity/v3/users/ee477f2bc9884d60be75775420536753 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:38.884750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122e43b-5aa5-484e-a2d6-ecf822b9437b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:38.885164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122e43b-5aa5-484e-a2d6-ecf822b9437b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:38.885582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b122e43b-5aa5-484e-a2d6-ecf822b9437b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:38.907702 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b122e43b-5aa5-484e-a2d6-ecf822b9437b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:38.909874 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b122e43b-5aa5-484e-a2d6-ecf822b9437b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:38.921758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:38.977960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1021/2022] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:38.988288 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4bfad-e879-4b4f-ad03-49e40bf6fb7a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:38.989708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-82f4bfad-e879-4b4f-ad03-49e40bf6fb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:39.008826 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:39.052383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f4bfad-e879-4b4f-ad03-49e40bf6fb7a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:39.056374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39593f1c-14ed-49f5-a14d-cb5825939aac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:39.057035 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39593f1c-14ed-49f5-a14d-cb5825939aac service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:39.057349 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39593f1c-14ed-49f5-a14d-cb5825939aac service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:39.057624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39593f1c-14ed-49f5-a14d-cb5825939aac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:39.068255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39593f1c-14ed-49f5-a14d-cb5825939aac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:39.069743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39593f1c-14ed-49f5-a14d-cb5825939aac service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:39.085000 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1002/2023] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:39.453347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122e43b-5aa5-484e-a2d6-ecf822b9437b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:39.454834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b122e43b-5aa5-484e-a2d6-ecf822b9437b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:39.467265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b122e43b-5aa5-484e-a2d6-ecf822b9437b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:39.472071 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d6644-0ce5-4229-812b-4acf91c9cd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:39.472741 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d6644-0ce5-4229-812b-4acf91c9cd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:39.473027 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d6644-0ce5-4229-812b-4acf91c9cd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:39.473302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0d6644-0ce5-4229-812b-4acf91c9cd64 admin admin] PATH_INFO: `/v3/projects/b1c4d7f33a984d478fc33c83543d7b43` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:39.474453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d6644-0ce5-4229-812b-4acf91c9cd64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c4d7f33a984d478fc33c83543d7b43)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:39.476484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0d6644-0ce5-4229-812b-4acf91c9cd64 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:39.527600 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6c0d6644-0ce5-4229-812b-4acf91c9cd64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c4d7f33a984d478fc33c83543d7b43', 'request_id': 'req-6c0d6644-0ce5-4229-812b-4acf91c9cd64'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:39.535210 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6c0d6644-0ce5-4229-812b-4acf91c9cd64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c4d7f33a984d478fc33c83543d7b43', 'request_id': 'req-6c0d6644-0ce5-4229-812b-4acf91c9cd64'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:39.540813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6c0d6644-0ce5-4229-812b-4acf91c9cd64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c4d7f33a984d478fc33c83543d7b43', 'request_id': 'req-6c0d6644-0ce5-4229-812b-4acf91c9cd64'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:39.551620 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6c0d6644-0ce5-4229-812b-4acf91c9cd64 admin admin] The token cache is being invalidate because project b1c4d7f33a984d478fc33c83543d7b43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:39.551906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6c0d6644-0ce5-4229-812b-4acf91c9cd64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:39.552529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6c0d6644-0ce5-4229-812b-4acf91c9cd64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:39.554044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1022/2024] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:39 2022] DELETE /identity/v3/projects/b1c4d7f33a984d478fc33c83543d7b43 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:39.558215 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39593f1c-14ed-49f5-a14d-cb5825939aac service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:39.567757 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39593f1c-14ed-49f5-a14d-cb5825939aac service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:39.625485 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198b2d78-489d-4d7f-b025-8d016381c405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:39.626257 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b2d78-489d-4d7f-b025-8d016381c405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:39.626542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b2d78-489d-4d7f-b025-8d016381c405 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:39.626878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198b2d78-489d-4d7f-b025-8d016381c405 admin admin] PATH_INFO: `/v3/users/39e029db394349599bc83127d66ea8f8` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:39.628046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b2d78-489d-4d7f-b025-8d016381c405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39e029db394349599bc83127d66ea8f8)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:39.630146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198b2d78-489d-4d7f-b025-8d016381c405 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:39.675420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-198b2d78-489d-4d7f-b025-8d016381c405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39e029db394349599bc83127d66ea8f8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:39.683078 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-198b2d78-489d-4d7f-b025-8d016381c405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39e029db394349599bc83127d66ea8f8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:39.697049 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-198b2d78-489d-4d7f-b025-8d016381c405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39e029db394349599bc83127d66ea8f8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:39.705387 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-198b2d78-489d-4d7f-b025-8d016381c405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39e029db394349599bc83127d66ea8f8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:39.706031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-198b2d78-489d-4d7f-b025-8d016381c405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39e029db394349599bc83127d66ea8f8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:39.711953 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1003/2025] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:39 2022] DELETE /identity/v3/users/39e029db394349599bc83127d66ea8f8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:40.040050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d6644-0ce5-4229-812b-4acf91c9cd64 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:40.041985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6c0d6644-0ce5-4229-812b-4acf91c9cd64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:40.066733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0d6644-0ce5-4229-812b-4acf91c9cd64 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:40.148537 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556955b6-023e-4bc1-8019-f1ebc5802c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:40.149241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556955b6-023e-4bc1-8019-f1ebc5802c9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:40.149526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556955b6-023e-4bc1-8019-f1ebc5802c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:40.149795 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556955b6-023e-4bc1-8019-f1ebc5802c9f admin admin] PATH_INFO: `/v3/projects/b6c4834806de46d4b0875f9e06ac23a2` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:40.151020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556955b6-023e-4bc1-8019-f1ebc5802c9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c4834806de46d4b0875f9e06ac23a2)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:40.153370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556955b6-023e-4bc1-8019-f1ebc5802c9f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:40.201267 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:40.217375 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-556955b6-023e-4bc1-8019-f1ebc5802c9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c4834806de46d4b0875f9e06ac23a2', 'request_id': 'req-556955b6-023e-4bc1-8019-f1ebc5802c9f'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:40.227238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-556955b6-023e-4bc1-8019-f1ebc5802c9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c4834806de46d4b0875f9e06ac23a2', 'request_id': 'req-556955b6-023e-4bc1-8019-f1ebc5802c9f'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:40.238273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-556955b6-023e-4bc1-8019-f1ebc5802c9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c4834806de46d4b0875f9e06ac23a2', 'request_id': 'req-556955b6-023e-4bc1-8019-f1ebc5802c9f'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:40.252962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-556955b6-023e-4bc1-8019-f1ebc5802c9f admin admin] The token cache is being invalidate because project b6c4834806de46d4b0875f9e06ac23a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:40.253321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-556955b6-023e-4bc1-8019-f1ebc5802c9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:40.254000 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-556955b6-023e-4bc1-8019-f1ebc5802c9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:40.256716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1023/2026] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:40 2022] DELETE /identity/v3/projects/b6c4834806de46d4b0875f9e06ac23a2 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:40.261804 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcde1b-0dce-47aa-8188-7ab3c45c0437 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:40.262291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcde1b-0dce-47aa-8188-7ab3c45c0437 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:40.262576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcde1b-0dce-47aa-8188-7ab3c45c0437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:40.287000 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-75bcde1b-0dce-47aa-8188-7ab3c45c0437 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:40.288246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-75bcde1b-0dce-47aa-8188-7ab3c45c0437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:40.351459 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:40.406634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1004/2027] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:40.415495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc087a-815c-4629-b3d1-648f92f49879 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:40.416008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc087a-815c-4629-b3d1-648f92f49879 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:40.416315 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddc087a-815c-4629-b3d1-648f92f49879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:40.443384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8ddc087a-815c-4629-b3d1-648f92f49879 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:40.445478 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8ddc087a-815c-4629-b3d1-648f92f49879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:40.460563 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1024/2028] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:38:40.465611 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcde1b-0dce-47aa-8188-7ab3c45c0437 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:40.479540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bcde1b-0dce-47aa-8188-7ab3c45c0437 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:40.492744 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a94e7-a653-4da5-a048-ea90f685fd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:40.493492 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a94e7-a653-4da5-a048-ea90f685fd58 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:40.493775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a94e7-a653-4da5-a048-ea90f685fd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:40.494316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a94e7-a653-4da5-a048-ea90f685fd58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:40.495334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a94e7-a653-4da5-a048-ea90f685fd58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:40.495334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a94e7-a653-4da5-a048-ea90f685fd58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:40.497364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a94e7-a653-4da5-a048-ea90f685fd58 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:40.526036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1005/2029] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:38:40.536350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc087a-815c-4629-b3d1-648f92f49879 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:40.553080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddc087a-815c-4629-b3d1-648f92f49879 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:40.557657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565d1e5-8d73-46a1-a752-5c30a62faed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:40.558812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565d1e5-8d73-46a1-a752-5c30a62faed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:40.559129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565d1e5-8d73-46a1-a752-5c30a62faed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:40.564084 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565d1e5-8d73-46a1-a752-5c30a62faed5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:40.564853 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565d1e5-8d73-46a1-a752-5c30a62faed5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:40.566807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565d1e5-8d73-46a1-a752-5c30a62faed5 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:40.601051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a94e7-a653-4da5-a048-ea90f685fd58 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:40.602833 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e01a94e7-a653-4da5-a048-ea90f685fd58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:40.603386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1025/2030] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:40 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:40.608176 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565d1e5-8d73-46a1-a752-5c30a62faed5 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:40.617725 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a94e7-a653-4da5-a048-ea90f685fd58 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:40.682614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c7782a-458e-478e-9cc7-28b989c1036c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:40.683325 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7782a-458e-478e-9cc7-28b989c1036c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:40.683582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7782a-458e-478e-9cc7-28b989c1036c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:40.683904 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c7782a-458e-478e-9cc7-28b989c1036c admin admin] PATH_INFO: `/v3/users/aa256ec5b4e3493598a22f9c9963a6df` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:40.685621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7782a-458e-478e-9cc7-28b989c1036c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa256ec5b4e3493598a22f9c9963a6df)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:40.687832 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c7782a-458e-478e-9cc7-28b989c1036c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:40.696120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565d1e5-8d73-46a1-a752-5c30a62faed5 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:40.701122 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2370d-e321-49f2-b056-c800829d4955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:40.701848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2370d-e321-49f2-b056-c800829d4955 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:40.702284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2370d-e321-49f2-b056-c800829d4955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:40.702554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd2370d-e321-49f2-b056-c800829d4955 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:40.703185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2370d-e321-49f2-b056-c800829d4955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:40.705161 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd2370d-e321-49f2-b056-c800829d4955 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:40.736175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1026/2031] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:40 2022] POST /identity/v3/users => generated 290 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:38:40.740157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2370d-e321-49f2-b056-c800829d4955 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:40.753296 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd2370d-e321-49f2-b056-c800829d4955 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:40.754900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b6c7782a-458e-478e-9cc7-28b989c1036c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa256ec5b4e3493598a22f9c9963a6df'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:40.758204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7200b5a-3f9c-41ef-aeae-b003a20f6a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:40.758813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200b5a-3f9c-41ef-aeae-b003a20f6a8b admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:40.759120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200b5a-3f9c-41ef-aeae-b003a20f6a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:40.759370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7200b5a-3f9c-41ef-aeae-b003a20f6a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:40.760024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7200b5a-3f9c-41ef-aeae-b003a20f6a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:40.761693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7200b5a-3f9c-41ef-aeae-b003a20f6a8b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:40.763019 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b6c7782a-458e-478e-9cc7-28b989c1036c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa256ec5b4e3493598a22f9c9963a6df'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:40.780917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b6c7782a-458e-478e-9cc7-28b989c1036c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa256ec5b4e3493598a22f9c9963a6df'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:40.788232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1027/2032] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:40.789485 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7200b5a-3f9c-41ef-aeae-b003a20f6a8b admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:40.794135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b6c7782a-458e-478e-9cc7-28b989c1036c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa256ec5b4e3493598a22f9c9963a6df'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:40.794874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b6c7782a-458e-478e-9cc7-28b989c1036c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa256ec5b4e3493598a22f9c9963a6df'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:40.804250 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1006/2033] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:40 2022] DELETE /identity/v3/users/aa256ec5b4e3493598a22f9c9963a6df => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:40.805180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7200b5a-3f9c-41ef-aeae-b003a20f6a8b admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:40.808240 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce20cb-9be1-4ba3-85b4-c33dcdbe81af None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:40.808603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce20cb-9be1-4ba3-85b4-c33dcdbe81af None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:40.809149 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ce20cb-9be1-4ba3-85b4-c33dcdbe81af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:40.845072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-37ce20cb-9be1-4ba3-85b4-c33dcdbe81af None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:40.846438 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-37ce20cb-9be1-4ba3-85b4-c33dcdbe81af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:40.898276 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:40.899291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31571eb1-7fe2-4079-a9fe-35c186f1b640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:40.900015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31571eb1-7fe2-4079-a9fe-35c186f1b640 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:40.900302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31571eb1-7fe2-4079-a9fe-35c186f1b640 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:40.900576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31571eb1-7fe2-4079-a9fe-35c186f1b640 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:40.901384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31571eb1-7fe2-4079-a9fe-35c186f1b640 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:40.903539 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31571eb1-7fe2-4079-a9fe-35c186f1b640 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:40.914793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1028/2034] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:40.921647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31571eb1-7fe2-4079-a9fe-35c186f1b640 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:40.924736 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-31571eb1-7fe2-4079-a9fe-35c186f1b640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:40.927913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1007/2035] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:38:40.938485 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31571eb1-7fe2-4079-a9fe-35c186f1b640 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:40.939737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce20cb-9be1-4ba3-85b4-c33dcdbe81af None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:40.944785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8770f-fea4-478e-b835-63730f57de3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:40.944785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8770f-fea4-478e-b835-63730f57de3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:40.944785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8770f-fea4-478e-b835-63730f57de3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:40.944785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8770f-fea4-478e-b835-63730f57de3a admin admin] PATH_INFO: `/v3/projects/c3b6341ce8c54368b6722bbb0b7ee05c/users/d02fd119fd3c49f2bd38f6af8125b045/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:40.946080 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-37ce20cb-9be1-4ba3-85b4-c33dcdbe81af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:40.979743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:40.984045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8770f-fea4-478e-b835-63730f57de3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3b6341ce8c54368b6722bbb0b7ee05c, user_id=d02fd119fd3c49f2bd38f6af8125b045, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:40.988248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8770f-fea4-478e-b835-63730f57de3a admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:41.013944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1029/2036] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:40 2022] PUT /identity/v3/projects/c3b6341ce8c54368b6722bbb0b7ee05c/users/d02fd119fd3c49f2bd38f6af8125b045/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:41.025994 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4ab52-5410-448c-8b63-2cc672f5c320 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:41.026284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4ab52-5410-448c-8b63-2cc672f5c320 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:41.026568 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de4ab52-5410-448c-8b63-2cc672f5c320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:41.034706 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ce20cb-9be1-4ba3-85b4-c33dcdbe81af None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:41.071387 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-3de4ab52-5410-448c-8b63-2cc672f5c320 None None] MFA Rules not processed for user `d02fd119fd3c49f2bd38f6af8125b045`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:41.075236 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3de4ab52-5410-448c-8b63-2cc672f5c320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:41.109529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4d60e-6542-4800-976d-ffe4000875c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:41.110567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4d60e-6542-4800-976d-ffe4000875c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:41.111132 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4d60e-6542-4800-976d-ffe4000875c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:41.111688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4d60e-6542-4800-976d-ffe4000875c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:41.197125 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1030/2037] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:41.199443 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4ab52-5410-448c-8b63-2cc672f5c320 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:41.218555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4d60e-6542-4800-976d-ffe4000875c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:41.220696 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4d60e-6542-4800-976d-ffe4000875c1 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:41.235148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1008/2038] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:41.293657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de4ab52-5410-448c-8b63-2cc672f5c320 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:41.305168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90318505-a0ef-4af8-bc44-6cd143422cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:41.305932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318505-a0ef-4af8-bc44-6cd143422cd7 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:41.306268 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318505-a0ef-4af8-bc44-6cd143422cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:41.308903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90318505-a0ef-4af8-bc44-6cd143422cd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:41.309559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318505-a0ef-4af8-bc44-6cd143422cd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:41.316591 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90318505-a0ef-4af8-bc44-6cd143422cd7 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:41.372163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1031/2039] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:41 2022] POST /identity/v3/projects => generated 381 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:38:41.373922 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4d60e-6542-4800-976d-ffe4000875c1 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:41.391311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4d60e-6542-4800-976d-ffe4000875c1 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:41.504266 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:41.518772 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb425cd-5e90-4053-bb80-7fea5f30ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:41.520053 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb425cd-5e90-4053-bb80-7fea5f30ef71 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:41.520832 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb425cd-5e90-4053-bb80-7fea5f30ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:41.521588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb425cd-5e90-4053-bb80-7fea5f30ef71 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:41.522572 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb425cd-5e90-4053-bb80-7fea5f30ef71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:41.542818 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb425cd-5e90-4053-bb80-7fea5f30ef71 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:41.614270 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1009/2040] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:41 2022] POST /identity/v3/users => generated 297 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:41.615806 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90318505-a0ef-4af8-bc44-6cd143422cd7 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:41.635297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90318505-a0ef-4af8-bc44-6cd143422cd7 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:41.643352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b63f0-4c31-40ef-b028-15af26f5d5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:41.644064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b63f0-4c31-40ef-b028-15af26f5d5fc admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:41.644582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b63f0-4c31-40ef-b028-15af26f5d5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:41.644947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b63f0-4c31-40ef-b028-15af26f5d5fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:41.646835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b63f0-4c31-40ef-b028-15af26f5d5fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:41.652819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b63f0-4c31-40ef-b028-15af26f5d5fc admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:41.687162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1032/2041] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:41.691499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb425cd-5e90-4053-bb80-7fea5f30ef71 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:41.705959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb425cd-5e90-4053-bb80-7fea5f30ef71 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:41.712279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480a1a4-cf28-4d52-a44e-6ddef9482877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:41.713458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480a1a4-cf28-4d52-a44e-6ddef9482877 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:41.713894 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480a1a4-cf28-4d52-a44e-6ddef9482877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:41.714972 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480a1a4-cf28-4d52-a44e-6ddef9482877 admin admin] PATH_INFO: `/v3/projects/6748f122853c44c9aecb6b01cbf74dbb/users/3fc818a22cfa4be4bdd44e6fbf89c5d6/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:41.736287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480a1a4-cf28-4d52-a44e-6ddef9482877 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6748f122853c44c9aecb6b01cbf74dbb, user_id=3fc818a22cfa4be4bdd44e6fbf89c5d6, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:41.740161 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480a1a4-cf28-4d52-a44e-6ddef9482877 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:41.745140 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b63f0-4c31-40ef-b028-15af26f5d5fc admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:41.747624 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b97b63f0-4c31-40ef-b028-15af26f5d5fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:41.786653 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1010/2042] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:41 2022] PUT /identity/v3/projects/6748f122853c44c9aecb6b01cbf74dbb/users/3fc818a22cfa4be4bdd44e6fbf89c5d6/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:41.787132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b63f0-4c31-40ef-b028-15af26f5d5fc admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:41.790655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480a1a4-cf28-4d52-a44e-6ddef9482877 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:41.880558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:41.889321 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480a1a4-cf28-4d52-a44e-6ddef9482877 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:41.896942 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293feb7-7427-437a-934e-716a17c67dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:41.897653 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293feb7-7427-437a-934e-716a17c67dd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:41.898005 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293feb7-7427-437a-934e-716a17c67dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:41.898350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c293feb7-7427-437a-934e-716a17c67dd3 admin admin] PATH_INFO: `/v3/projects/3d72bca740f145088395f3318fb362ee` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:41.898572 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989152b-dd45-4bfa-89a5-4a4bdc4179ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:41.899757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293feb7-7427-437a-934e-716a17c67dd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d72bca740f145088395f3318fb362ee)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:41.900386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989152b-dd45-4bfa-89a5-4a4bdc4179ae admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:41.900759 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989152b-dd45-4bfa-89a5-4a4bdc4179ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:41.901041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4989152b-dd45-4bfa-89a5-4a4bdc4179ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:41.902505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989152b-dd45-4bfa-89a5-4a4bdc4179ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:41.902616 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c293feb7-7427-437a-934e-716a17c67dd3 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:41.905274 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4989152b-dd45-4bfa-89a5-4a4bdc4179ae admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:41.924542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1011/2043] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:41.926860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989152b-dd45-4bfa-89a5-4a4bdc4179ae admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:41.943217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4989152b-dd45-4bfa-89a5-4a4bdc4179ae admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:41.956396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfd5ce7-6302-4492-afae-76eee4cf07a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:41.956396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd5ce7-6302-4492-afae-76eee4cf07a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:41.956396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd5ce7-6302-4492-afae-76eee4cf07a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:41.956396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfd5ce7-6302-4492-afae-76eee4cf07a6 admin admin] PATH_INFO: `/v3/projects/6748f122853c44c9aecb6b01cbf74dbb/users/3fc818a22cfa4be4bdd44e6fbf89c5d6/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:41.956994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd5ce7-6302-4492-afae-76eee4cf07a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6748f122853c44c9aecb6b01cbf74dbb, user_id=3fc818a22cfa4be4bdd44e6fbf89c5d6, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:41.958984 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfd5ce7-6302-4492-afae-76eee4cf07a6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:41.967370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c293feb7-7427-437a-934e-716a17c67dd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d72bca740f145088395f3318fb362ee', 'request_id': 'req-c293feb7-7427-437a-934e-716a17c67dd3'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:41.976711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1012/2044] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:41 2022] PUT /identity/v3/projects/6748f122853c44c9aecb6b01cbf74dbb/users/3fc818a22cfa4be4bdd44e6fbf89c5d6/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:41.982371 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c293feb7-7427-437a-934e-716a17c67dd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d72bca740f145088395f3318fb362ee', 'request_id': 'req-c293feb7-7427-437a-934e-716a17c67dd3'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:41.983761 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31feb777-8ffd-435e-8915-b4f3a1ff1fef None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:41.984049 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31feb777-8ffd-435e-8915-b4f3a1ff1fef None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:41.984330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31feb777-8ffd-435e-8915-b4f3a1ff1fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:41.989869 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c293feb7-7427-437a-934e-716a17c67dd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d72bca740f145088395f3318fb362ee', 'request_id': 'req-c293feb7-7427-437a-934e-716a17c67dd3'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:42.002502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c293feb7-7427-437a-934e-716a17c67dd3 admin admin] The token cache is being invalidate because project 3d72bca740f145088395f3318fb362ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:42.002789 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c293feb7-7427-437a-934e-716a17c67dd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:42.003460 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c293feb7-7427-437a-934e-716a17c67dd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:42.005531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1033/2045] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:41 2022] DELETE /identity/v3/projects/3d72bca740f145088395f3318fb362ee => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:42.010335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293feb7-7427-437a-934e-716a17c67dd3 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:42.011656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c293feb7-7427-437a-934e-716a17c67dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:42.018091 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-31feb777-8ffd-435e-8915-b4f3a1ff1fef None None] MFA Rules not processed for user `3fc818a22cfa4be4bdd44e6fbf89c5d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:42.020011 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-31feb777-8ffd-435e-8915-b4f3a1ff1fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:42.096547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c293feb7-7427-437a-934e-716a17c67dd3 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:42.113183 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1013/2046] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:42.130733 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31feb777-8ffd-435e-8915-b4f3a1ff1fef None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:42.132595 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-31feb777-8ffd-435e-8915-b4f3a1ff1fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:42.163168 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:42.173828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b2a0c-eb1a-41a6-8705-7fc7ceea470d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:42.174476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b2a0c-eb1a-41a6-8705-7fc7ceea470d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:42.174754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b2a0c-eb1a-41a6-8705-7fc7ceea470d admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:42.175025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b2a0c-eb1a-41a6-8705-7fc7ceea470d admin admin] PATH_INFO: `/v3/users/af1901e85e7b4dfcb8e45c289f8a5584` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:42.176640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b2a0c-eb1a-41a6-8705-7fc7ceea470d admin admin] RBAC: Authorizing `identity:delete_user(user_id=af1901e85e7b4dfcb8e45c289f8a5584)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:42.191009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b2a0c-eb1a-41a6-8705-7fc7ceea470d admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:42.198404 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31feb777-8ffd-435e-8915-b4f3a1ff1fef None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:42.202230 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a662-caf7-408f-8ab9-75d015933718 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:42.202990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a662-caf7-408f-8ab9-75d015933718 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:42.203273 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a662-caf7-408f-8ab9-75d015933718 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:42.203587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a662-caf7-408f-8ab9-75d015933718 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:42.223261 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744a662-caf7-408f-8ab9-75d015933718 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:42.224897 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744a662-caf7-408f-8ab9-75d015933718 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:42.238036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1014/2047] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:42.248336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:42.258209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-391b2a0c-eb1a-41a6-8705-7fc7ceea470d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af1901e85e7b4dfcb8e45c289f8a5584'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:42.266738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-391b2a0c-eb1a-41a6-8705-7fc7ceea470d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af1901e85e7b4dfcb8e45c289f8a5584'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:42.285295 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-391b2a0c-eb1a-41a6-8705-7fc7ceea470d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af1901e85e7b4dfcb8e45c289f8a5584'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:42.285946 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-391b2a0c-eb1a-41a6-8705-7fc7ceea470d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af1901e85e7b4dfcb8e45c289f8a5584'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:42.313377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-391b2a0c-eb1a-41a6-8705-7fc7ceea470d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af1901e85e7b4dfcb8e45c289f8a5584'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:42.323552 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1034/2048] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:42 2022] DELETE /identity/v3/users/af1901e85e7b4dfcb8e45c289f8a5584 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:42.721456 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a662-caf7-408f-8ab9-75d015933718 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:42.739764 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a662-caf7-408f-8ab9-75d015933718 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:42.786850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b2a0c-eb1a-41a6-8705-7fc7ceea470d admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:42.788300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-391b2a0c-eb1a-41a6-8705-7fc7ceea470d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:42.864344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa785c67-faea-4a85-8b8d-daf496548686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:42.865108 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa785c67-faea-4a85-8b8d-daf496548686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:42.865459 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa785c67-faea-4a85-8b8d-daf496548686 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:42.865803 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa785c67-faea-4a85-8b8d-daf496548686 admin admin] PATH_INFO: `/v3/projects/ad3a9ba7849d4c888736e1d770376ec6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:42.867288 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa785c67-faea-4a85-8b8d-daf496548686 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad3a9ba7849d4c888736e1d770376ec6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:42.869620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa785c67-faea-4a85-8b8d-daf496548686 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:42.932559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b2a0c-eb1a-41a6-8705-7fc7ceea470d admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:42.958277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aa785c67-faea-4a85-8b8d-daf496548686 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad3a9ba7849d4c888736e1d770376ec6', 'request_id': 'req-aa785c67-faea-4a85-8b8d-daf496548686'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:42.973541 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aa785c67-faea-4a85-8b8d-daf496548686 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad3a9ba7849d4c888736e1d770376ec6', 'request_id': 'req-aa785c67-faea-4a85-8b8d-daf496548686'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:42.991206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aa785c67-faea-4a85-8b8d-daf496548686 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad3a9ba7849d4c888736e1d770376ec6', 'request_id': 'req-aa785c67-faea-4a85-8b8d-daf496548686'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.027194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aa785c67-faea-4a85-8b8d-daf496548686 admin admin] The token cache is being invalidate because project ad3a9ba7849d4c888736e1d770376ec6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:43.027681 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aa785c67-faea-4a85-8b8d-daf496548686 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.030729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-aa785c67-faea-4a85-8b8d-daf496548686 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.032909 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1015/2049] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:42 2022] DELETE /identity/v3/projects/ad3a9ba7849d4c888736e1d770376ec6 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:43.036646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa785c67-faea-4a85-8b8d-daf496548686 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:43.039070 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-aa785c67-faea-4a85-8b8d-daf496548686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:43.061682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b39ced7-44fa-475d-8d87-13e78d05a500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:43.061937 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39ced7-44fa-475d-8d87-13e78d05a500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:43.062229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39ced7-44fa-475d-8d87-13e78d05a500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:43.063077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b39ced7-44fa-475d-8d87-13e78d05a500 admin admin] PATH_INFO: `/v3/users/d02fd119fd3c49f2bd38f6af8125b045` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:43.064256 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39ced7-44fa-475d-8d87-13e78d05a500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d02fd119fd3c49f2bd38f6af8125b045)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:43.068162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b39ced7-44fa-475d-8d87-13e78d05a500 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:43.177774 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9b39ced7-44fa-475d-8d87-13e78d05a500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd02fd119fd3c49f2bd38f6af8125b045'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.178855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:43.188539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa785c67-faea-4a85-8b8d-daf496548686 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:43.193550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9b39ced7-44fa-475d-8d87-13e78d05a500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd02fd119fd3c49f2bd38f6af8125b045'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.201127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215794f-374a-45ba-9ec3-97c00a011831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:43.203084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215794f-374a-45ba-9ec3-97c00a011831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:43.203938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215794f-374a-45ba-9ec3-97c00a011831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:43.204420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215794f-374a-45ba-9ec3-97c00a011831 admin admin] PATH_INFO: `/v3/users/e9e2e70e53174422a1deaf08e08aa223` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:43.206189 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215794f-374a-45ba-9ec3-97c00a011831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e2e70e53174422a1deaf08e08aa223)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:43.207480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:43.212791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215794f-374a-45ba-9ec3-97c00a011831 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:43.233849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9b39ced7-44fa-475d-8d87-13e78d05a500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd02fd119fd3c49f2bd38f6af8125b045'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.235051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9b39ced7-44fa-475d-8d87-13e78d05a500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd02fd119fd3c49f2bd38f6af8125b045'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.259742 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9b39ced7-44fa-475d-8d87-13e78d05a500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd02fd119fd3c49f2bd38f6af8125b045'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.269148 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1035/2050] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:42 2022] DELETE /identity/v3/users/d02fd119fd3c49f2bd38f6af8125b045 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:43.273648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adbf9a-21c9-47bd-a8b9-915172286452 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:43.274113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adbf9a-21c9-47bd-a8b9-915172286452 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:43.274745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adbf9a-21c9-47bd-a8b9-915172286452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:43.304916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-31adbf9a-21c9-47bd-a8b9-915172286452 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:43.306480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-31adbf9a-21c9-47bd-a8b9-915172286452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:43.311286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f215794f-374a-45ba-9ec3-97c00a011831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e2e70e53174422a1deaf08e08aa223'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.318889 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f215794f-374a-45ba-9ec3-97c00a011831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e2e70e53174422a1deaf08e08aa223'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.335941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f215794f-374a-45ba-9ec3-97c00a011831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e2e70e53174422a1deaf08e08aa223'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.346639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f215794f-374a-45ba-9ec3-97c00a011831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e2e70e53174422a1deaf08e08aa223'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.347641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-f215794f-374a-45ba-9ec3-97c00a011831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e2e70e53174422a1deaf08e08aa223'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.356546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1016/2051] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:43 2022] DELETE /identity/v3/users/e9e2e70e53174422a1deaf08e08aa223 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:43.451280 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1036/2052] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:43.493293 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215794f-374a-45ba-9ec3-97c00a011831 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:43.495045 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f215794f-374a-45ba-9ec3-97c00a011831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:43.576194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215794f-374a-45ba-9ec3-97c00a011831 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:43.583167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1ff4a-30c0-480a-a5a4-55f69107500f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:43.583893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1ff4a-30c0-480a-a5a4-55f69107500f service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:43.584281 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1ff4a-30c0-480a-a5a4-55f69107500f service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:43.584849 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1ff4a-30c0-480a-a5a4-55f69107500f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:43.689107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1ff4a-30c0-480a-a5a4-55f69107500f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:43.691277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1ff4a-30c0-480a-a5a4-55f69107500f service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:43.702624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1017/2053] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:43.769733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adbf9a-21c9-47bd-a8b9-915172286452 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:43.771781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-31adbf9a-21c9-47bd-a8b9-915172286452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:43.785908 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adbf9a-21c9-47bd-a8b9-915172286452 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:43.797481 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12484ebd-fa31-4151-94b6-b891c078ae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:43.798129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12484ebd-fa31-4151-94b6-b891c078ae12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:43.798399 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12484ebd-fa31-4151-94b6-b891c078ae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:43.798676 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12484ebd-fa31-4151-94b6-b891c078ae12 admin admin] PATH_INFO: `/v3/projects/b63befde38554c929cc17d05c57fa78e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:43.800066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12484ebd-fa31-4151-94b6-b891c078ae12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b63befde38554c929cc17d05c57fa78e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:43.802035 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12484ebd-fa31-4151-94b6-b891c078ae12 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:43.856478 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-12484ebd-fa31-4151-94b6-b891c078ae12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b63befde38554c929cc17d05c57fa78e', 'request_id': 'req-12484ebd-fa31-4151-94b6-b891c078ae12'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.864303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-12484ebd-fa31-4151-94b6-b891c078ae12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b63befde38554c929cc17d05c57fa78e', 'request_id': 'req-12484ebd-fa31-4151-94b6-b891c078ae12'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.871345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-12484ebd-fa31-4151-94b6-b891c078ae12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b63befde38554c929cc17d05c57fa78e', 'request_id': 'req-12484ebd-fa31-4151-94b6-b891c078ae12'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.888794 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-12484ebd-fa31-4151-94b6-b891c078ae12 admin admin] The token cache is being invalidate because project b63befde38554c929cc17d05c57fa78e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:43.889302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-12484ebd-fa31-4151-94b6-b891c078ae12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.890149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-12484ebd-fa31-4151-94b6-b891c078ae12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:43.897986 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1037/2054] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:43 2022] DELETE /identity/v3/projects/b63befde38554c929cc17d05c57fa78e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:43.899140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9beed-275f-4a98-ae1e-063f89b3a5c2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:43.899612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9beed-275f-4a98-ae1e-063f89b3a5c2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:43.899834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9beed-275f-4a98-ae1e-063f89b3a5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:43.926267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2fb9beed-275f-4a98-ae1e-063f89b3a5c2 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:43.928288 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2fb9beed-275f-4a98-ae1e-063f89b3a5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:43.955832 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:44.028538 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1018/2055] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:44.037352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883f481-13b5-4610-bcb6-8583b98c13a2 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:44.037862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883f481-13b5-4610-bcb6-8583b98c13a2 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:44.038338 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883f481-13b5-4610-bcb6-8583b98c13a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:44.101716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-3883f481-13b5-4610-bcb6-8583b98c13a2 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:44.102963 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3883f481-13b5-4610-bcb6-8583b98c13a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:44.139317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1038/2056] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:44.140930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9beed-275f-4a98-ae1e-063f89b3a5c2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:44.152333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9beed-275f-4a98-ae1e-063f89b3a5c2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:44.158167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c48ed-51e2-4cbd-9103-23eccbf36aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:44.159022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c48ed-51e2-4cbd-9103-23eccbf36aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:44.159312 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c48ed-51e2-4cbd-9103-23eccbf36aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:44.159608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c48ed-51e2-4cbd-9103-23eccbf36aa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:44.160320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c48ed-51e2-4cbd-9103-23eccbf36aa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:44.160634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c48ed-51e2-4cbd-9103-23eccbf36aa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:44.162367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c48ed-51e2-4cbd-9103-23eccbf36aa1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:44.177703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883f481-13b5-4610-bcb6-8583b98c13a2 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:44.179192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3883f481-13b5-4610-bcb6-8583b98c13a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:44.193216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1019/2057] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:38:44.195898 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883f481-13b5-4610-bcb6-8583b98c13a2 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:44.201272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c48ed-51e2-4cbd-9103-23eccbf36aa1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:44.221660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc924174-92ec-404d-bc26-5a7b4db781a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:44.222407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc924174-92ec-404d-bc26-5a7b4db781a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:44.226866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc924174-92ec-404d-bc26-5a7b4db781a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:44.226866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc924174-92ec-404d-bc26-5a7b4db781a1 admin admin] PATH_INFO: `/v3/projects/c3b6341ce8c54368b6722bbb0b7ee05c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:44.228456 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc924174-92ec-404d-bc26-5a7b4db781a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3b6341ce8c54368b6722bbb0b7ee05c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:44.231891 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c48ed-51e2-4cbd-9103-23eccbf36aa1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:44.234209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc924174-92ec-404d-bc26-5a7b4db781a1 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:44.242156 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f7e95-5141-4521-8b92-f3cd70bdb673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:44.242577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f7e95-5141-4521-8b92-f3cd70bdb673 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:44.242860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f7e95-5141-4521-8b92-f3cd70bdb673 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:44.243134 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f7e95-5141-4521-8b92-f3cd70bdb673 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:44.244983 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f7e95-5141-4521-8b92-f3cd70bdb673 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:44.246563 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f7e95-5141-4521-8b92-f3cd70bdb673 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:44.298287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1020/2058] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:44 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:44.299979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f7e95-5141-4521-8b92-f3cd70bdb673 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:44.354500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dc924174-92ec-404d-bc26-5a7b4db781a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3b6341ce8c54368b6722bbb0b7ee05c', 'request_id': 'req-dc924174-92ec-404d-bc26-5a7b4db781a1'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:44.356947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:44.369208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dc924174-92ec-404d-bc26-5a7b4db781a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3b6341ce8c54368b6722bbb0b7ee05c', 'request_id': 'req-dc924174-92ec-404d-bc26-5a7b4db781a1'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:44.378467 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dc924174-92ec-404d-bc26-5a7b4db781a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3b6341ce8c54368b6722bbb0b7ee05c', 'request_id': 'req-dc924174-92ec-404d-bc26-5a7b4db781a1'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:44.393531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dc924174-92ec-404d-bc26-5a7b4db781a1 admin admin] The token cache is being invalidate because project c3b6341ce8c54368b6722bbb0b7ee05c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:44.393907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dc924174-92ec-404d-bc26-5a7b4db781a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:44.394663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dc924174-92ec-404d-bc26-5a7b4db781a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:44.395562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f7e95-5141-4521-8b92-f3cd70bdb673 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:44.400450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1039/2059] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:44 2022] DELETE /identity/v3/projects/c3b6341ce8c54368b6722bbb0b7ee05c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:44.403780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc924174-92ec-404d-bc26-5a7b4db781a1 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:44.407719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-dc924174-92ec-404d-bc26-5a7b4db781a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:44.497191 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7bd8b-3176-4047-b102-d2ff91ebad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:44.497825 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7bd8b-3176-4047-b102-d2ff91ebad2e admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:44.498934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7bd8b-3176-4047-b102-d2ff91ebad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:44.498934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e7bd8b-3176-4047-b102-d2ff91ebad2e admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:44.499198 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7bd8b-3176-4047-b102-d2ff91ebad2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:44.501339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e7bd8b-3176-4047-b102-d2ff91ebad2e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:44.573440 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1021/2060] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:44 2022] POST /identity/v3/users => generated 293 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:44.575059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7bd8b-3176-4047-b102-d2ff91ebad2e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:44.577391 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-06e7bd8b-3176-4047-b102-d2ff91ebad2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:44.586632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc924174-92ec-404d-bc26-5a7b4db781a1 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:44.594070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd987221-1954-41af-ad93-fe67e89dd8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:44.594969 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd987221-1954-41af-ad93-fe67e89dd8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:44.597054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd987221-1954-41af-ad93-fe67e89dd8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:44.597492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd987221-1954-41af-ad93-fe67e89dd8f2 admin admin] PATH_INFO: `/v3/users/3fc818a22cfa4be4bdd44e6fbf89c5d6` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:44.598707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd987221-1954-41af-ad93-fe67e89dd8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc818a22cfa4be4bdd44e6fbf89c5d6)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:44.600625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd987221-1954-41af-ad93-fe67e89dd8f2 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:44.607157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e7bd8b-3176-4047-b102-d2ff91ebad2e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:44.613698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cdccc-06c4-4f68-8a9d-579916a53422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:44.614358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cdccc-06c4-4f68-8a9d-579916a53422 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:44.614713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cdccc-06c4-4f68-8a9d-579916a53422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:44.614992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0cdccc-06c4-4f68-8a9d-579916a53422 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:44.615699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cdccc-06c4-4f68-8a9d-579916a53422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:44.617449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0cdccc-06c4-4f68-8a9d-579916a53422 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:44.660792 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1022/2061] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:44.665315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cdccc-06c4-4f68-8a9d-579916a53422 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:44.692231 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bd987221-1954-41af-ad93-fe67e89dd8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc818a22cfa4be4bdd44e6fbf89c5d6'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:44.693139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0cdccc-06c4-4f68-8a9d-579916a53422 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:44.699605 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea8db4-626a-4b6c-86c3-52d204dbe431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:44.699991 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea8db4-626a-4b6c-86c3-52d204dbe431 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:44.700352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea8db4-626a-4b6c-86c3-52d204dbe431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:44.700779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea8db4-626a-4b6c-86c3-52d204dbe431 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:44.701500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea8db4-626a-4b6c-86c3-52d204dbe431 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:44.701773 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bd987221-1954-41af-ad93-fe67e89dd8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc818a22cfa4be4bdd44e6fbf89c5d6'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:44.703331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea8db4-626a-4b6c-86c3-52d204dbe431 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:44.716427 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1023/2062] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:44.720212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea8db4-626a-4b6c-86c3-52d204dbe431 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:44.724195 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bd987221-1954-41af-ad93-fe67e89dd8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc818a22cfa4be4bdd44e6fbf89c5d6'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:44.724982 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bd987221-1954-41af-ad93-fe67e89dd8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc818a22cfa4be4bdd44e6fbf89c5d6'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:44.739239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bd987221-1954-41af-ad93-fe67e89dd8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc818a22cfa4be4bdd44e6fbf89c5d6'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:44.741359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea8db4-626a-4b6c-86c3-52d204dbe431 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:44.749521 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e55f16-1395-481a-b7d2-1d9ede0d7243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:44.749650 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1040/2063] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:44 2022] DELETE /identity/v3/users/3fc818a22cfa4be4bdd44e6fbf89c5d6 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:44.750830 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e55f16-1395-481a-b7d2-1d9ede0d7243 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:44.751139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e55f16-1395-481a-b7d2-1d9ede0d7243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:44.751430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e55f16-1395-481a-b7d2-1d9ede0d7243 admin admin] PATH_INFO: `/v3/projects/dbb36cfd1b9545f68dc859ae175819a9/users/f4e6afccc106434fa6a9ad274535e402/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:44.754186 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:44.773357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e55f16-1395-481a-b7d2-1d9ede0d7243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dbb36cfd1b9545f68dc859ae175819a9, user_id=f4e6afccc106434fa6a9ad274535e402, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:44.777664 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e55f16-1395-481a-b7d2-1d9ede0d7243 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:44.807630 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1024/2064] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:44 2022] PUT /identity/v3/projects/dbb36cfd1b9545f68dc859ae175819a9/users/f4e6afccc106434fa6a9ad274535e402/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:44.819587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d60c0a-0d1e-4d6d-bbeb-e97855371c2e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:44.820512 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d60c0a-0d1e-4d6d-bbeb-e97855371c2e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:44.821010 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d60c0a-0d1e-4d6d-bbeb-e97855371c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:44.858696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-92d60c0a-0d1e-4d6d-bbeb-e97855371c2e None None] MFA Rules not processed for user `f4e6afccc106434fa6a9ad274535e402`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:44.860057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-92d60c0a-0d1e-4d6d-bbeb-e97855371c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:44.925033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e55f16-1395-481a-b7d2-1d9ede0d7243 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:44.927492 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-39e55f16-1395-481a-b7d2-1d9ede0d7243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:44.944366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:44.980916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1041/2065] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:44.990074 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d60c0a-0d1e-4d6d-bbeb-e97855371c2e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:44.991872 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-92d60c0a-0d1e-4d6d-bbeb-e97855371c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:45.018868 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e55f16-1395-481a-b7d2-1d9ede0d7243 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:45.024151 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d64df9-1ba0-440b-bb5f-d4f555c473d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:45.024833 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d64df9-1ba0-440b-bb5f-d4f555c473d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:45.025118 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d64df9-1ba0-440b-bb5f-d4f555c473d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:45.025392 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d64df9-1ba0-440b-bb5f-d4f555c473d3 admin admin] PATH_INFO: `/v3/users/2be13654c5be47f8919773766ab02148` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:45.027373 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d64df9-1ba0-440b-bb5f-d4f555c473d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be13654c5be47f8919773766ab02148)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:45.030288 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d64df9-1ba0-440b-bb5f-d4f555c473d3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:45.096304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d2d64df9-1ba0-440b-bb5f-d4f555c473d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be13654c5be47f8919773766ab02148'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.096969 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d60c0a-0d1e-4d6d-bbeb-e97855371c2e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:45.106381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d2d64df9-1ba0-440b-bb5f-d4f555c473d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be13654c5be47f8919773766ab02148'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.106584 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c741028-b5ff-46b4-bfce-28b43581272d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:45.109034 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c741028-b5ff-46b4-bfce-28b43581272d service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:45.109427 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c741028-b5ff-46b4-bfce-28b43581272d service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:45.109959 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c741028-b5ff-46b4-bfce-28b43581272d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:45.121442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c741028-b5ff-46b4-bfce-28b43581272d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:45.122953 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c741028-b5ff-46b4-bfce-28b43581272d service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:45.126211 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d2d64df9-1ba0-440b-bb5f-d4f555c473d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be13654c5be47f8919773766ab02148'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.135205 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1042/2066] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:45.142133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d2d64df9-1ba0-440b-bb5f-d4f555c473d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be13654c5be47f8919773766ab02148'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.143587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d2d64df9-1ba0-440b-bb5f-d4f555c473d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be13654c5be47f8919773766ab02148'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.160520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1025/2067] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:44 2022] DELETE /identity/v3/users/2be13654c5be47f8919773766ab02148 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:45.162421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c741028-b5ff-46b4-bfce-28b43581272d service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:45.163921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4c741028-b5ff-46b4-bfce-28b43581272d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:45.205578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c741028-b5ff-46b4-bfce-28b43581272d service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:45.261843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d64df9-1ba0-440b-bb5f-d4f555c473d3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:45.263323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d2d64df9-1ba0-440b-bb5f-d4f555c473d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:45.376781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac6b4f-f764-4392-bb96-69bf39c1e3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:45.377566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac6b4f-f764-4392-bb96-69bf39c1e3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:45.377849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac6b4f-f764-4392-bb96-69bf39c1e3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:45.378124 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ac6b4f-f764-4392-bb96-69bf39c1e3e3 admin admin] PATH_INFO: `/v3/users/f4e6afccc106434fa6a9ad274535e402` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:45.379343 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac6b4f-f764-4392-bb96-69bf39c1e3e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e6afccc106434fa6a9ad274535e402)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:45.381502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ac6b4f-f764-4392-bb96-69bf39c1e3e3 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:45.395205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d64df9-1ba0-440b-bb5f-d4f555c473d3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:45.406128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299a08ad-6f49-45c1-9a49-afe5626ed354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:45.406702 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a08ad-6f49-45c1-9a49-afe5626ed354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:45.406987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a08ad-6f49-45c1-9a49-afe5626ed354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:45.407260 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299a08ad-6f49-45c1-9a49-afe5626ed354 admin admin] PATH_INFO: `/v3/projects/6748f122853c44c9aecb6b01cbf74dbb` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:45.408584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a08ad-6f49-45c1-9a49-afe5626ed354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6748f122853c44c9aecb6b01cbf74dbb)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:45.410555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299a08ad-6f49-45c1-9a49-afe5626ed354 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:45.413823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:45.477397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-77ac6b4f-f764-4392-bb96-69bf39c1e3e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e6afccc106434fa6a9ad274535e402'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.486389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-77ac6b4f-f764-4392-bb96-69bf39c1e3e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e6afccc106434fa6a9ad274535e402'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.495566 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-299a08ad-6f49-45c1-9a49-afe5626ed354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6748f122853c44c9aecb6b01cbf74dbb', 'request_id': 'req-299a08ad-6f49-45c1-9a49-afe5626ed354'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.504050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-299a08ad-6f49-45c1-9a49-afe5626ed354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6748f122853c44c9aecb6b01cbf74dbb', 'request_id': 'req-299a08ad-6f49-45c1-9a49-afe5626ed354'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.505857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-77ac6b4f-f764-4392-bb96-69bf39c1e3e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e6afccc106434fa6a9ad274535e402'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.506692 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-77ac6b4f-f764-4392-bb96-69bf39c1e3e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e6afccc106434fa6a9ad274535e402'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.513327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-299a08ad-6f49-45c1-9a49-afe5626ed354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6748f122853c44c9aecb6b01cbf74dbb', 'request_id': 'req-299a08ad-6f49-45c1-9a49-afe5626ed354'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.518785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-77ac6b4f-f764-4392-bb96-69bf39c1e3e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e6afccc106434fa6a9ad274535e402'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.526614 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1043/2068] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:45 2022] DELETE /identity/v3/users/f4e6afccc106434fa6a9ad274535e402 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:45.530314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac6b4f-f764-4392-bb96-69bf39c1e3e3 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:45.530314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-77ac6b4f-f764-4392-bb96-69bf39c1e3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:45.532016 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-299a08ad-6f49-45c1-9a49-afe5626ed354 admin admin] The token cache is being invalidate because project 6748f122853c44c9aecb6b01cbf74dbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:45.532319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-299a08ad-6f49-45c1-9a49-afe5626ed354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.532984 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-299a08ad-6f49-45c1-9a49-afe5626ed354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.534576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1026/2069] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:45 2022] DELETE /identity/v3/projects/6748f122853c44c9aecb6b01cbf74dbb => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:45.539492 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843577e-f225-4b2f-be25-3ed7456018f2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:45.539839 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843577e-f225-4b2f-be25-3ed7456018f2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:45.540226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9843577e-f225-4b2f-be25-3ed7456018f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:45.541956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:45.561661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9843577e-f225-4b2f-be25-3ed7456018f2 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:45.562864 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9843577e-f225-4b2f-be25-3ed7456018f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:45.619569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ac6b4f-f764-4392-bb96-69bf39c1e3e3 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:45.626466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9d1d4-b371-42ad-807c-41591b88d9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:45.627120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9d1d4-b371-42ad-807c-41591b88d9ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:45.627430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9d1d4-b371-42ad-807c-41591b88d9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:45.627772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9d1d4-b371-42ad-807c-41591b88d9ff admin admin] PATH_INFO: `/v3/projects/205e037c73cc4f50856ad2bd54690c08` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:45.628959 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9d1d4-b371-42ad-807c-41591b88d9ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=205e037c73cc4f50856ad2bd54690c08)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:45.631085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9d1d4-b371-42ad-807c-41591b88d9ff admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:45.636824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1027/2070] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:45.638443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b334b0-6ace-4348-9f9d-df23f3a7a614 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:45.638832 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b334b0-6ace-4348-9f9d-df23f3a7a614 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:45.639203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b334b0-6ace-4348-9f9d-df23f3a7a614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:45.671214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f8b334b0-6ace-4348-9f9d-df23f3a7a614 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:45.673034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f8b334b0-6ace-4348-9f9d-df23f3a7a614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:45.687883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d7b9d1d4-b371-42ad-807c-41591b88d9ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '205e037c73cc4f50856ad2bd54690c08', 'request_id': 'req-d7b9d1d4-b371-42ad-807c-41591b88d9ff'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.698015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d7b9d1d4-b371-42ad-807c-41591b88d9ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '205e037c73cc4f50856ad2bd54690c08', 'request_id': 'req-d7b9d1d4-b371-42ad-807c-41591b88d9ff'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.705473 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d7b9d1d4-b371-42ad-807c-41591b88d9ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '205e037c73cc4f50856ad2bd54690c08', 'request_id': 'req-d7b9d1d4-b371-42ad-807c-41591b88d9ff'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.720983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d7b9d1d4-b371-42ad-807c-41591b88d9ff admin admin] The token cache is being invalidate because project 205e037c73cc4f50856ad2bd54690c08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:45.721275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d7b9d1d4-b371-42ad-807c-41591b88d9ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.721947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d7b9d1d4-b371-42ad-807c-41591b88d9ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:45.726728 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1044/2071] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:45 2022] DELETE /identity/v3/projects/205e037c73cc4f50856ad2bd54690c08 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:45.726728 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9d1d4-b371-42ad-807c-41591b88d9ff admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:45.728354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d7b9d1d4-b371-42ad-807c-41591b88d9ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:45.748872 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1028/2072] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:45.752330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ebd48-6781-4ca9-b42e-2c14f36da2c8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:45.752330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ebd48-6781-4ca9-b42e-2c14f36da2c8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:45.752330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85ebd48-6781-4ca9-b42e-2c14f36da2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:45.773389 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f85ebd48-6781-4ca9-b42e-2c14f36da2c8 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:45.774600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f85ebd48-6781-4ca9-b42e-2c14f36da2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:45.783135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1029/2073] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:45.784308 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045bbb2-2db3-4c26-aa8c-65bb5e27b76b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:45.784586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045bbb2-2db3-4c26-aa8c-65bb5e27b76b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:45.784894 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8045bbb2-2db3-4c26-aa8c-65bb5e27b76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:45.789609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9d1d4-b371-42ad-807c-41591b88d9ff admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:45.793302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064ef2a-4b80-481d-bc1d-95d993f74067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:45.793911 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064ef2a-4b80-481d-bc1d-95d993f74067 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:45.794193 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064ef2a-4b80-481d-bc1d-95d993f74067 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:45.794465 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064ef2a-4b80-481d-bc1d-95d993f74067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:45.796225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4064ef2a-4b80-481d-bc1d-95d993f74067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:45.805434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8045bbb2-2db3-4c26-aa8c-65bb5e27b76b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:45.806544 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8045bbb2-2db3-4c26-aa8c-65bb5e27b76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:45.808542 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064ef2a-4b80-481d-bc1d-95d993f74067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:45.810010 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064ef2a-4b80-481d-bc1d-95d993f74067 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:45.815170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1030/2074] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:45.816166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79422252-ddba-42f4-b32c-ecc733114f7e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:45.816461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79422252-ddba-42f4-b32c-ecc733114f7e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:45.817254 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79422252-ddba-42f4-b32c-ecc733114f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:45.819780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1045/2075] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:45.820578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064ef2a-4b80-481d-bc1d-95d993f74067 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:45.832339 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064ef2a-4b80-481d-bc1d-95d993f74067 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:45.837888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-79422252-ddba-42f4-b32c-ecc733114f7e None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:45.839139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ada69-d68c-49ae-aed3-2d616567b5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:45.839409 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-79422252-ddba-42f4-b32c-ecc733114f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:45.839947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ada69-d68c-49ae-aed3-2d616567b5ce admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:45.840407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ada69-d68c-49ae-aed3-2d616567b5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:45.840734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ada69-d68c-49ae-aed3-2d616567b5ce admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:45.841567 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ada69-d68c-49ae-aed3-2d616567b5ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:45.841926 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ada69-d68c-49ae-aed3-2d616567b5ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:45.843602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ada69-d68c-49ae-aed3-2d616567b5ce admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:45.848242 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1031/2076] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:45.852208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79422252-ddba-42f4-b32c-ecc733114f7e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:45.857261 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1046/2077] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:38:45.863118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ada69-d68c-49ae-aed3-2d616567b5ce admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:45.864641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79422252-ddba-42f4-b32c-ecc733114f7e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:45.870901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289df08f-13e0-44d6-a2d6-7dc1548cd2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:45.871179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289df08f-13e0-44d6-a2d6-7dc1548cd2c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:45.871456 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289df08f-13e0-44d6-a2d6-7dc1548cd2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:45.871846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289df08f-13e0-44d6-a2d6-7dc1548cd2c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:45.872512 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289df08f-13e0-44d6-a2d6-7dc1548cd2c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:45.872910 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289df08f-13e0-44d6-a2d6-7dc1548cd2c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:45.874583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289df08f-13e0-44d6-a2d6-7dc1548cd2c4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:45.878436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ada69-d68c-49ae-aed3-2d616567b5ce admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:45.885847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:45.887219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2db170-2a42-4a4b-a45e-52da8f81a37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:45.888456 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2db170-2a42-4a4b-a45e-52da8f81a37d admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:45.888780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2db170-2a42-4a4b-a45e-52da8f81a37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:45.889273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2db170-2a42-4a4b-a45e-52da8f81a37d admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:45.890054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2db170-2a42-4a4b-a45e-52da8f81a37d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:45.893547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1032/2078] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:38:45.893659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2db170-2a42-4a4b-a45e-52da8f81a37d admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:45.894504 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289df08f-13e0-44d6-a2d6-7dc1548cd2c4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:45.906186 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289df08f-13e0-44d6-a2d6-7dc1548cd2c4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:45.913701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e74001-9d02-4f27-b7d8-c0e7aa30b8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:45.914232 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e74001-9d02-4f27-b7d8-c0e7aa30b8bf admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:45.914675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e74001-9d02-4f27-b7d8-c0e7aa30b8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:45.914953 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e74001-9d02-4f27-b7d8-c0e7aa30b8bf admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:45.915591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e74001-9d02-4f27-b7d8-c0e7aa30b8bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:45.917573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e74001-9d02-4f27-b7d8-c0e7aa30b8bf admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:45.930333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1047/2079] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:45 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:45.936102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2db170-2a42-4a4b-a45e-52da8f81a37d admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:45.946431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:45.948150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1033/2080] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:45 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:38:45.954765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e74001-9d02-4f27-b7d8-c0e7aa30b8bf admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:46.026503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2db170-2a42-4a4b-a45e-52da8f81a37d admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.029751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e74001-9d02-4f27-b7d8-c0e7aa30b8bf admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.033735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd76f2-0a23-43f4-8390-8e774918b6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.034347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd76f2-0a23-43f4-8390-8e774918b6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.034630 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd76f2-0a23-43f4-8390-8e774918b6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.034886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcd76f2-0a23-43f4-8390-8e774918b6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.035162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d3fe0-45db-4d1c-a7b7-af752f20d33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.035513 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd76f2-0a23-43f4-8390-8e774918b6f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.036031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d3fe0-45db-4d1c-a7b7-af752f20d33d admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.036395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d3fe0-45db-4d1c-a7b7-af752f20d33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.036791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975d3fe0-45db-4d1c-a7b7-af752f20d33d admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.037697 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d3fe0-45db-4d1c-a7b7-af752f20d33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.037868 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcd76f2-0a23-43f4-8390-8e774918b6f9 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.039841 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975d3fe0-45db-4d1c-a7b7-af752f20d33d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.064505 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1048/2081] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:45 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:46.066663 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1034/2082] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:45 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:46.068290 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd76f2-0a23-43f4-8390-8e774918b6f9 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:46.070456 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d3fe0-45db-4d1c-a7b7-af752f20d33d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:46.084239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcd76f2-0a23-43f4-8390-8e774918b6f9 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.084863 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975d3fe0-45db-4d1c-a7b7-af752f20d33d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.089337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65df5b3-7cab-4c30-9217-eb0272bfd866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.090372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65df5b3-7cab-4c30-9217-eb0272bfd866 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.090372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65df5b3-7cab-4c30-9217-eb0272bfd866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.090571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65df5b3-7cab-4c30-9217-eb0272bfd866 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.091104 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65df5b3-7cab-4c30-9217-eb0272bfd866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.091886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1729bf-f086-4a23-8546-3802503456ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.092657 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1729bf-f086-4a23-8546-3802503456ca admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.092802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65df5b3-7cab-4c30-9217-eb0272bfd866 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.093205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1729bf-f086-4a23-8546-3802503456ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.093622 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1729bf-f086-4a23-8546-3802503456ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.094537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1729bf-f086-4a23-8546-3802503456ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.096904 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1729bf-f086-4a23-8546-3802503456ca admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.103250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1049/2083] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:38:46.106933 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65df5b3-7cab-4c30-9217-eb0272bfd866 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:46.113333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1035/2084] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:38:46.117044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1729bf-f086-4a23-8546-3802503456ca admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:46.117876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65df5b3-7cab-4c30-9217-eb0272bfd866 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.127896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1729bf-f086-4a23-8546-3802503456ca admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.129328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd2cba-dc31-4763-951c-c9b2076cf7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.130249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd2cba-dc31-4763-951c-c9b2076cf7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.131902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd2cba-dc31-4763-951c-c9b2076cf7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.131902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dd2cba-dc31-4763-951c-c9b2076cf7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.131902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd2cba-dc31-4763-951c-c9b2076cf7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.134057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dd2cba-dc31-4763-951c-c9b2076cf7c5 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.135767 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994da2cb-7d8d-4a76-bb84-a77d9775fc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.137120 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994da2cb-7d8d-4a76-bb84-a77d9775fc50 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.137466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994da2cb-7d8d-4a76-bb84-a77d9775fc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.137744 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994da2cb-7d8d-4a76-bb84-a77d9775fc50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.138384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994da2cb-7d8d-4a76-bb84-a77d9775fc50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.140850 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994da2cb-7d8d-4a76-bb84-a77d9775fc50 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.147459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1050/2085] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:38:46.148083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd2cba-dc31-4763-951c-c9b2076cf7c5 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:46.150636 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-84dd2cba-dc31-4763-951c-c9b2076cf7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:46.155729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1036/2086] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:38:46.155729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994da2cb-7d8d-4a76-bb84-a77d9775fc50 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:46.164590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dd2cba-dc31-4763-951c-c9b2076cf7c5 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.164729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994da2cb-7d8d-4a76-bb84-a77d9775fc50 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.170040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a3cde2-8c3d-4cbb-bf3b-1c9b26920ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.170163 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3581b-c5fc-4c06-923e-dc70011fbd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.170668 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3cde2-8c3d-4cbb-bf3b-1c9b26920ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.170770 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3581b-c5fc-4c06-923e-dc70011fbd7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.170938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3cde2-8c3d-4cbb-bf3b-1c9b26920ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.171031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3581b-c5fc-4c06-923e-dc70011fbd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.171207 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a3cde2-8c3d-4cbb-bf3b-1c9b26920ac0 admin admin] PATH_INFO: `/v3/projects/dbb36cfd1b9545f68dc859ae175819a9` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.171314 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf3581b-c5fc-4c06-923e-dc70011fbd7b admin admin] PATH_INFO: `/v3/projects/4e9a547df092442c8ec9bda3417a69a0/users/945c3af350024acc8c090292e3018f6e/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.172308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3cde2-8c3d-4cbb-bf3b-1c9b26920ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dbb36cfd1b9545f68dc859ae175819a9)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.174221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a3cde2-8c3d-4cbb-bf3b-1c9b26920ac0 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.186694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3581b-c5fc-4c06-923e-dc70011fbd7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e9a547df092442c8ec9bda3417a69a0, user_id=945c3af350024acc8c090292e3018f6e, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.189414 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf3581b-c5fc-4c06-923e-dc70011fbd7b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.204923 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1037/2087] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:46 2022] PUT /identity/v3/projects/4e9a547df092442c8ec9bda3417a69a0/users/945c3af350024acc8c090292e3018f6e/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:46.205829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3581b-c5fc-4c06-923e-dc70011fbd7b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:46.224922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c6a3cde2-8c3d-4cbb-bf3b-1c9b26920ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dbb36cfd1b9545f68dc859ae175819a9', 'request_id': 'req-c6a3cde2-8c3d-4cbb-bf3b-1c9b26920ac0'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:46.235353 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c6a3cde2-8c3d-4cbb-bf3b-1c9b26920ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dbb36cfd1b9545f68dc859ae175819a9', 'request_id': 'req-c6a3cde2-8c3d-4cbb-bf3b-1c9b26920ac0'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:46.241164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c6a3cde2-8c3d-4cbb-bf3b-1c9b26920ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dbb36cfd1b9545f68dc859ae175819a9', 'request_id': 'req-c6a3cde2-8c3d-4cbb-bf3b-1c9b26920ac0'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:46.253361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c6a3cde2-8c3d-4cbb-bf3b-1c9b26920ac0 admin admin] The token cache is being invalidate because project dbb36cfd1b9545f68dc859ae175819a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:46.253669 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c6a3cde2-8c3d-4cbb-bf3b-1c9b26920ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:46.254330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c6a3cde2-8c3d-4cbb-bf3b-1c9b26920ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:46.256020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1051/2088] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:46 2022] DELETE /identity/v3/projects/dbb36cfd1b9545f68dc859ae175819a9 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:46.257036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072de711-159f-4ab7-a881-57b4223ae02e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.257324 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072de711-159f-4ab7-a881-57b4223ae02e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.257599 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072de711-159f-4ab7-a881-57b4223ae02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.279444 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf3581b-c5fc-4c06-923e-dc70011fbd7b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.288628 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-072de711-159f-4ab7-a881-57b4223ae02e None None] MFA Rules not processed for user `945c3af350024acc8c090292e3018f6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:46.289902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-072de711-159f-4ab7-a881-57b4223ae02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:46.312102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:46.353737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f92b0-9ab9-4d4b-ba6a-94e2fd18f9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.353737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f92b0-9ab9-4d4b-ba6a-94e2fd18f9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.353737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f92b0-9ab9-4d4b-ba6a-94e2fd18f9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.353737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f92b0-9ab9-4d4b-ba6a-94e2fd18f9ae admin admin] PATH_INFO: `/v3/projects/3dd82efdd388400590ff71c83386431c/users/8505dee31512437ba7b6de3512dcc76a/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.362882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:46.377927 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f92b0-9ab9-4d4b-ba6a-94e2fd18f9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd82efdd388400590ff71c83386431c, user_id=8505dee31512437ba7b6de3512dcc76a, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.381132 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f92b0-9ab9-4d4b-ba6a-94e2fd18f9ae admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.408364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1038/2089] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:46 2022] PUT /identity/v3/projects/3dd82efdd388400590ff71c83386431c/users/8505dee31512437ba7b6de3512dcc76a/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:46.413665 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ecb64-2a49-448a-8e54-508c82e75bd4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.414242 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ecb64-2a49-448a-8e54-508c82e75bd4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.415278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ecb64-2a49-448a-8e54-508c82e75bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.421768 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1052/2090] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:46.424218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072de711-159f-4ab7-a881-57b4223ae02e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:46.427767 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-072de711-159f-4ab7-a881-57b4223ae02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:46.443517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e12ecb64-2a49-448a-8e54-508c82e75bd4 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:46.443517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e12ecb64-2a49-448a-8e54-508c82e75bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:46.458413 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072de711-159f-4ab7-a881-57b4223ae02e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.524551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1039/2091] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:46.529078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efce80b-17dd-4b9c-a1c1-99e5b49bc1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.529700 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efce80b-17dd-4b9c-a1c1-99e5b49bc1a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.529982 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efce80b-17dd-4b9c-a1c1-99e5b49bc1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.530256 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efce80b-17dd-4b9c-a1c1-99e5b49bc1a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.531010 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efce80b-17dd-4b9c-a1c1-99e5b49bc1a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.532318 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ecb64-2a49-448a-8e54-508c82e75bd4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:46.532846 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efce80b-17dd-4b9c-a1c1-99e5b49bc1a7 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.534010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e12ecb64-2a49-448a-8e54-508c82e75bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:46.565777 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1053/2092] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:46 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:46.566874 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efce80b-17dd-4b9c-a1c1-99e5b49bc1a7 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:46.611430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ecb64-2a49-448a-8e54-508c82e75bd4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.651059 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efce80b-17dd-4b9c-a1c1-99e5b49bc1a7 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.656002 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f2e02-1dcb-4c1b-ad2f-03d2784546e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.656613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f2e02-1dcb-4c1b-ad2f-03d2784546e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.657057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f2e02-1dcb-4c1b-ad2f-03d2784546e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.657381 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f2e02-1dcb-4c1b-ad2f-03d2784546e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.658023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f2e02-1dcb-4c1b-ad2f-03d2784546e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.659936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152f2e02-1dcb-4c1b-ad2f-03d2784546e7 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.671323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e083b9c-9a21-443b-a835-8e94535407d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.671989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e083b9c-9a21-443b-a835-8e94535407d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.672384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e083b9c-9a21-443b-a835-8e94535407d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.672588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e083b9c-9a21-443b-a835-8e94535407d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.681772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1054/2093] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:46 2022] POST /identity/v3/users => generated 297 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:46.682542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e083b9c-9a21-443b-a835-8e94535407d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.684520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e083b9c-9a21-443b-a835-8e94535407d1 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.686332 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f2e02-1dcb-4c1b-ad2f-03d2784546e7 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:46.695569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1040/2094] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:46.696294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f2e02-1dcb-4c1b-ad2f-03d2784546e7 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.701709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f582e1-40d7-434a-8034-f7f65ee16db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.702296 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f582e1-40d7-434a-8034-f7f65ee16db9 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.702560 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f582e1-40d7-434a-8034-f7f65ee16db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.702822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f582e1-40d7-434a-8034-f7f65ee16db9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.703459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f582e1-40d7-434a-8034-f7f65ee16db9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.705077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f582e1-40d7-434a-8034-f7f65ee16db9 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.715215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1055/2095] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:46.719798 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e083b9c-9a21-443b-a835-8e94535407d1 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:46.729662 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e083b9c-9a21-443b-a835-8e94535407d1 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.734553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ea72f-d8fa-44ab-89b2-152037ab522f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.735342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ea72f-d8fa-44ab-89b2-152037ab522f admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.735694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ea72f-d8fa-44ab-89b2-152037ab522f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.735976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ea72f-d8fa-44ab-89b2-152037ab522f admin admin] PATH_INFO: `/v3/projects/c4b842a7738a400b9b2b30f8ec7005ae/users/915241c969774ef590dec4cbe4413dc4/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.745189 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:46.756055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ea72f-d8fa-44ab-89b2-152037ab522f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b842a7738a400b9b2b30f8ec7005ae, user_id=915241c969774ef590dec4cbe4413dc4, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.759430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80ea72f-d8fa-44ab-89b2-152037ab522f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.780017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1041/2096] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:46 2022] PUT /identity/v3/projects/c4b842a7738a400b9b2b30f8ec7005ae/users/915241c969774ef590dec4cbe4413dc4/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:46.784555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f582e1-40d7-434a-8034-f7f65ee16db9 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:46.798916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f582e1-40d7-434a-8034-f7f65ee16db9 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.853075 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:46.864559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec16cf-58e5-4ec0-a08e-b6bc2de4b133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.865377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec16cf-58e5-4ec0-a08e-b6bc2de4b133 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.865653 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec16cf-58e5-4ec0-a08e-b6bc2de4b133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.865920 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec16cf-58e5-4ec0-a08e-b6bc2de4b133 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.866574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec16cf-58e5-4ec0-a08e-b6bc2de4b133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.868173 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec16cf-58e5-4ec0-a08e-b6bc2de4b133 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.884934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1056/2097] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:46.886113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ea72f-d8fa-44ab-89b2-152037ab522f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:46.897039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ea72f-d8fa-44ab-89b2-152037ab522f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:46.902288 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11842ee7-920b-4443-a17b-9886c2cfff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:46.902961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11842ee7-920b-4443-a17b-9886c2cfff81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.903266 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11842ee7-920b-4443-a17b-9886c2cfff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.903697 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11842ee7-920b-4443-a17b-9886c2cfff81 admin admin] PATH_INFO: `/v3/projects/c4b842a7738a400b9b2b30f8ec7005ae/users/915241c969774ef590dec4cbe4413dc4/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.905761 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11842ee7-920b-4443-a17b-9886c2cfff81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4b842a7738a400b9b2b30f8ec7005ae, user_id=915241c969774ef590dec4cbe4413dc4, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:46.908410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11842ee7-920b-4443-a17b-9886c2cfff81 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:46.920248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1042/2098] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:46 2022] PUT /identity/v3/projects/c4b842a7738a400b9b2b30f8ec7005ae/users/915241c969774ef590dec4cbe4413dc4/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:46.930628 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46207146-2f20-42a1-ab90-c6c74e10e57d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:46.930907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46207146-2f20-42a1-ab90-c6c74e10e57d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:46.931183 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46207146-2f20-42a1-ab90-c6c74e10e57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:46.960499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-46207146-2f20-42a1-ab90-c6c74e10e57d None None] MFA Rules not processed for user `915241c969774ef590dec4cbe4413dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:46.961763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-46207146-2f20-42a1-ab90-c6c74e10e57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:47.035680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1057/2099] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:46 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:47.047366 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11842ee7-920b-4443-a17b-9886c2cfff81 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:47.049145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-11842ee7-920b-4443-a17b-9886c2cfff81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:47.108285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11842ee7-920b-4443-a17b-9886c2cfff81 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:47.112160 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a053053-f83c-47ce-aede-f61d970a57df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:47.112844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a053053-f83c-47ce-aede-f61d970a57df service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:47.113133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a053053-f83c-47ce-aede-f61d970a57df service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:47.113407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a053053-f83c-47ce-aede-f61d970a57df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:47.126834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a053053-f83c-47ce-aede-f61d970a57df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:47.128286 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a053053-f83c-47ce-aede-f61d970a57df service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:47.139531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1043/2100] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:47.228435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46207146-2f20-42a1-ab90-c6c74e10e57d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:47.238638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46207146-2f20-42a1-ab90-c6c74e10e57d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:47.242411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68cba3-4e17-4470-9b73-74ce515fb64a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:47.243627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68cba3-4e17-4470-9b73-74ce515fb64a service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:47.244178 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68cba3-4e17-4470-9b73-74ce515fb64a service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:47.244461 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68cba3-4e17-4470-9b73-74ce515fb64a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:47.309354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68cba3-4e17-4470-9b73-74ce515fb64a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:47.310808 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68cba3-4e17-4470-9b73-74ce515fb64a service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:47.320535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1058/2101] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:47.626033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a053053-f83c-47ce-aede-f61d970a57df service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:47.705958 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a053053-f83c-47ce-aede-f61d970a57df service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:47.710737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff0cd0-b1ea-40b0-adf6-ad32733b436a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:47.711591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff0cd0-b1ea-40b0-adf6-ad32733b436a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:47.711966 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff0cd0-b1ea-40b0-adf6-ad32733b436a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:47.712949 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff0cd0-b1ea-40b0-adf6-ad32733b436a admin admin] PATH_INFO: `/v3/users/945c3af350024acc8c090292e3018f6e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:47.713735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff0cd0-b1ea-40b0-adf6-ad32733b436a admin admin] RBAC: Authorizing `identity:delete_user(user_id=945c3af350024acc8c090292e3018f6e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:47.715752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff0cd0-b1ea-40b0-adf6-ad32733b436a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:47.772055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1cff0cd0-b1ea-40b0-adf6-ad32733b436a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '945c3af350024acc8c090292e3018f6e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:47.779990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1cff0cd0-b1ea-40b0-adf6-ad32733b436a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '945c3af350024acc8c090292e3018f6e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:47.797734 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1cff0cd0-b1ea-40b0-adf6-ad32733b436a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '945c3af350024acc8c090292e3018f6e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:47.804375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:47.813435 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1cff0cd0-b1ea-40b0-adf6-ad32733b436a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '945c3af350024acc8c090292e3018f6e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:47.814855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-1cff0cd0-b1ea-40b0-adf6-ad32733b436a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '945c3af350024acc8c090292e3018f6e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:47.825528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1044/2102] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:47 2022] DELETE /identity/v3/users/945c3af350024acc8c090292e3018f6e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:47.829966 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2828715-bc91-4553-9bc6-ffcb12969041 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:47.830370 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2828715-bc91-4553-9bc6-ffcb12969041 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:47.830823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2828715-bc91-4553-9bc6-ffcb12969041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:47.852795 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d2828715-bc91-4553-9bc6-ffcb12969041 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:47.854089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d2828715-bc91-4553-9bc6-ffcb12969041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:47.921380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1059/2103] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:47.931473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff0cd0-b1ea-40b0-adf6-ad32733b436a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:47.933526 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1cff0cd0-b1ea-40b0-adf6-ad32733b436a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:48.002182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff0cd0-b1ea-40b0-adf6-ad32733b436a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:48.007140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb9d92-e95d-46f0-8cc0-e35df7b25f14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:48.007908 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb9d92-e95d-46f0-8cc0-e35df7b25f14 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:48.008294 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb9d92-e95d-46f0-8cc0-e35df7b25f14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:48.008709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb9d92-e95d-46f0-8cc0-e35df7b25f14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:48.020909 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb9d92-e95d-46f0-8cc0-e35df7b25f14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:48.022651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb9d92-e95d-46f0-8cc0-e35df7b25f14 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:48.036793 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1045/2104] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:48.377297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2828715-bc91-4553-9bc6-ffcb12969041 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:48.379249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d2828715-bc91-4553-9bc6-ffcb12969041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:48.394400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2828715-bc91-4553-9bc6-ffcb12969041 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:48.401793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e03a-8223-4928-bf93-5f28d777407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:48.402657 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e03a-8223-4928-bf93-5f28d777407e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:48.403007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e03a-8223-4928-bf93-5f28d777407e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:48.403286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e03a-8223-4928-bf93-5f28d777407e admin admin] PATH_INFO: `/v3/projects/4e9a547df092442c8ec9bda3417a69a0` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:48.405333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2e03a-8223-4928-bf93-5f28d777407e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e9a547df092442c8ec9bda3417a69a0)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:48.408135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2e03a-8223-4928-bf93-5f28d777407e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:48.416080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:48.507442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-7fe2e03a-8223-4928-bf93-5f28d777407e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e9a547df092442c8ec9bda3417a69a0', 'request_id': 'req-7fe2e03a-8223-4928-bf93-5f28d777407e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:48.529040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-7fe2e03a-8223-4928-bf93-5f28d777407e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e9a547df092442c8ec9bda3417a69a0', 'request_id': 'req-7fe2e03a-8223-4928-bf93-5f28d777407e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:48.550815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-7fe2e03a-8223-4928-bf93-5f28d777407e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e9a547df092442c8ec9bda3417a69a0', 'request_id': 'req-7fe2e03a-8223-4928-bf93-5f28d777407e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:48.566564 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-7fe2e03a-8223-4928-bf93-5f28d777407e admin admin] The token cache is being invalidate because project 4e9a547df092442c8ec9bda3417a69a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:48.567176 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-7fe2e03a-8223-4928-bf93-5f28d777407e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:48.568085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-7fe2e03a-8223-4928-bf93-5f28d777407e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:48.570386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1060/2105] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:48 2022] DELETE /identity/v3/projects/4e9a547df092442c8ec9bda3417a69a0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:48.574897 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb9d92-e95d-46f0-8cc0-e35df7b25f14 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:48.586576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb9d92-e95d-46f0-8cc0-e35df7b25f14 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:48.673448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6def9e-4262-418a-a550-b7f6efc519bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:48.674458 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6def9e-4262-418a-a550-b7f6efc519bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:48.674967 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6def9e-4262-418a-a550-b7f6efc519bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:48.674967 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6def9e-4262-418a-a550-b7f6efc519bc admin admin] PATH_INFO: `/v3/users/915241c969774ef590dec4cbe4413dc4` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:48.677508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6def9e-4262-418a-a550-b7f6efc519bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=915241c969774ef590dec4cbe4413dc4)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:48.679549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6def9e-4262-418a-a550-b7f6efc519bc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:48.740875 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f6def9e-4262-418a-a550-b7f6efc519bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '915241c969774ef590dec4cbe4413dc4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:48.752016 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f6def9e-4262-418a-a550-b7f6efc519bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '915241c969774ef590dec4cbe4413dc4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:48.767331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f6def9e-4262-418a-a550-b7f6efc519bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '915241c969774ef590dec4cbe4413dc4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:48.801410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f6def9e-4262-418a-a550-b7f6efc519bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '915241c969774ef590dec4cbe4413dc4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:48.803624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f6def9e-4262-418a-a550-b7f6efc519bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '915241c969774ef590dec4cbe4413dc4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:48.814125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1046/2106] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:48 2022] DELETE /identity/v3/users/915241c969774ef590dec4cbe4413dc4 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:49.325136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e03a-8223-4928-bf93-5f28d777407e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:49.327151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-7fe2e03a-8223-4928-bf93-5f28d777407e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:49.386175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e03a-8223-4928-bf93-5f28d777407e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:49.508479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079b7245-116a-4c48-82ef-6b3f74a4cfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:49.509649 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b7245-116a-4c48-82ef-6b3f74a4cfc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:49.510081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b7245-116a-4c48-82ef-6b3f74a4cfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:49.510514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079b7245-116a-4c48-82ef-6b3f74a4cfc8 admin admin] PATH_INFO: `/v3/projects/c4b842a7738a400b9b2b30f8ec7005ae` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:49.512108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b7245-116a-4c48-82ef-6b3f74a4cfc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4b842a7738a400b9b2b30f8ec7005ae)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:49.514358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079b7245-116a-4c48-82ef-6b3f74a4cfc8 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:49.586732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-079b7245-116a-4c48-82ef-6b3f74a4cfc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4b842a7738a400b9b2b30f8ec7005ae', 'request_id': 'req-079b7245-116a-4c48-82ef-6b3f74a4cfc8'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:49.601816 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-079b7245-116a-4c48-82ef-6b3f74a4cfc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4b842a7738a400b9b2b30f8ec7005ae', 'request_id': 'req-079b7245-116a-4c48-82ef-6b3f74a4cfc8'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:49.614725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-079b7245-116a-4c48-82ef-6b3f74a4cfc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4b842a7738a400b9b2b30f8ec7005ae', 'request_id': 'req-079b7245-116a-4c48-82ef-6b3f74a4cfc8'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:49.637753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-079b7245-116a-4c48-82ef-6b3f74a4cfc8 admin admin] The token cache is being invalidate because project c4b842a7738a400b9b2b30f8ec7005ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:49.638034 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-079b7245-116a-4c48-82ef-6b3f74a4cfc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:49.646327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-079b7245-116a-4c48-82ef-6b3f74a4cfc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:49.646327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1061/2107] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:49 2022] DELETE /identity/v3/projects/c4b842a7738a400b9b2b30f8ec7005ae => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:49.652547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9eb59-eef9-4541-8bd7-46d2eee70dd0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:49.653020 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9eb59-eef9-4541-8bd7-46d2eee70dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:49.653437 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9eb59-eef9-4541-8bd7-46d2eee70dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:49.692465 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cdd9eb59-eef9-4541-8bd7-46d2eee70dd0 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:49.693646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cdd9eb59-eef9-4541-8bd7-46d2eee70dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:49.708364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:49.802247 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1047/2108] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:49.810720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275d71-1b48-40a3-b034-524007b981ce None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:49.811010 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275d71-1b48-40a3-b034-524007b981ce None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:49.811292 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37275d71-1b48-40a3-b034-524007b981ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:49.847944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-37275d71-1b48-40a3-b034-524007b981ce None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:49.849428 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-37275d71-1b48-40a3-b034-524007b981ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:49.859436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1062/2109] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:38:49.863492 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9eb59-eef9-4541-8bd7-46d2eee70dd0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:49.875251 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9eb59-eef9-4541-8bd7-46d2eee70dd0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:49.879916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29e713-1c7b-436a-8d22-023c923d2e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:49.880528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29e713-1c7b-436a-8d22-023c923d2e43 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:49.880840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29e713-1c7b-436a-8d22-023c923d2e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:49.881112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29e713-1c7b-436a-8d22-023c923d2e43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:49.881764 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29e713-1c7b-436a-8d22-023c923d2e43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:49.882065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29e713-1c7b-436a-8d22-023c923d2e43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:49.883659 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29e713-1c7b-436a-8d22-023c923d2e43 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:49.903489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37275d71-1b48-40a3-b034-524007b981ce None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:49.909609 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1048/2110] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:38:49.915301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37275d71-1b48-40a3-b034-524007b981ce None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:49.926830 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759b87a-4030-4630-b7c8-bc3d10b797e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:49.927811 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759b87a-4030-4630-b7c8-bc3d10b797e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:49.928211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759b87a-4030-4630-b7c8-bc3d10b797e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:49.928580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2759b87a-4030-4630-b7c8-bc3d10b797e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:49.929911 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759b87a-4030-4630-b7c8-bc3d10b797e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:49.932428 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2759b87a-4030-4630-b7c8-bc3d10b797e9 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:49.955380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:49.976969 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1063/2111] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:49 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:49.982104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29e713-1c7b-436a-8d22-023c923d2e43 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:49.995306 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29e713-1c7b-436a-8d22-023c923d2e43 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:50.099774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8418633-eab5-4830-adbc-584f567b19fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:50.100467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8418633-eab5-4830-adbc-584f567b19fb admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:50.100853 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8418633-eab5-4830-adbc-584f567b19fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:50.101196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8418633-eab5-4830-adbc-584f567b19fb admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:50.101897 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8418633-eab5-4830-adbc-584f567b19fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:50.109701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8418633-eab5-4830-adbc-584f567b19fb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:50.137862 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1049/2112] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:49 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:50.143857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759b87a-4030-4630-b7c8-bc3d10b797e9 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:50.161301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2759b87a-4030-4630-b7c8-bc3d10b797e9 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:50.171944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993d4b7-881b-4032-9e64-fe951e42771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:50.172574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993d4b7-881b-4032-9e64-fe951e42771c admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:50.172913 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993d4b7-881b-4032-9e64-fe951e42771c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:50.173188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c993d4b7-881b-4032-9e64-fe951e42771c admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:50.173844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993d4b7-881b-4032-9e64-fe951e42771c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:50.175795 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c993d4b7-881b-4032-9e64-fe951e42771c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:50.187133 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1064/2113] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:50.191038 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8418633-eab5-4830-adbc-584f567b19fb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:50.203691 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8418633-eab5-4830-adbc-584f567b19fb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:50.217014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b5e0fe-89a3-470d-b0e8-88e771f31d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:50.220355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5e0fe-89a3-470d-b0e8-88e771f31d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:50.220355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5e0fe-89a3-470d-b0e8-88e771f31d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:50.220355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b5e0fe-89a3-470d-b0e8-88e771f31d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:50.220355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5e0fe-89a3-470d-b0e8-88e771f31d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:50.222924 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b5e0fe-89a3-470d-b0e8-88e771f31d8e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:50.240979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1050/2114] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:50.253828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993d4b7-881b-4032-9e64-fe951e42771c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:50.265899 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c993d4b7-881b-4032-9e64-fe951e42771c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:50.273988 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c171487-e141-434f-a2f5-7e220c119e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:50.274674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c171487-e141-434f-a2f5-7e220c119e53 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:50.274953 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c171487-e141-434f-a2f5-7e220c119e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:50.275226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c171487-e141-434f-a2f5-7e220c119e53 admin admin] PATH_INFO: `/v3/projects/64dded8ce600431db859a582510cd05a/users/d576c8a8688c4f6db356dcb1aade3c34/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:50.297099 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c171487-e141-434f-a2f5-7e220c119e53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64dded8ce600431db859a582510cd05a, user_id=d576c8a8688c4f6db356dcb1aade3c34, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:50.300865 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c171487-e141-434f-a2f5-7e220c119e53 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:50.323050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1065/2115] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:50 2022] PUT /identity/v3/projects/64dded8ce600431db859a582510cd05a/users/d576c8a8688c4f6db356dcb1aade3c34/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:50.334065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff1cd6-8c45-45c0-8b4d-412e1edf3444 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:50.334422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff1cd6-8c45-45c0-8b4d-412e1edf3444 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:50.334619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff1cd6-8c45-45c0-8b4d-412e1edf3444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:50.380553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-11ff1cd6-8c45-45c0-8b4d-412e1edf3444 None None] MFA Rules not processed for user `d576c8a8688c4f6db356dcb1aade3c34`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:50.382456 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-11ff1cd6-8c45-45c0-8b4d-412e1edf3444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:50.485095 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1051/2116] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:50.489459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c171487-e141-434f-a2f5-7e220c119e53 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:50.571737 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c171487-e141-434f-a2f5-7e220c119e53 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:50.576772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba50e51-ff91-4d57-84c3-98458a3dcfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:50.577394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba50e51-ff91-4d57-84c3-98458a3dcfeb admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:50.577708 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba50e51-ff91-4d57-84c3-98458a3dcfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:50.578116 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba50e51-ff91-4d57-84c3-98458a3dcfeb admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:50.578778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba50e51-ff91-4d57-84c3-98458a3dcfeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:50.581145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba50e51-ff91-4d57-84c3-98458a3dcfeb admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:50.618639 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1066/2117] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:50 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:50.623185 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff1cd6-8c45-45c0-8b4d-412e1edf3444 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:50.640059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff1cd6-8c45-45c0-8b4d-412e1edf3444 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:50.660691 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:50.715158 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b5e0b-401c-4c38-a4b0-38e1ed0aa71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:50.715779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b5e0b-401c-4c38-a4b0-38e1ed0aa71d admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:50.716130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b5e0b-401c-4c38-a4b0-38e1ed0aa71d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:50.716712 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4b5e0b-401c-4c38-a4b0-38e1ed0aa71d admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:50.717358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b5e0b-401c-4c38-a4b0-38e1ed0aa71d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:50.719425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4b5e0b-401c-4c38-a4b0-38e1ed0aa71d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:50.750474 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1052/2118] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:50 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:50.754535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba50e51-ff91-4d57-84c3-98458a3dcfeb admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:50.765047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba50e51-ff91-4d57-84c3-98458a3dcfeb admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:50.771991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794837da-a885-4e30-a06f-a6150042a211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:50.772968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794837da-a885-4e30-a06f-a6150042a211 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:50.772968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794837da-a885-4e30-a06f-a6150042a211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:50.772968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794837da-a885-4e30-a06f-a6150042a211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:50.773534 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794837da-a885-4e30-a06f-a6150042a211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:50.775175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794837da-a885-4e30-a06f-a6150042a211 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:50.787645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1067/2119] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:50.794043 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b5e0b-401c-4c38-a4b0-38e1ed0aa71d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:50.807192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4b5e0b-401c-4c38-a4b0-38e1ed0aa71d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:50.818204 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929ab75-f5df-479d-89d6-907a1558810a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:50.819103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929ab75-f5df-479d-89d6-907a1558810a admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:50.819603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929ab75-f5df-479d-89d6-907a1558810a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:50.820080 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929ab75-f5df-479d-89d6-907a1558810a admin admin] PATH_INFO: `/v3/projects/f132a8d910f04053a0d120b4c30c54b8/users/4055f38ab11e4b83b9c6a312418affe8/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:50.837036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929ab75-f5df-479d-89d6-907a1558810a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f132a8d910f04053a0d120b4c30c54b8, user_id=4055f38ab11e4b83b9c6a312418affe8, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:50.841601 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929ab75-f5df-479d-89d6-907a1558810a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:50.863259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1053/2120] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:50 2022] PUT /identity/v3/projects/f132a8d910f04053a0d120b4c30c54b8/users/4055f38ab11e4b83b9c6a312418affe8/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:50.867421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794837da-a885-4e30-a06f-a6150042a211 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:50.884058 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794837da-a885-4e30-a06f-a6150042a211 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:50.967711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ead7c-6775-45e7-a0f8-9e1f24d87c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:50.968263 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ead7c-6775-45e7-a0f8-9e1f24d87c1d admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:50.968538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ead7c-6775-45e7-a0f8-9e1f24d87c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:50.968835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ead7c-6775-45e7-a0f8-9e1f24d87c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:50.969566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ead7c-6775-45e7-a0f8-9e1f24d87c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:50.971383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ead7c-6775-45e7-a0f8-9e1f24d87c1d admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:50.982877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1068/2121] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:50 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:50.990124 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929ab75-f5df-479d-89d6-907a1558810a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:51.006163 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929ab75-f5df-479d-89d6-907a1558810a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:51.011940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc5e64-a01c-4ce5-8c38-abb99d0dea9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:51.012779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc5e64-a01c-4ce5-8c38-abb99d0dea9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:51.013119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc5e64-a01c-4ce5-8c38-abb99d0dea9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:51.013468 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dc5e64-a01c-4ce5-8c38-abb99d0dea9c admin admin] PATH_INFO: `/v3/projects/f132a8d910f04053a0d120b4c30c54b8/users/4055f38ab11e4b83b9c6a312418affe8/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:51.015639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc5e64-a01c-4ce5-8c38-abb99d0dea9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f132a8d910f04053a0d120b4c30c54b8, user_id=4055f38ab11e4b83b9c6a312418affe8, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:51.018425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dc5e64-a01c-4ce5-8c38-abb99d0dea9c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:51.031195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1054/2122] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:50 2022] PUT /identity/v3/projects/f132a8d910f04053a0d120b4c30c54b8/users/4055f38ab11e4b83b9c6a312418affe8/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:51.043499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be70f2-0fd1-4fa3-be23-1a5b2e38d95b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:51.043788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be70f2-0fd1-4fa3-be23-1a5b2e38d95b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:51.044066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be70f2-0fd1-4fa3-be23-1a5b2e38d95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:51.092818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-96be70f2-0fd1-4fa3-be23-1a5b2e38d95b None None] MFA Rules not processed for user `4055f38ab11e4b83b9c6a312418affe8`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:51.094476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-96be70f2-0fd1-4fa3-be23-1a5b2e38d95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:51.117213 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:51.214497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc5e64-a01c-4ce5-8c38-abb99d0dea9c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:51.219577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-06dc5e64-a01c-4ce5-8c38-abb99d0dea9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:51.270691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1069/2123] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:51.287284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be70f2-0fd1-4fa3-be23-1a5b2e38d95b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:51.292508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-96be70f2-0fd1-4fa3-be23-1a5b2e38d95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:51.337838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dc5e64-a01c-4ce5-8c38-abb99d0dea9c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:51.344622 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5b37bf-bcb2-4416-9b28-ba98647fe51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:51.345309 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b37bf-bcb2-4416-9b28-ba98647fe51b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:51.345591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b37bf-bcb2-4416-9b28-ba98647fe51b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:51.345863 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5b37bf-bcb2-4416-9b28-ba98647fe51b admin admin] PATH_INFO: `/v3/users/f6e865f851874163b407688f406efcdf` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:51.347944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b37bf-bcb2-4416-9b28-ba98647fe51b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e865f851874163b407688f406efcdf)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:51.354913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5b37bf-bcb2-4416-9b28-ba98647fe51b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:51.384738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be70f2-0fd1-4fa3-be23-1a5b2e38d95b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:51.392368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b917-7d51-4053-bfe6-fa982c9919f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:51.393639 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b917-7d51-4053-bfe6-fa982c9919f5 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:51.394122 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b917-7d51-4053-bfe6-fa982c9919f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:51.394857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b0b917-7d51-4053-bfe6-fa982c9919f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:51.441427 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ee5b37bf-bcb2-4416-9b28-ba98647fe51b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e865f851874163b407688f406efcdf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:51.451026 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ee5b37bf-bcb2-4416-9b28-ba98647fe51b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e865f851874163b407688f406efcdf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:51.461242 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:51.467959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ee5b37bf-bcb2-4416-9b28-ba98647fe51b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e865f851874163b407688f406efcdf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:51.480003 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ee5b37bf-bcb2-4416-9b28-ba98647fe51b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e865f851874163b407688f406efcdf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:51.481406 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ee5b37bf-bcb2-4416-9b28-ba98647fe51b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e865f851874163b407688f406efcdf'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:51.492298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0b917-7d51-4053-bfe6-fa982c9919f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:51.493317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1055/2124] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:38:51 2022] DELETE /identity/v3/users/f6e865f851874163b407688f406efcdf => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:51.499932 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7bb84-9f5a-4ede-a275-ca32504f58f5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:51.500158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b0b917-7d51-4053-bfe6-fa982c9919f5 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:51.500888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7bb84-9f5a-4ede-a275-ca32504f58f5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:51.502558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7bb84-9f5a-4ede-a275-ca32504f58f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:51.516777 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1070/2125] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:51.532683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-81a7bb84-9f5a-4ede-a275-ca32504f58f5 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:51.539663 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-81a7bb84-9f5a-4ede-a275-ca32504f58f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:51.679334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1056/2126] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:51.690432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b917-7d51-4053-bfe6-fa982c9919f5 service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:51.692089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-71b0b917-7d51-4053-bfe6-fa982c9919f5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:51.790779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b0b917-7d51-4053-bfe6-fa982c9919f5 service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:51.828324 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:51.874574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a96dd-94bf-4cda-a4cb-71fad41f29b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:51.875564 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a96dd-94bf-4cda-a4cb-71fad41f29b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:51.875564 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a96dd-94bf-4cda-a4cb-71fad41f29b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:51.875742 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a96dd-94bf-4cda-a4cb-71fad41f29b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:51.888924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a96dd-94bf-4cda-a4cb-71fad41f29b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:51.890659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a96dd-94bf-4cda-a4cb-71fad41f29b8 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:51.911038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1071/2127] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:52.319065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e46d7-f4af-4cd8-bb5f-e10bcec33c3c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:52.319355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e46d7-f4af-4cd8-bb5f-e10bcec33c3c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:52.319634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04e46d7-f4af-4cd8-bb5f-e10bcec33c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:52.386901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f04e46d7-f4af-4cd8-bb5f-e10bcec33c3c None None] MFA Rules not processed for user `8505dee31512437ba7b6de3512dcc76a`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:52.388145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f04e46d7-f4af-4cd8-bb5f-e10bcec33c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:52.451965 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a96dd-94bf-4cda-a4cb-71fad41f29b8 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:52.455788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0f4a96dd-94bf-4cda-a4cb-71fad41f29b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:52.479707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a96dd-94bf-4cda-a4cb-71fad41f29b8 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:52.495839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d624d2c5-7816-47a4-aef2-b22fb9f1793d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:52.496515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624d2c5-7816-47a4-aef2-b22fb9f1793d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:52.496700 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624d2c5-7816-47a4-aef2-b22fb9f1793d admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:52.497170 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d624d2c5-7816-47a4-aef2-b22fb9f1793d admin admin] PATH_INFO: `/v3/projects/781a70ae526347d4be315cad116d580a` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:52.498484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624d2c5-7816-47a4-aef2-b22fb9f1793d admin admin] RBAC: Authorizing `identity:delete_project(project_id=781a70ae526347d4be315cad116d580a)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:52.501397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d624d2c5-7816-47a4-aef2-b22fb9f1793d admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:52.521030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1057/2128] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:52.535104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e46d7-f4af-4cd8-bb5f-e10bcec33c3c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:52.536542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f04e46d7-f4af-4cd8-bb5f-e10bcec33c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:52.579008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d624d2c5-7816-47a4-aef2-b22fb9f1793d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781a70ae526347d4be315cad116d580a', 'request_id': 'req-d624d2c5-7816-47a4-aef2-b22fb9f1793d'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:52.587767 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d624d2c5-7816-47a4-aef2-b22fb9f1793d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781a70ae526347d4be315cad116d580a', 'request_id': 'req-d624d2c5-7816-47a4-aef2-b22fb9f1793d'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:52.594770 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d624d2c5-7816-47a4-aef2-b22fb9f1793d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781a70ae526347d4be315cad116d580a', 'request_id': 'req-d624d2c5-7816-47a4-aef2-b22fb9f1793d'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:52.606935 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d624d2c5-7816-47a4-aef2-b22fb9f1793d admin admin] The token cache is being invalidate because project 781a70ae526347d4be315cad116d580a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:38:52.607235 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d624d2c5-7816-47a4-aef2-b22fb9f1793d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:52.608080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d624d2c5-7816-47a4-aef2-b22fb9f1793d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:38:52.609660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1072/2129] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:38:52 2022] DELETE /identity/v3/projects/781a70ae526347d4be315cad116d580a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:38:52.614393 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275baab5-ef83-490b-9b69-1f671559229c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:52.614678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275baab5-ef83-490b-9b69-1f671559229c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:52.614955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275baab5-ef83-490b-9b69-1f671559229c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:52.638558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04e46d7-f4af-4cd8-bb5f-e10bcec33c3c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:52.645269 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-275baab5-ef83-490b-9b69-1f671559229c None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:52.645269 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-275baab5-ef83-490b-9b69-1f671559229c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:52.667357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:52.727809 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1073/2130] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:52.739102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51a287-4dbb-4ba0-8c39-25cabb8ab385 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:52.739378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51a287-4dbb-4ba0-8c39-25cabb8ab385 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:52.739655 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a51a287-4dbb-4ba0-8c39-25cabb8ab385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:52.740917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46d548-89ab-4d97-819c-6b54830833e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:52.741574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46d548-89ab-4d97-819c-6b54830833e4 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:52.741859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46d548-89ab-4d97-819c-6b54830833e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:52.742133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46d548-89ab-4d97-819c-6b54830833e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:52.745837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3a46d548-89ab-4d97-819c-6b54830833e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:52.762049 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-4a51a287-4dbb-4ba0-8c39-25cabb8ab385 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:52.765080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4a51a287-4dbb-4ba0-8c39-25cabb8ab385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:52.785356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1074/2131] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:52.786289 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51a287-4dbb-4ba0-8c39-25cabb8ab385 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:52.795868 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a51a287-4dbb-4ba0-8c39-25cabb8ab385 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:52.803017 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e206ef-6638-405d-9df8-32cabfc02cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:52.803634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e206ef-6638-405d-9df8-32cabfc02cbb admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:52.803917 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e206ef-6638-405d-9df8-32cabfc02cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:52.804250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e206ef-6638-405d-9df8-32cabfc02cbb admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:52.804962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e206ef-6638-405d-9df8-32cabfc02cbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:38:52.805266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e206ef-6638-405d-9df8-32cabfc02cbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:52.806873 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e206ef-6638-405d-9df8-32cabfc02cbb admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:52.816941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46d548-89ab-4d97-819c-6b54830833e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:52.818538 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a46d548-89ab-4d97-819c-6b54830833e4 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:52.819979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1075/2132] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:38:52.824613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e206ef-6638-405d-9df8-32cabfc02cbb admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:52.841411 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1058/2133] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:38:52.849325 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e206ef-6638-405d-9df8-32cabfc02cbb admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:52.857526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f4fe1-eeed-43ca-9f08-5bc901751dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:52.858162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f4fe1-eeed-43ca-9f08-5bc901751dd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:52.858501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f4fe1-eeed-43ca-9f08-5bc901751dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:52.858779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f4fe1-eeed-43ca-9f08-5bc901751dd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:52.859583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f4fe1-eeed-43ca-9f08-5bc901751dd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:52.861667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f4fe1-eeed-43ca-9f08-5bc901751dd0 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:52.899286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1076/2134] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:38:52 2022] POST /identity/v3/projects => generated 371 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:38:52.904023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46d548-89ab-4d97-819c-6b54830833e4 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:52.923085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46d548-89ab-4d97-819c-6b54830833e4 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:53.051749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ad4fe-5cc2-4b1b-9895-4e79badba0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:53.052376 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ad4fe-5cc2-4b1b-9895-4e79badba0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:53.052659 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ad4fe-5cc2-4b1b-9895-4e79badba0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:53.053067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8ad4fe-5cc2-4b1b-9895-4e79badba0e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:53.053962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ad4fe-5cc2-4b1b-9895-4e79badba0e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:53.056055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8ad4fe-5cc2-4b1b-9895-4e79badba0e8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:53.087141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1059/2135] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:38:52 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:38:53.091846 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f4fe1-eeed-43ca-9f08-5bc901751dd0 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:53.104555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f4fe1-eeed-43ca-9f08-5bc901751dd0 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:53.118612 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb340d07-f1f6-4767-bfd0-050cd5a09225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:53.119945 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb340d07-f1f6-4767-bfd0-050cd5a09225 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:53.120263 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb340d07-f1f6-4767-bfd0-050cd5a09225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:53.120535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb340d07-f1f6-4767-bfd0-050cd5a09225 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:53.121244 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb340d07-f1f6-4767-bfd0-050cd5a09225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:53.122872 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb340d07-f1f6-4767-bfd0-050cd5a09225 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:53.133707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:53.143102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1077/2136] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:53.144578 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ad4fe-5cc2-4b1b-9895-4e79badba0e8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:53.171234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8ad4fe-5cc2-4b1b-9895-4e79badba0e8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:53.176940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4193a-fb76-4535-806c-c78d7737502b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:53.177568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4193a-fb76-4535-806c-c78d7737502b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:53.177853 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4193a-fb76-4535-806c-c78d7737502b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:53.178130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4193a-fb76-4535-806c-c78d7737502b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:53.178791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4193a-fb76-4535-806c-c78d7737502b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:53.180403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf4193a-fb76-4535-806c-c78d7737502b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:53.194390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1060/2137] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:38:53 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:38:53.199320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb340d07-f1f6-4767-bfd0-050cd5a09225 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:53.210368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb340d07-f1f6-4767-bfd0-050cd5a09225 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:53.224511 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3e1f3-5555-42a3-ac45-1afc9e56496c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:53.225431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3e1f3-5555-42a3-ac45-1afc9e56496c admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:53.225784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3e1f3-5555-42a3-ac45-1afc9e56496c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:53.226162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3e1f3-5555-42a3-ac45-1afc9e56496c admin admin] PATH_INFO: `/v3/projects/8237b538f43a42278a1408f90a27ade1/users/427393a6813c47b3a7d7db6e265c6ee1/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:53.255850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3e1f3-5555-42a3-ac45-1afc9e56496c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8237b538f43a42278a1408f90a27ade1, user_id=427393a6813c47b3a7d7db6e265c6ee1, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:53.259418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3e1f3-5555-42a3-ac45-1afc9e56496c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:53.297602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1078/2138] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:38:53 2022] PUT /identity/v3/projects/8237b538f43a42278a1408f90a27ade1/users/427393a6813c47b3a7d7db6e265c6ee1/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:38:53.299160 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad932d3-da11-41b6-b050-3064a5877c8d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:53.299455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad932d3-da11-41b6-b050-3064a5877c8d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:53.299811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad932d3-da11-41b6-b050-3064a5877c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:53.366549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-aad932d3-da11-41b6-b050-3064a5877c8d None None] MFA Rules not processed for user `427393a6813c47b3a7d7db6e265c6ee1`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:53.371130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-aad932d3-da11-41b6-b050-3064a5877c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:53.419647 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:38:53.544613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1061/2139] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:53.561458 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3e1f3-5555-42a3-ac45-1afc9e56496c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:53.563355 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-59d3e1f3-5555-42a3-ac45-1afc9e56496c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:53.644538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3e1f3-5555-42a3-ac45-1afc9e56496c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:53.649587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a6f19-6670-440b-8519-7d8c0fd3237b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc0c92f881e40c9abe067d3a6d4251b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:53.650256 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a6f19-6670-440b-8519-7d8c0fd3237b service glance] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:53.650549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a6f19-6670-440b-8519-7d8c0fd3237b service glance] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:53.650868 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a6f19-6670-440b-8519-7d8c0fd3237b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:53.661824 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a6f19-6670-440b-8519-7d8c0fd3237b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:53.663283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a6f19-6670-440b-8519-7d8c0fd3237b service glance] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:53.674225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1079/2140] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:38:54.557654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f39e4-1eaf-4e97-bf46-fa353e481ee3 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:54.558136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f39e4-1eaf-4e97-bf46-fa353e481ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:54.558228 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82f39e4-1eaf-4e97-bf46-fa353e481ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:54.579513 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a82f39e4-1eaf-4e97-bf46-fa353e481ee3 None None] MFA Rules not processed for user `8505dee31512437ba7b6de3512dcc76a`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:38:54.580837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a82f39e4-1eaf-4e97-bf46-fa353e481ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:54.640989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1062/2141] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:38:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:38:56.578664 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a6f19-6670-440b-8519-7d8c0fd3237b service glance] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:38:56.580198 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e21a6f19-6670-440b-8519-7d8c0fd3237b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:56.648778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a6f19-6670-440b-8519-7d8c0fd3237b service glance] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:38:56.652816 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0c70a5-2439-4e45-86f9-11e91eabf107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:38:56.653848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c70a5-2439-4e45-86f9-11e91eabf107 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:38:56.654133 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c70a5-2439-4e45-86f9-11e91eabf107 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:38:56.654409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0c70a5-2439-4e45-86f9-11e91eabf107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:38:56.656333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5d0c70a5-2439-4e45-86f9-11e91eabf107 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:38:56.723278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c70a5-2439-4e45-86f9-11e91eabf107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:38:56.724638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0c70a5-2439-4e45-86f9-11e91eabf107 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:38:56.733909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1080/2142] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:38:56 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:39:01.656347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f39e4-1eaf-4e97-bf46-fa353e481ee3 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:01.658051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a82f39e4-1eaf-4e97-bf46-fa353e481ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:01.725558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82f39e4-1eaf-4e97-bf46-fa353e481ee3 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:01.730637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28da30c-4d85-4c4d-bc6c-413adb07b3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:01.731269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28da30c-4d85-4c4d-bc6c-413adb07b3da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:01.731599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28da30c-4d85-4c4d-bc6c-413adb07b3da admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:01.731884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28da30c-4d85-4c4d-bc6c-413adb07b3da admin admin] PATH_INFO: `/v3/users/d576c8a8688c4f6db356dcb1aade3c34` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:01.733041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28da30c-4d85-4c4d-bc6c-413adb07b3da admin admin] RBAC: Authorizing `identity:delete_user(user_id=d576c8a8688c4f6db356dcb1aade3c34)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:01.734952 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28da30c-4d85-4c4d-bc6c-413adb07b3da admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:01.783620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c28da30c-4d85-4c4d-bc6c-413adb07b3da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd576c8a8688c4f6db356dcb1aade3c34'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:01.790758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c28da30c-4d85-4c4d-bc6c-413adb07b3da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd576c8a8688c4f6db356dcb1aade3c34'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:01.798235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:01.804201 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c28da30c-4d85-4c4d-bc6c-413adb07b3da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd576c8a8688c4f6db356dcb1aade3c34'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:01.810854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c28da30c-4d85-4c4d-bc6c-413adb07b3da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd576c8a8688c4f6db356dcb1aade3c34'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:01.811479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c28da30c-4d85-4c4d-bc6c-413adb07b3da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd576c8a8688c4f6db356dcb1aade3c34'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:01.817396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1063/2143] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:39:01 2022] DELETE /identity/v3/users/d576c8a8688c4f6db356dcb1aade3c34 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:39:01.821915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff11800-31d1-4de2-a5a9-41ad761f8fa1 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:01.822371 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff11800-31d1-4de2-a5a9-41ad761f8fa1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:01.822503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff11800-31d1-4de2-a5a9-41ad761f8fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:01.842187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2ff11800-31d1-4de2-a5a9-41ad761f8fa1 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:01.843417 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2ff11800-31d1-4de2-a5a9-41ad761f8fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:01.867978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:01.915648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1081/2144] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:01.927200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28da30c-4d85-4c4d-bc6c-413adb07b3da admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:01.928720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c28da30c-4d85-4c4d-bc6c-413adb07b3da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:01.995916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28da30c-4d85-4c4d-bc6c-413adb07b3da admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:01.999602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddca6d-903f-44a7-852c-2ecbdd9d1bb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:02.000206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddca6d-903f-44a7-852c-2ecbdd9d1bb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:02.000490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddca6d-903f-44a7-852c-2ecbdd9d1bb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:02.000798 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ddca6d-903f-44a7-852c-2ecbdd9d1bb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:02.011338 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ddca6d-903f-44a7-852c-2ecbdd9d1bb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:02.012826 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ddca6d-903f-44a7-852c-2ecbdd9d1bb3 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:02.023866 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1064/2145] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:39:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:39:02.302589 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff11800-31d1-4de2-a5a9-41ad761f8fa1 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:02.304274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2ff11800-31d1-4de2-a5a9-41ad761f8fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:02.318975 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff11800-31d1-4de2-a5a9-41ad761f8fa1 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:02.323886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879facca-e44e-482b-bff2-bb599f0c5789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:02.324547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879facca-e44e-482b-bff2-bb599f0c5789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:02.324869 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879facca-e44e-482b-bff2-bb599f0c5789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:02.325147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879facca-e44e-482b-bff2-bb599f0c5789 admin admin] PATH_INFO: `/v3/projects/64dded8ce600431db859a582510cd05a` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:02.326990 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879facca-e44e-482b-bff2-bb599f0c5789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64dded8ce600431db859a582510cd05a)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:02.328571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879facca-e44e-482b-bff2-bb599f0c5789 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:02.389404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-879facca-e44e-482b-bff2-bb599f0c5789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64dded8ce600431db859a582510cd05a', 'request_id': 'req-879facca-e44e-482b-bff2-bb599f0c5789'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:02.396604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-879facca-e44e-482b-bff2-bb599f0c5789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64dded8ce600431db859a582510cd05a', 'request_id': 'req-879facca-e44e-482b-bff2-bb599f0c5789'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:02.403279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-879facca-e44e-482b-bff2-bb599f0c5789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64dded8ce600431db859a582510cd05a', 'request_id': 'req-879facca-e44e-482b-bff2-bb599f0c5789'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:02.415211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-879facca-e44e-482b-bff2-bb599f0c5789 admin admin] The token cache is being invalidate because project 64dded8ce600431db859a582510cd05a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:39:02.415490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-879facca-e44e-482b-bff2-bb599f0c5789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:02.416283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-879facca-e44e-482b-bff2-bb599f0c5789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:02.418832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1082/2146] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:39:02 2022] DELETE /identity/v3/projects/64dded8ce600431db859a582510cd05a => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:39:02.423214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddca6d-903f-44a7-852c-2ecbdd9d1bb3 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:02.433339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ddca6d-903f-44a7-852c-2ecbdd9d1bb3 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:02.491886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7b989c-a20b-44a4-bcf6-5349edaf8f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:02.492521 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b989c-a20b-44a4-bcf6-5349edaf8f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:02.492840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b989c-a20b-44a4-bcf6-5349edaf8f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:02.493115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7b989c-a20b-44a4-bcf6-5349edaf8f74 admin admin] PATH_INFO: `/v3/users/4055f38ab11e4b83b9c6a312418affe8` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:02.494497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b989c-a20b-44a4-bcf6-5349edaf8f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4055f38ab11e4b83b9c6a312418affe8)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:02.496423 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7b989c-a20b-44a4-bcf6-5349edaf8f74 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:02.544104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cf7b989c-a20b-44a4-bcf6-5349edaf8f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4055f38ab11e4b83b9c6a312418affe8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:02.551078 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cf7b989c-a20b-44a4-bcf6-5349edaf8f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4055f38ab11e4b83b9c6a312418affe8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:02.563370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cf7b989c-a20b-44a4-bcf6-5349edaf8f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4055f38ab11e4b83b9c6a312418affe8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:02.570874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cf7b989c-a20b-44a4-bcf6-5349edaf8f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4055f38ab11e4b83b9c6a312418affe8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:02.571577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cf7b989c-a20b-44a4-bcf6-5349edaf8f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4055f38ab11e4b83b9c6a312418affe8'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:02.578303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1065/2147] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:39:02 2022] DELETE /identity/v3/users/4055f38ab11e4b83b9c6a312418affe8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:39:02.858861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879facca-e44e-482b-bff2-bb599f0c5789 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:02.860386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-879facca-e44e-482b-bff2-bb599f0c5789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:02.876768 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879facca-e44e-482b-bff2-bb599f0c5789 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:02.938391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017a0edf-eaec-43ee-9a02-bb6c7b8181fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:02.938927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a0edf-eaec-43ee-9a02-bb6c7b8181fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:02.939204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a0edf-eaec-43ee-9a02-bb6c7b8181fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:02.939473 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017a0edf-eaec-43ee-9a02-bb6c7b8181fe admin admin] PATH_INFO: `/v3/projects/f132a8d910f04053a0d120b4c30c54b8` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:02.940573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a0edf-eaec-43ee-9a02-bb6c7b8181fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f132a8d910f04053a0d120b4c30c54b8)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:02.942494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017a0edf-eaec-43ee-9a02-bb6c7b8181fe admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:02.989619 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-017a0edf-eaec-43ee-9a02-bb6c7b8181fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f132a8d910f04053a0d120b4c30c54b8', 'request_id': 'req-017a0edf-eaec-43ee-9a02-bb6c7b8181fe'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:02.994101 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:03.000907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-017a0edf-eaec-43ee-9a02-bb6c7b8181fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f132a8d910f04053a0d120b4c30c54b8', 'request_id': 'req-017a0edf-eaec-43ee-9a02-bb6c7b8181fe'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:03.007682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-017a0edf-eaec-43ee-9a02-bb6c7b8181fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f132a8d910f04053a0d120b4c30c54b8', 'request_id': 'req-017a0edf-eaec-43ee-9a02-bb6c7b8181fe'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:03.025304 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-017a0edf-eaec-43ee-9a02-bb6c7b8181fe admin admin] The token cache is being invalidate because project f132a8d910f04053a0d120b4c30c54b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:39:03.025646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-017a0edf-eaec-43ee-9a02-bb6c7b8181fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:03.027144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-017a0edf-eaec-43ee-9a02-bb6c7b8181fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:03.028805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1083/2148] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:39:02 2022] DELETE /identity/v3/projects/f132a8d910f04053a0d120b4c30c54b8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:39:03.034909 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2c511-38b7-4087-812c-bcb10e76ee0b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:03.035426 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2c511-38b7-4087-812c-bcb10e76ee0b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:03.035549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2c511-38b7-4087-812c-bcb10e76ee0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:03.044450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:03.058666 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-89b2c511-38b7-4087-812c-bcb10e76ee0b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:03.060626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-89b2c511-38b7-4087-812c-bcb10e76ee0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:03.127720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1066/2149] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:03.137521 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12a85d-20f2-4455-b38a-500a2f65d9b9 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:03.138203 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12a85d-20f2-4455-b38a-500a2f65d9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:03.141031 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12a85d-20f2-4455-b38a-500a2f65d9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:03.161740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-3f12a85d-20f2-4455-b38a-500a2f65d9b9 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:03.163031 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3f12a85d-20f2-4455-b38a-500a2f65d9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:03.170935 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1084/2150] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:03.175307 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2c511-38b7-4087-812c-bcb10e76ee0b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:03.186299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2c511-38b7-4087-812c-bcb10e76ee0b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:03.191483 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37f2e5-0b31-488f-9a0c-29928b6bff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:03.192212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37f2e5-0b31-488f-9a0c-29928b6bff41 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:03.192361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37f2e5-0b31-488f-9a0c-29928b6bff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:03.192631 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37f2e5-0b31-488f-9a0c-29928b6bff41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:03.193362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37f2e5-0b31-488f-9a0c-29928b6bff41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:39:03.193666 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37f2e5-0b31-488f-9a0c-29928b6bff41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:03.195285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37f2e5-0b31-488f-9a0c-29928b6bff41 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:03.210429 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1067/2151] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:39:03.213240 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12a85d-20f2-4455-b38a-500a2f65d9b9 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:03.222679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12a85d-20f2-4455-b38a-500a2f65d9b9 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:03.227245 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ebe0c-ddbd-4cfe-820e-1cca4729b214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:03.227826 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ebe0c-ddbd-4cfe-820e-1cca4729b214 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:03.228100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ebe0c-ddbd-4cfe-820e-1cca4729b214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:03.228368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0ebe0c-ddbd-4cfe-820e-1cca4729b214 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:03.229042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ebe0c-ddbd-4cfe-820e-1cca4729b214 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:03.231340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0ebe0c-ddbd-4cfe-820e-1cca4729b214 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:03.276701 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1085/2152] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:39:03 2022] POST /identity/v3/projects => generated 381 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:39:03.278038 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37f2e5-0b31-488f-9a0c-29928b6bff41 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:03.288009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37f2e5-0b31-488f-9a0c-29928b6bff41 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:03.342914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0950bf-ed34-4cc1-b353-d3e5a49b2535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:03.343515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0950bf-ed34-4cc1-b353-d3e5a49b2535 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:03.343804 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0950bf-ed34-4cc1-b353-d3e5a49b2535 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:03.344081 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0950bf-ed34-4cc1-b353-d3e5a49b2535 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:03.344731 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0950bf-ed34-4cc1-b353-d3e5a49b2535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:03.346637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0950bf-ed34-4cc1-b353-d3e5a49b2535 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:03.374011 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1068/2153] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:39:03 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:39:03.375606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ebe0c-ddbd-4cfe-820e-1cca4729b214 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:03.387036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0ebe0c-ddbd-4cfe-820e-1cca4729b214 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:03.391740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca63da-8bbc-459f-badc-efede4f519bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:03.392372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca63da-8bbc-459f-badc-efede4f519bb admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:03.392648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca63da-8bbc-459f-badc-efede4f519bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:03.393583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca63da-8bbc-459f-badc-efede4f519bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:03.394244 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca63da-8bbc-459f-badc-efede4f519bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:03.396232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca63da-8bbc-459f-badc-efede4f519bb admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:03.411902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1086/2154] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:39:03.416216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0950bf-ed34-4cc1-b353-d3e5a49b2535 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:03.426967 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0950bf-ed34-4cc1-b353-d3e5a49b2535 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:03.432188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c7819-5404-4a32-a1f0-2c58aeb4d165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:03.433326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c7819-5404-4a32-a1f0-2c58aeb4d165 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:03.433600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c7819-5404-4a32-a1f0-2c58aeb4d165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:03.433868 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c7819-5404-4a32-a1f0-2c58aeb4d165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:03.434502 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c7819-5404-4a32-a1f0-2c58aeb4d165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:03.436066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c7819-5404-4a32-a1f0-2c58aeb4d165 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:03.447680 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1069/2155] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:39:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:39:03.451884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca63da-8bbc-459f-badc-efede4f519bb admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:03.465762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca63da-8bbc-459f-badc-efede4f519bb admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:03.470513 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a900c-bb80-4381-88ac-3ca59641fb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:03.471168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a900c-bb80-4381-88ac-3ca59641fb37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:03.471446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a900c-bb80-4381-88ac-3ca59641fb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:03.471717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2a900c-bb80-4381-88ac-3ca59641fb37 admin admin] PATH_INFO: `/v3/projects/eeda99c9af924b49875177994ad3a96c/users/3dbc133fc3244186bbadc30cad04173e/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:03.487779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a900c-bb80-4381-88ac-3ca59641fb37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeda99c9af924b49875177994ad3a96c, user_id=3dbc133fc3244186bbadc30cad04173e, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:03.490574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2a900c-bb80-4381-88ac-3ca59641fb37 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:03.504413 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1087/2156] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:39:03 2022] PUT /identity/v3/projects/eeda99c9af924b49875177994ad3a96c/users/3dbc133fc3244186bbadc30cad04173e/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:39:03.509542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cf1a6-8c0b-4a39-ae82-cb162f853722 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:03.509830 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cf1a6-8c0b-4a39-ae82-cb162f853722 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:03.510132 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081cf1a6-8c0b-4a39-ae82-cb162f853722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:03.529189 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-081cf1a6-8c0b-4a39-ae82-cb162f853722 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:03.530407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-081cf1a6-8c0b-4a39-ae82-cb162f853722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:03.590833 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1070/2157] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:03.600869 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a900c-bb80-4381-88ac-3ca59641fb37 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:03.602647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9b2a900c-bb80-4381-88ac-3ca59641fb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:03.663485 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2a900c-bb80-4381-88ac-3ca59641fb37 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:03.667646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f2c48-fdfa-4837-8e14-1a1bcad27264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:03.668250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f2c48-fdfa-4837-8e14-1a1bcad27264 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:03.668529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f2c48-fdfa-4837-8e14-1a1bcad27264 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:03.668834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f2c48-fdfa-4837-8e14-1a1bcad27264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:03.677834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f2c48-fdfa-4837-8e14-1a1bcad27264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:03.679302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f2c48-fdfa-4837-8e14-1a1bcad27264 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:03.690428 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1088/2158] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:39:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:39:04.330910 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba4865-2147-4e8f-b4de-3cede24f7258 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:04.332215 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba4865-2147-4e8f-b4de-3cede24f7258 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:04.332599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ba4865-2147-4e8f-b4de-3cede24f7258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:04.355293 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:04.366275 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-68ba4865-2147-4e8f-b4de-3cede24f7258 None None] MFA Rules not processed for user `3dbc133fc3244186bbadc30cad04173e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:04.369100 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-68ba4865-2147-4e8f-b4de-3cede24f7258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:04.461441 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1071/2159] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:39:04.486296 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f2c48-fdfa-4837-8e14-1a1bcad27264 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:04.488014 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e94f2c48-fdfa-4837-8e14-1a1bcad27264 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:04.552718 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f2c48-fdfa-4837-8e14-1a1bcad27264 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:04.557187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d3a7c-19a4-4e5b-87e3-86c647eac9d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:04.558354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d3a7c-19a4-4e5b-87e3-86c647eac9d0 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:04.558636 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d3a7c-19a4-4e5b-87e3-86c647eac9d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:04.558910 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88d3a7c-19a4-4e5b-87e3-86c647eac9d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:04.567904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d3a7c-19a4-4e5b-87e3-86c647eac9d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:04.569374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88d3a7c-19a4-4e5b-87e3-86c647eac9d0 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:04.578519 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1089/2160] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:39:04 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:39:05.970124 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d6d9c-bffb-4af9-9791-5d8d051c7ae1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:05.971015 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d6d9c-bffb-4af9-9791-5d8d051c7ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:05.971474 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d6d9c-bffb-4af9-9791-5d8d051c7ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:05.992724 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ae9d6d9c-bffb-4af9-9791-5d8d051c7ae1 None None] MFA Rules not processed for user `3dbc133fc3244186bbadc30cad04173e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:05.994667 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ae9d6d9c-bffb-4af9-9791-5d8d051c7ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:06.013130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1072/2161] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:39:14.574107 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=85,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:15.167501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d3a7c-19a4-4e5b-87e3-86c647eac9d0 service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:15.168967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a88d3a7c-19a4-4e5b-87e3-86c647eac9d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:15.183441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88d3a7c-19a4-4e5b-87e3-86c647eac9d0 service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:15.187835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0210c18-a2ff-41f1-90d4-5851b91fac21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:15.188445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0210c18-a2ff-41f1-90d4-5851b91fac21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:15.188751 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0210c18-a2ff-41f1-90d4-5851b91fac21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:15.189014 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0210c18-a2ff-41f1-90d4-5851b91fac21 admin admin] PATH_INFO: `/v3/users/1105afef62244fa58efdea30eb36dbb2` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:15.190126 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0210c18-a2ff-41f1-90d4-5851b91fac21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1105afef62244fa58efdea30eb36dbb2)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:15.192152 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0210c18-a2ff-41f1-90d4-5851b91fac21 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:15.239215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-f0210c18-a2ff-41f1-90d4-5851b91fac21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1105afef62244fa58efdea30eb36dbb2'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:15.247287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-f0210c18-a2ff-41f1-90d4-5851b91fac21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1105afef62244fa58efdea30eb36dbb2'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:15.259068 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-f0210c18-a2ff-41f1-90d4-5851b91fac21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1105afef62244fa58efdea30eb36dbb2'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:15.259732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-f0210c18-a2ff-41f1-90d4-5851b91fac21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1105afef62244fa58efdea30eb36dbb2'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:15.267602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-f0210c18-a2ff-41f1-90d4-5851b91fac21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1105afef62244fa58efdea30eb36dbb2'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:15.273559 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1090/2162] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:39:15 2022] DELETE /identity/v3/users/1105afef62244fa58efdea30eb36dbb2 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:39:15.277951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bcf14-2051-491b-ac5d-27d81623d6c2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:15.278407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bcf14-2051-491b-ac5d-27d81623d6c2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:15.278518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bcf14-2051-491b-ac5d-27d81623d6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:15.297648 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-052bcf14-2051-491b-ac5d-27d81623d6c2 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:15.298841 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-052bcf14-2051-491b-ac5d-27d81623d6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:15.356119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1073/2163] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:15.365778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0210c18-a2ff-41f1-90d4-5851b91fac21 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:15.367171 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f0210c18-a2ff-41f1-90d4-5851b91fac21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:15.426679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0210c18-a2ff-41f1-90d4-5851b91fac21 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:15.430187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93dab98-651a-4e63-8517-04d33bcf5e3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:15.430784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dab98-651a-4e63-8517-04d33bcf5e3f service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:15.431087 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dab98-651a-4e63-8517-04d33bcf5e3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:15.431358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93dab98-651a-4e63-8517-04d33bcf5e3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:15.440756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dab98-651a-4e63-8517-04d33bcf5e3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:15.442175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93dab98-651a-4e63-8517-04d33bcf5e3f service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:15.452241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1091/2164] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:39:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:39:15.715882 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bcf14-2051-491b-ac5d-27d81623d6c2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:15.717333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-052bcf14-2051-491b-ac5d-27d81623d6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:15.736987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052bcf14-2051-491b-ac5d-27d81623d6c2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:15.754618 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ab7b4-5e25-4488-956d-bac9c15e4193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:15.754821 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ab7b4-5e25-4488-956d-bac9c15e4193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:15.755093 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ab7b4-5e25-4488-956d-bac9c15e4193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:15.755365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ab7b4-5e25-4488-956d-bac9c15e4193 admin admin] PATH_INFO: `/v3/projects/bcdb57d3109345a48a890511a5f3bb1d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:15.756497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ab7b4-5e25-4488-956d-bac9c15e4193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcdb57d3109345a48a890511a5f3bb1d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:15.763305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ab7b4-5e25-4488-956d-bac9c15e4193 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:15.824296 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a52ab7b4-5e25-4488-956d-bac9c15e4193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcdb57d3109345a48a890511a5f3bb1d', 'request_id': 'req-a52ab7b4-5e25-4488-956d-bac9c15e4193'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:15.831429 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a52ab7b4-5e25-4488-956d-bac9c15e4193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcdb57d3109345a48a890511a5f3bb1d', 'request_id': 'req-a52ab7b4-5e25-4488-956d-bac9c15e4193'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:15.837661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a52ab7b4-5e25-4488-956d-bac9c15e4193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcdb57d3109345a48a890511a5f3bb1d', 'request_id': 'req-a52ab7b4-5e25-4488-956d-bac9c15e4193'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:15.850540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a52ab7b4-5e25-4488-956d-bac9c15e4193 admin admin] The token cache is being invalidate because project bcdb57d3109345a48a890511a5f3bb1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:39:15.850824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a52ab7b4-5e25-4488-956d-bac9c15e4193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:15.851438 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a52ab7b4-5e25-4488-956d-bac9c15e4193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:15.852934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1074/2165] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:39:15 2022] DELETE /identity/v3/projects/bcdb57d3109345a48a890511a5f3bb1d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:39:15.858481 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea244251-9087-4c7a-9d29-057bb39cf2e7 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:15.858942 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea244251-9087-4c7a-9d29-057bb39cf2e7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:15.859153 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea244251-9087-4c7a-9d29-057bb39cf2e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:15.878681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ea244251-9087-4c7a-9d29-057bb39cf2e7 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:15.879978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ea244251-9087-4c7a-9d29-057bb39cf2e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:15.939879 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1092/2166] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:39:15.949039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd87d4-fea7-47e6-95d0-b9f90727770f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:15.949372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd87d4-fea7-47e6-95d0-b9f90727770f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:15.949746 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edd87d4-fea7-47e6-95d0-b9f90727770f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:15.976460 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1edd87d4-fea7-47e6-95d0-b9f90727770f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:15.977668 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1edd87d4-fea7-47e6-95d0-b9f90727770f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:15.986584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1075/2167] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:15.991925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea244251-9087-4c7a-9d29-057bb39cf2e7 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:16.004330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea244251-9087-4c7a-9d29-057bb39cf2e7 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:16.009992 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3b433-8547-416e-b16f-43c3b8c62b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:16.011212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3b433-8547-416e-b16f-43c3b8c62b22 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:16.012792 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3b433-8547-416e-b16f-43c3b8c62b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:16.012792 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d3b433-8547-416e-b16f-43c3b8c62b22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:16.012792 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3b433-8547-416e-b16f-43c3b8c62b22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:39:16.013270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3b433-8547-416e-b16f-43c3b8c62b22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:16.015040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d3b433-8547-416e-b16f-43c3b8c62b22 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:16.027796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1093/2168] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:39:16.032539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd87d4-fea7-47e6-95d0-b9f90727770f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:16.046151 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edd87d4-fea7-47e6-95d0-b9f90727770f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:16.053343 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a24e1-cc2c-4867-ad6f-c680151d03a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:16.054069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a24e1-cc2c-4867-ad6f-c680151d03a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:16.054225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a24e1-cc2c-4867-ad6f-c680151d03a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:16.054501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975a24e1-cc2c-4867-ad6f-c680151d03a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:16.055158 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a24e1-cc2c-4867-ad6f-c680151d03a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:16.057856 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975a24e1-cc2c-4867-ad6f-c680151d03a5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:16.082287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:16.115602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1076/2169] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:39:16 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:39:16.121644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3b433-8547-416e-b16f-43c3b8c62b22 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:16.127246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:16.138326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d3b433-8547-416e-b16f-43c3b8c62b22 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:16.278625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434826ce-aed6-4356-8e88-397f16df2546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:16.279261 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434826ce-aed6-4356-8e88-397f16df2546 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:16.279546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434826ce-aed6-4356-8e88-397f16df2546 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:16.279822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434826ce-aed6-4356-8e88-397f16df2546 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:16.280813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434826ce-aed6-4356-8e88-397f16df2546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:16.282797 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434826ce-aed6-4356-8e88-397f16df2546 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:16.316904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1094/2170] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:39:16 2022] POST /identity/v3/users => generated 286 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:39:16.318117 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a24e1-cc2c-4867-ad6f-c680151d03a5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:16.334996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975a24e1-cc2c-4867-ad6f-c680151d03a5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:16.345352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63293da6-0434-41f6-9e5b-059e5a13bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:16.347613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63293da6-0434-41f6-9e5b-059e5a13bddd admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:16.348324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63293da6-0434-41f6-9e5b-059e5a13bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:16.348855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63293da6-0434-41f6-9e5b-059e5a13bddd admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:16.350410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63293da6-0434-41f6-9e5b-059e5a13bddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:16.353581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63293da6-0434-41f6-9e5b-059e5a13bddd admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:16.370474 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1077/2171] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:39:16.375189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434826ce-aed6-4356-8e88-397f16df2546 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:16.390241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434826ce-aed6-4356-8e88-397f16df2546 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:16.400532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e5338-dee4-4356-a1a1-2d00888544cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:16.404020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e5338-dee4-4356-a1a1-2d00888544cd admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:16.404422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e5338-dee4-4356-a1a1-2d00888544cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:16.405320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e5338-dee4-4356-a1a1-2d00888544cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:16.406348 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e5338-dee4-4356-a1a1-2d00888544cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:16.413724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7e5338-dee4-4356-a1a1-2d00888544cd admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:16.428693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1095/2172] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:39:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:39:16.433977 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63293da6-0434-41f6-9e5b-059e5a13bddd admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:16.446382 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63293da6-0434-41f6-9e5b-059e5a13bddd admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:16.452814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a595506-3fe1-4790-8ad8-485f815adfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:16.453624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a595506-3fe1-4790-8ad8-485f815adfe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:16.454002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a595506-3fe1-4790-8ad8-485f815adfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:16.454355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a595506-3fe1-4790-8ad8-485f815adfe8 admin admin] PATH_INFO: `/v3/projects/9b3ca43f623f4d12913127cdb4ccc35b/users/e4a6625d4e8f42af93bda9d91505e809/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:16.472728 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a595506-3fe1-4790-8ad8-485f815adfe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b3ca43f623f4d12913127cdb4ccc35b, user_id=e4a6625d4e8f42af93bda9d91505e809, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:16.475382 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a595506-3fe1-4790-8ad8-485f815adfe8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:16.492786 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1078/2173] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:39:16 2022] PUT /identity/v3/projects/9b3ca43f623f4d12913127cdb4ccc35b/users/e4a6625d4e8f42af93bda9d91505e809/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:39:16.503744 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38843f46-c437-45cd-ad5a-54cddcfca85b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:16.504426 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38843f46-c437-45cd-ad5a-54cddcfca85b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:16.504729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38843f46-c437-45cd-ad5a-54cddcfca85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:16.535079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-38843f46-c437-45cd-ad5a-54cddcfca85b None None] MFA Rules not processed for user `e4a6625d4e8f42af93bda9d91505e809`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:16.536359 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-38843f46-c437-45cd-ad5a-54cddcfca85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:16.601366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1096/2174] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:16.613736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a595506-3fe1-4790-8ad8-485f815adfe8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:16.615583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8a595506-3fe1-4790-8ad8-485f815adfe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:16.678695 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a595506-3fe1-4790-8ad8-485f815adfe8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:16.682854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52042403-9954-4611-95cd-108da62fda39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:16.683448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52042403-9954-4611-95cd-108da62fda39 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:16.683725 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52042403-9954-4611-95cd-108da62fda39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:16.683994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52042403-9954-4611-95cd-108da62fda39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:16.692113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52042403-9954-4611-95cd-108da62fda39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:16.693558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52042403-9954-4611-95cd-108da62fda39 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:16.702676 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1079/2175] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:39:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:39:16.729494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38843f46-c437-45cd-ad5a-54cddcfca85b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:16.793115 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38843f46-c437-45cd-ad5a-54cddcfca85b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:16.797681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22654371-c804-4617-ab95-c3e94d4af174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:16.798309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22654371-c804-4617-ab95-c3e94d4af174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:16.798594 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22654371-c804-4617-ab95-c3e94d4af174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:16.798880 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22654371-c804-4617-ab95-c3e94d4af174 admin admin] PATH_INFO: `/v3/users/e4a6625d4e8f42af93bda9d91505e809` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:16.805410 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22654371-c804-4617-ab95-c3e94d4af174 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4a6625d4e8f42af93bda9d91505e809)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:16.808752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22654371-c804-4617-ab95-c3e94d4af174 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:16.827758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:16.864530 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-22654371-c804-4617-ab95-c3e94d4af174 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4a6625d4e8f42af93bda9d91505e809'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:16.872401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-22654371-c804-4617-ab95-c3e94d4af174 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4a6625d4e8f42af93bda9d91505e809'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:16.885615 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-22654371-c804-4617-ab95-c3e94d4af174 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4a6625d4e8f42af93bda9d91505e809'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:16.886359 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-22654371-c804-4617-ab95-c3e94d4af174 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4a6625d4e8f42af93bda9d91505e809'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:16.894307 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-22654371-c804-4617-ab95-c3e94d4af174 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4a6625d4e8f42af93bda9d91505e809'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:16.900727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1097/2176] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:39:16 2022] DELETE /identity/v3/users/e4a6625d4e8f42af93bda9d91505e809 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:39:16.905235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b6031-4669-4303-938c-833b9e9fe187 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:16.905551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b6031-4669-4303-938c-833b9e9fe187 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:16.905846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8b6031-4669-4303-938c-833b9e9fe187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:16.925871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ad8b6031-4669-4303-938c-833b9e9fe187 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:16.927268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ad8b6031-4669-4303-938c-833b9e9fe187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:16.991247 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1080/2177] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:39:17.002454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22654371-c804-4617-ab95-c3e94d4af174 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:17.003941 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-22654371-c804-4617-ab95-c3e94d4af174 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:17.062085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22654371-c804-4617-ab95-c3e94d4af174 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:17.065704 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5606f4-d759-4a77-8e57-dc83f564b0a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:17.066300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5606f4-d759-4a77-8e57-dc83f564b0a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:17.066674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5606f4-d759-4a77-8e57-dc83f564b0a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:17.066974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5606f4-d759-4a77-8e57-dc83f564b0a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:17.075808 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5606f4-d759-4a77-8e57-dc83f564b0a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:17.077271 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5606f4-d759-4a77-8e57-dc83f564b0a2 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:17.086402 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1098/2178] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:39:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:39:17.365860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b6031-4669-4303-938c-833b9e9fe187 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:17.367769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ad8b6031-4669-4303-938c-833b9e9fe187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:17.380657 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8b6031-4669-4303-938c-833b9e9fe187 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:17.386132 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068d1e3-43c7-4e92-8aca-397e5bd6a2e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:17.386825 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068d1e3-43c7-4e92-8aca-397e5bd6a2e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:17.387449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068d1e3-43c7-4e92-8aca-397e5bd6a2e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:17.387814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068d1e3-43c7-4e92-8aca-397e5bd6a2e5 admin admin] PATH_INFO: `/v3/projects/9b3ca43f623f4d12913127cdb4ccc35b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:17.389646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068d1e3-43c7-4e92-8aca-397e5bd6a2e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b3ca43f623f4d12913127cdb4ccc35b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:17.391814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068d1e3-43c7-4e92-8aca-397e5bd6a2e5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:17.463521 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0068d1e3-43c7-4e92-8aca-397e5bd6a2e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b3ca43f623f4d12913127cdb4ccc35b', 'request_id': 'req-0068d1e3-43c7-4e92-8aca-397e5bd6a2e5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:17.466391 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:17.483749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0068d1e3-43c7-4e92-8aca-397e5bd6a2e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b3ca43f623f4d12913127cdb4ccc35b', 'request_id': 'req-0068d1e3-43c7-4e92-8aca-397e5bd6a2e5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:17.493198 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0068d1e3-43c7-4e92-8aca-397e5bd6a2e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b3ca43f623f4d12913127cdb4ccc35b', 'request_id': 'req-0068d1e3-43c7-4e92-8aca-397e5bd6a2e5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:17.510496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0068d1e3-43c7-4e92-8aca-397e5bd6a2e5 admin admin] The token cache is being invalidate because project 9b3ca43f623f4d12913127cdb4ccc35b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:39:17.510793 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0068d1e3-43c7-4e92-8aca-397e5bd6a2e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:17.511651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0068d1e3-43c7-4e92-8aca-397e5bd6a2e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:17.513207 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1081/2179] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:39:17 2022] DELETE /identity/v3/projects/9b3ca43f623f4d12913127cdb4ccc35b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:39:17.519383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bd082-6768-4019-93ac-6aa4567b9808 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:17.519915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bd082-6768-4019-93ac-6aa4567b9808 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:17.520629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269bd082-6768-4019-93ac-6aa4567b9808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:17.545934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-269bd082-6768-4019-93ac-6aa4567b9808 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:17.547430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-269bd082-6768-4019-93ac-6aa4567b9808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:17.616620 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1099/2180] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:17.626416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837996e-080d-4efb-90b9-4c0f4db9755a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:17.626707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837996e-080d-4efb-90b9-4c0f4db9755a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:17.626980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837996e-080d-4efb-90b9-4c0f4db9755a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:17.646933 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5837996e-080d-4efb-90b9-4c0f4db9755a None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:17.648349 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5837996e-080d-4efb-90b9-4c0f4db9755a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:17.656590 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1082/2181] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:17.660907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bd082-6768-4019-93ac-6aa4567b9808 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:17.671363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269bd082-6768-4019-93ac-6aa4567b9808 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:17.676205 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78438d-b936-406c-ae45-894121a33f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:17.676839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78438d-b936-406c-ae45-894121a33f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:17.677120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78438d-b936-406c-ae45-894121a33f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:17.677391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb78438d-b936-406c-ae45-894121a33f03 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:17.678033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78438d-b936-406c-ae45-894121a33f03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:39:17.678336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78438d-b936-406c-ae45-894121a33f03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:17.679975 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb78438d-b936-406c-ae45-894121a33f03 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:17.692464 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1100/2182] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:39:17.696700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837996e-080d-4efb-90b9-4c0f4db9755a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:17.706382 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837996e-080d-4efb-90b9-4c0f4db9755a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:17.711003 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c65ba7-d96c-4afc-9a3a-2e4193302b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:17.711587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c65ba7-d96c-4afc-9a3a-2e4193302b89 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:17.711868 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c65ba7-d96c-4afc-9a3a-2e4193302b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:17.712137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c65ba7-d96c-4afc-9a3a-2e4193302b89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:17.712792 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c65ba7-d96c-4afc-9a3a-2e4193302b89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:17.715223 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c65ba7-d96c-4afc-9a3a-2e4193302b89 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:17.742265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1083/2183] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:39:17 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:39:17.746535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78438d-b936-406c-ae45-894121a33f03 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:17.756361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb78438d-b936-406c-ae45-894121a33f03 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:17.773381 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:17.813357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a06e85-f385-48cc-aa7e-865a646ce933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:17.813954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a06e85-f385-48cc-aa7e-865a646ce933 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:17.814237 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a06e85-f385-48cc-aa7e-865a646ce933 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:17.814536 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a06e85-f385-48cc-aa7e-865a646ce933 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:17.815162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a06e85-f385-48cc-aa7e-865a646ce933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:17.817120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a06e85-f385-48cc-aa7e-865a646ce933 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:17.837628 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1101/2184] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:39:17 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:39:17.842303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c65ba7-d96c-4afc-9a3a-2e4193302b89 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:17.852612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c65ba7-d96c-4afc-9a3a-2e4193302b89 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:17.857293 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54c846-451f-4f0d-9ffd-53301a070878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:17.857885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54c846-451f-4f0d-9ffd-53301a070878 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:17.858170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54c846-451f-4f0d-9ffd-53301a070878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:17.858445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c54c846-451f-4f0d-9ffd-53301a070878 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:17.859091 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54c846-451f-4f0d-9ffd-53301a070878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:17.860686 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c54c846-451f-4f0d-9ffd-53301a070878 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:17.870706 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1084/2185] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:39:17.874421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a06e85-f385-48cc-aa7e-865a646ce933 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:17.884311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a06e85-f385-48cc-aa7e-865a646ce933 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:17.890567 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887e85a-f0f1-49bd-bb58-e3651709e743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:17.891167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887e85a-f0f1-49bd-bb58-e3651709e743 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:17.891447 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887e85a-f0f1-49bd-bb58-e3651709e743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:17.891717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887e85a-f0f1-49bd-bb58-e3651709e743 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:17.892357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887e85a-f0f1-49bd-bb58-e3651709e743 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:17.893974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887e85a-f0f1-49bd-bb58-e3651709e743 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:17.905835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1102/2186] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:39:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:39:17.910047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54c846-451f-4f0d-9ffd-53301a070878 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:17.920262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c54c846-451f-4f0d-9ffd-53301a070878 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:17.925065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687d324-9c99-461f-8bbe-42b618d682a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:17.926150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687d324-9c99-461f-8bbe-42b618d682a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:17.926150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687d324-9c99-461f-8bbe-42b618d682a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:17.926394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687d324-9c99-461f-8bbe-42b618d682a2 admin admin] PATH_INFO: `/v3/projects/b0a43bb33a65490ba9222283f7bf4358/users/a1adde0d318b4b698243ef1c5f0dad39/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:17.942864 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687d324-9c99-461f-8bbe-42b618d682a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a43bb33a65490ba9222283f7bf4358, user_id=a1adde0d318b4b698243ef1c5f0dad39, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:17.945577 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687d324-9c99-461f-8bbe-42b618d682a2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:17.965175 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1085/2187] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:39:17 2022] PUT /identity/v3/projects/b0a43bb33a65490ba9222283f7bf4358/users/a1adde0d318b4b698243ef1c5f0dad39/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:39:17.975610 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a46b35-203c-477f-8779-6282231c01bc None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:17.976002 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a46b35-203c-477f-8779-6282231c01bc None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:17.976341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a46b35-203c-477f-8779-6282231c01bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:18.007164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-53a46b35-203c-477f-8779-6282231c01bc None None] MFA Rules not processed for user `a1adde0d318b4b698243ef1c5f0dad39`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:18.008579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-53a46b35-203c-477f-8779-6282231c01bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:18.084299 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1103/2188] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:18.095680 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687d324-9c99-461f-8bbe-42b618d682a2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:18.097548 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5687d324-9c99-461f-8bbe-42b618d682a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:18.172924 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687d324-9c99-461f-8bbe-42b618d682a2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:18.182616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93406776-27e6-42a8-9303-bcb2c7eae343 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:18.184155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93406776-27e6-42a8-9303-bcb2c7eae343 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:18.184155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93406776-27e6-42a8-9303-bcb2c7eae343 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:18.184155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93406776-27e6-42a8-9303-bcb2c7eae343 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:18.193575 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93406776-27e6-42a8-9303-bcb2c7eae343 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:18.195010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93406776-27e6-42a8-9303-bcb2c7eae343 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:18.204622 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1086/2189] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:39:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:39:23.310457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a46b35-203c-477f-8779-6282231c01bc None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:23.312364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-53a46b35-203c-477f-8779-6282231c01bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:23.384743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a46b35-203c-477f-8779-6282231c01bc None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:23.389282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f431919-8e4b-40c6-8ee5-4259548f76d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:23.389914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f431919-8e4b-40c6-8ee5-4259548f76d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:23.390194 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f431919-8e4b-40c6-8ee5-4259548f76d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:23.390469 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f431919-8e4b-40c6-8ee5-4259548f76d3 admin admin] PATH_INFO: `/v3/users/427393a6813c47b3a7d7db6e265c6ee1` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:23.391594 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f431919-8e4b-40c6-8ee5-4259548f76d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=427393a6813c47b3a7d7db6e265c6ee1)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:23.393542 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f431919-8e4b-40c6-8ee5-4259548f76d3 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:23.436828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:23.452572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-0f431919-8e4b-40c6-8ee5-4259548f76d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427393a6813c47b3a7d7db6e265c6ee1'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:23.460519 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-0f431919-8e4b-40c6-8ee5-4259548f76d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427393a6813c47b3a7d7db6e265c6ee1'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:23.476357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-0f431919-8e4b-40c6-8ee5-4259548f76d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427393a6813c47b3a7d7db6e265c6ee1'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:23.477105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-0f431919-8e4b-40c6-8ee5-4259548f76d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427393a6813c47b3a7d7db6e265c6ee1'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:23.485380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-0f431919-8e4b-40c6-8ee5-4259548f76d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427393a6813c47b3a7d7db6e265c6ee1'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:23.491491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1104/2190] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:39:23 2022] DELETE /identity/v3/users/427393a6813c47b3a7d7db6e265c6ee1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:39:23.497028 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e3eb5-b6d7-4635-88b2-4fb8a9d69fb8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:23.497569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e3eb5-b6d7-4635-88b2-4fb8a9d69fb8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:23.497797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4e3eb5-b6d7-4635-88b2-4fb8a9d69fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:23.519606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0f4e3eb5-b6d7-4635-88b2-4fb8a9d69fb8 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:23.520877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0f4e3eb5-b6d7-4635-88b2-4fb8a9d69fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:23.604712 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1087/2191] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:23.615384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f431919-8e4b-40c6-8ee5-4259548f76d3 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:23.617221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0f431919-8e4b-40c6-8ee5-4259548f76d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:23.694904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f431919-8e4b-40c6-8ee5-4259548f76d3 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:23.702735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e2761-0a44-4b35-9dbf-a1123d9fd072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:23.703354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e2761-0a44-4b35-9dbf-a1123d9fd072 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:23.703631 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e2761-0a44-4b35-9dbf-a1123d9fd072 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:23.703901 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e2761-0a44-4b35-9dbf-a1123d9fd072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:23.719897 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e2761-0a44-4b35-9dbf-a1123d9fd072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:23.719897 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1e2761-0a44-4b35-9dbf-a1123d9fd072 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:23.730786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1105/2192] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:39:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:39:24.034049 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e3eb5-b6d7-4635-88b2-4fb8a9d69fb8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:24.035481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0f4e3eb5-b6d7-4635-88b2-4fb8a9d69fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:24.051007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4e3eb5-b6d7-4635-88b2-4fb8a9d69fb8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:24.055796 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e936f8-6454-4abf-acf3-29fe74baf499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:24.056493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e936f8-6454-4abf-acf3-29fe74baf499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:24.057341 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e936f8-6454-4abf-acf3-29fe74baf499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:24.057618 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e936f8-6454-4abf-acf3-29fe74baf499 admin admin] PATH_INFO: `/v3/projects/8237b538f43a42278a1408f90a27ade1` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:24.058784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e936f8-6454-4abf-acf3-29fe74baf499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8237b538f43a42278a1408f90a27ade1)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:24.060703 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e936f8-6454-4abf-acf3-29fe74baf499 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:24.077349 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:24.110601 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d3e936f8-6454-4abf-acf3-29fe74baf499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8237b538f43a42278a1408f90a27ade1', 'request_id': 'req-d3e936f8-6454-4abf-acf3-29fe74baf499'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:24.116410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d3e936f8-6454-4abf-acf3-29fe74baf499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8237b538f43a42278a1408f90a27ade1', 'request_id': 'req-d3e936f8-6454-4abf-acf3-29fe74baf499'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:24.122996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d3e936f8-6454-4abf-acf3-29fe74baf499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8237b538f43a42278a1408f90a27ade1', 'request_id': 'req-d3e936f8-6454-4abf-acf3-29fe74baf499'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:24.134733 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d3e936f8-6454-4abf-acf3-29fe74baf499 admin admin] The token cache is being invalidate because project 8237b538f43a42278a1408f90a27ade1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:39:24.135018 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d3e936f8-6454-4abf-acf3-29fe74baf499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:24.135630 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d3e936f8-6454-4abf-acf3-29fe74baf499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:24.137143 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1088/2193] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:39:24 2022] DELETE /identity/v3/projects/8237b538f43a42278a1408f90a27ade1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:39:24.142120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fcc10-e45f-423a-b1c6-5b618bc5b43c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:24.142412 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fcc10-e45f-423a-b1c6-5b618bc5b43c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:24.142714 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098fcc10-e45f-423a-b1c6-5b618bc5b43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:24.162460 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-098fcc10-e45f-423a-b1c6-5b618bc5b43c None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:24.163680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-098fcc10-e45f-423a-b1c6-5b618bc5b43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:24.237486 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1106/2194] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:39:24.245415 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c5c9-597e-4b25-be51-644e38736e0f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:24.245819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c5c9-597e-4b25-be51-644e38736e0f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:24.245985 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081c5c9-597e-4b25-be51-644e38736e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:24.271849 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1081c5c9-597e-4b25-be51-644e38736e0f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:24.273127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1081c5c9-597e-4b25-be51-644e38736e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:24.281823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1089/2195] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:24.286178 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fcc10-e45f-423a-b1c6-5b618bc5b43c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:24.297078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098fcc10-e45f-423a-b1c6-5b618bc5b43c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:24.303968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3019c-35cf-4e52-8326-985f6a4a5e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:24.304611 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3019c-35cf-4e52-8326-985f6a4a5e6b admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:24.304946 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3019c-35cf-4e52-8326-985f6a4a5e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:24.305219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e3019c-35cf-4e52-8326-985f6a4a5e6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:24.305932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3019c-35cf-4e52-8326-985f6a4a5e6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:39:24.306311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3019c-35cf-4e52-8326-985f6a4a5e6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:24.307962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e3019c-35cf-4e52-8326-985f6a4a5e6b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:24.324154 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1107/2196] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:39:24.325244 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081c5c9-597e-4b25-be51-644e38736e0f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:24.334690 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081c5c9-597e-4b25-be51-644e38736e0f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:24.340009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a403fc-107a-4310-a4f6-0649bdd364f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:24.340603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a403fc-107a-4310-a4f6-0649bdd364f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:24.340917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a403fc-107a-4310-a4f6-0649bdd364f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:24.341193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a403fc-107a-4310-a4f6-0649bdd364f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:24.341836 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a403fc-107a-4310-a4f6-0649bdd364f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:24.343732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a403fc-107a-4310-a4f6-0649bdd364f8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:24.372260 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1090/2197] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:39:24 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:39:24.378850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3019c-35cf-4e52-8326-985f6a4a5e6b admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:24.389351 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e3019c-35cf-4e52-8326-985f6a4a5e6b admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:24.429944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:24.466253 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd79d91-7ed7-4955-8aa9-e6223c490820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:24.466878 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd79d91-7ed7-4955-8aa9-e6223c490820 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:24.480692 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd79d91-7ed7-4955-8aa9-e6223c490820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:24.480692 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd79d91-7ed7-4955-8aa9-e6223c490820 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:24.480692 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd79d91-7ed7-4955-8aa9-e6223c490820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:24.480692 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd79d91-7ed7-4955-8aa9-e6223c490820 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:24.493599 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1108/2198] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:39:24 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:39:24.497982 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a403fc-107a-4310-a4f6-0649bdd364f8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:24.510721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a403fc-107a-4310-a4f6-0649bdd364f8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:24.515930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269fcea-0b55-43ac-a231-be6781ad4d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:24.516528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269fcea-0b55-43ac-a231-be6781ad4d4c admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:24.516845 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269fcea-0b55-43ac-a231-be6781ad4d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:24.517122 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3269fcea-0b55-43ac-a231-be6781ad4d4c admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:24.517800 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269fcea-0b55-43ac-a231-be6781ad4d4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:24.519416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3269fcea-0b55-43ac-a231-be6781ad4d4c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:24.533172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1091/2199] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:39:24.537388 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd79d91-7ed7-4955-8aa9-e6223c490820 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:24.547598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd79d91-7ed7-4955-8aa9-e6223c490820 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:24.552230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66afc83-b5d6-433f-837b-b71f137d863b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:24.552861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66afc83-b5d6-433f-837b-b71f137d863b admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:24.553139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66afc83-b5d6-433f-837b-b71f137d863b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:24.553406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66afc83-b5d6-433f-837b-b71f137d863b admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:24.554051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66afc83-b5d6-433f-837b-b71f137d863b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:24.555667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66afc83-b5d6-433f-837b-b71f137d863b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:24.567349 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1109/2200] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:39:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:39:24.571741 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269fcea-0b55-43ac-a231-be6781ad4d4c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:24.582399 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3269fcea-0b55-43ac-a231-be6781ad4d4c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:24.587059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8ce4b-a1b9-45a1-a73b-70e4f3db4838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:24.587720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8ce4b-a1b9-45a1-a73b-70e4f3db4838 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:24.588607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8ce4b-a1b9-45a1-a73b-70e4f3db4838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:24.588994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae8ce4b-a1b9-45a1-a73b-70e4f3db4838 admin admin] PATH_INFO: `/v3/projects/c31f3d4b5efb4e2ca01993de5a065eee/users/b04bd4b5e46c42bba7f912ef6932e8df/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:24.603080 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8ce4b-a1b9-45a1-a73b-70e4f3db4838 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31f3d4b5efb4e2ca01993de5a065eee, user_id=b04bd4b5e46c42bba7f912ef6932e8df, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:24.605760 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae8ce4b-a1b9-45a1-a73b-70e4f3db4838 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:24.619073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1092/2201] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:39:24 2022] PUT /identity/v3/projects/c31f3d4b5efb4e2ca01993de5a065eee/users/b04bd4b5e46c42bba7f912ef6932e8df/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:39:24.630588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863179cd-c587-4781-8891-e170a94984f4 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:24.631099 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863179cd-c587-4781-8891-e170a94984f4 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:24.631483 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863179cd-c587-4781-8891-e170a94984f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:24.661057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-863179cd-c587-4781-8891-e170a94984f4 None None] MFA Rules not processed for user `b04bd4b5e46c42bba7f912ef6932e8df`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:24.662550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-863179cd-c587-4781-8891-e170a94984f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:24.727884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1110/2202] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:24.739368 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8ce4b-a1b9-45a1-a73b-70e4f3db4838 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:24.741298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cae8ce4b-a1b9-45a1-a73b-70e4f3db4838 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:24.801099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae8ce4b-a1b9-45a1-a73b-70e4f3db4838 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:24.804824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167e40b-4d75-4066-84c7-5e0ffc0e1e5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:24.805430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167e40b-4d75-4066-84c7-5e0ffc0e1e5e service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:24.805710 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167e40b-4d75-4066-84c7-5e0ffc0e1e5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:24.805978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167e40b-4d75-4066-84c7-5e0ffc0e1e5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:24.815672 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167e40b-4d75-4066-84c7-5e0ffc0e1e5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:24.817270 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167e40b-4d75-4066-84c7-5e0ffc0e1e5e service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:24.828366 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1093/2203] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:39:24 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:39:28.426142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863179cd-c587-4781-8891-e170a94984f4 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:28.428509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-863179cd-c587-4781-8891-e170a94984f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:28.516915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863179cd-c587-4781-8891-e170a94984f4 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:28.521858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301dd0b-9a45-4e86-b5c5-5e29e98c819d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:28.522501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301dd0b-9a45-4e86-b5c5-5e29e98c819d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:28.522782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301dd0b-9a45-4e86-b5c5-5e29e98c819d admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:28.523057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301dd0b-9a45-4e86-b5c5-5e29e98c819d admin admin] PATH_INFO: `/v3/users/a1adde0d318b4b698243ef1c5f0dad39` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:28.524227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301dd0b-9a45-4e86-b5c5-5e29e98c819d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1adde0d318b4b698243ef1c5f0dad39)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:28.526849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301dd0b-9a45-4e86-b5c5-5e29e98c819d admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:28.579844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1301dd0b-9a45-4e86-b5c5-5e29e98c819d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1adde0d318b4b698243ef1c5f0dad39'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:28.581155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:28.588947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1301dd0b-9a45-4e86-b5c5-5e29e98c819d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1adde0d318b4b698243ef1c5f0dad39'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:28.608378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1301dd0b-9a45-4e86-b5c5-5e29e98c819d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1adde0d318b4b698243ef1c5f0dad39'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:28.608378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1301dd0b-9a45-4e86-b5c5-5e29e98c819d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1adde0d318b4b698243ef1c5f0dad39'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:28.614550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1301dd0b-9a45-4e86-b5c5-5e29e98c819d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1adde0d318b4b698243ef1c5f0dad39'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:28.622593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1111/2204] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:39:28 2022] DELETE /identity/v3/users/a1adde0d318b4b698243ef1c5f0dad39 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:39:28.627159 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f6600-c3c9-49ed-a2eb-5119b658c55f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:28.627625 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f6600-c3c9-49ed-a2eb-5119b658c55f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:28.627723 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f6600-c3c9-49ed-a2eb-5119b658c55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:28.648094 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-414f6600-c3c9-49ed-a2eb-5119b658c55f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:28.649168 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-414f6600-c3c9-49ed-a2eb-5119b658c55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:28.687201 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:28.710744 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1094/2205] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:39:28.720386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301dd0b-9a45-4e86-b5c5-5e29e98c819d admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:28.721847 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1301dd0b-9a45-4e86-b5c5-5e29e98c819d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:28.782725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301dd0b-9a45-4e86-b5c5-5e29e98c819d admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:28.786746 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df9e85-dad9-4f6e-985e-390c2af2adb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:28.787356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df9e85-dad9-4f6e-985e-390c2af2adb7 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:28.787635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df9e85-dad9-4f6e-985e-390c2af2adb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:28.787906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df9e85-dad9-4f6e-985e-390c2af2adb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:28.797274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df9e85-dad9-4f6e-985e-390c2af2adb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:28.798715 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df9e85-dad9-4f6e-985e-390c2af2adb7 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:28.809512 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1112/2206] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:39:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:39:29.086280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f6600-c3c9-49ed-a2eb-5119b658c55f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:29.089220 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-414f6600-c3c9-49ed-a2eb-5119b658c55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:29.108911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f6600-c3c9-49ed-a2eb-5119b658c55f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:29.116578 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016f018-c007-4fab-9cfa-58c89b9a5313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:29.117342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016f018-c007-4fab-9cfa-58c89b9a5313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:29.117839 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016f018-c007-4fab-9cfa-58c89b9a5313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:29.118122 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016f018-c007-4fab-9cfa-58c89b9a5313 admin admin] PATH_INFO: `/v3/projects/b0a43bb33a65490ba9222283f7bf4358` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:29.124535 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016f018-c007-4fab-9cfa-58c89b9a5313 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a43bb33a65490ba9222283f7bf4358)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:29.126692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016f018-c007-4fab-9cfa-58c89b9a5313 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:29.181983 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5016f018-c007-4fab-9cfa-58c89b9a5313 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a43bb33a65490ba9222283f7bf4358', 'request_id': 'req-5016f018-c007-4fab-9cfa-58c89b9a5313'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:29.190469 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5016f018-c007-4fab-9cfa-58c89b9a5313 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a43bb33a65490ba9222283f7bf4358', 'request_id': 'req-5016f018-c007-4fab-9cfa-58c89b9a5313'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:29.197138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5016f018-c007-4fab-9cfa-58c89b9a5313 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a43bb33a65490ba9222283f7bf4358', 'request_id': 'req-5016f018-c007-4fab-9cfa-58c89b9a5313'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:29.214730 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5016f018-c007-4fab-9cfa-58c89b9a5313 admin admin] The token cache is being invalidate because project b0a43bb33a65490ba9222283f7bf4358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:39:29.215180 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5016f018-c007-4fab-9cfa-58c89b9a5313 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:29.215907 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5016f018-c007-4fab-9cfa-58c89b9a5313 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:29.217996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1095/2207] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:39:29 2022] DELETE /identity/v3/projects/b0a43bb33a65490ba9222283f7bf4358 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:39:34.871982 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df9e85-dad9-4f6e-985e-390c2af2adb7 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:34.873431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-29df9e85-dad9-4f6e-985e-390c2af2adb7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:34.887078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df9e85-dad9-4f6e-985e-390c2af2adb7 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:34.943556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba14c0-1316-4584-8c08-4142dab24ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:34.944192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba14c0-1316-4584-8c08-4142dab24ed0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:34.944470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba14c0-1316-4584-8c08-4142dab24ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:34.944770 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba14c0-1316-4584-8c08-4142dab24ed0 admin admin] PATH_INFO: `/v3/users/b04bd4b5e46c42bba7f912ef6932e8df` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:34.945895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba14c0-1316-4584-8c08-4142dab24ed0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b04bd4b5e46c42bba7f912ef6932e8df)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:34.947842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba14c0-1316-4584-8c08-4142dab24ed0 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:34.991801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-faba14c0-1316-4584-8c08-4142dab24ed0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b04bd4b5e46c42bba7f912ef6932e8df'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:35.001187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-faba14c0-1316-4584-8c08-4142dab24ed0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b04bd4b5e46c42bba7f912ef6932e8df'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:35.011616 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:35.014168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-faba14c0-1316-4584-8c08-4142dab24ed0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b04bd4b5e46c42bba7f912ef6932e8df'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:35.015533 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-faba14c0-1316-4584-8c08-4142dab24ed0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b04bd4b5e46c42bba7f912ef6932e8df'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:35.022894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-faba14c0-1316-4584-8c08-4142dab24ed0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b04bd4b5e46c42bba7f912ef6932e8df'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:35.028817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1113/2208] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:39:34 2022] DELETE /identity/v3/users/b04bd4b5e46c42bba7f912ef6932e8df => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:39:35.033690 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f3662-4767-4251-ad77-ea35a73990a9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:35.034229 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f3662-4767-4251-ad77-ea35a73990a9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:35.034426 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f3662-4767-4251-ad77-ea35a73990a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:35.053979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-998f3662-4767-4251-ad77-ea35a73990a9 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:35.055176 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-998f3662-4767-4251-ad77-ea35a73990a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:35.113461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1096/2209] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:39:35.123843 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba14c0-1316-4584-8c08-4142dab24ed0 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:35.125299 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-faba14c0-1316-4584-8c08-4142dab24ed0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:35.182817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba14c0-1316-4584-8c08-4142dab24ed0 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:35.186599 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b6683-b8ab-4189-ad18-2bb799950525 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:35.187210 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b6683-b8ab-4189-ad18-2bb799950525 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:35.187495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b6683-b8ab-4189-ad18-2bb799950525 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:35.187769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b6683-b8ab-4189-ad18-2bb799950525 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:35.196950 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b6683-b8ab-4189-ad18-2bb799950525 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:35.198383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b6683-b8ab-4189-ad18-2bb799950525 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:35.207746 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1114/2210] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:39:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:39:35.477667 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f3662-4767-4251-ad77-ea35a73990a9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:35.479791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-998f3662-4767-4251-ad77-ea35a73990a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:35.492259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f3662-4767-4251-ad77-ea35a73990a9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:35.506142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e676f574-bcf2-42f9-ba25-0b9dca7133de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:35.506886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676f574-bcf2-42f9-ba25-0b9dca7133de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:35.507172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676f574-bcf2-42f9-ba25-0b9dca7133de admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:35.507452 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e676f574-bcf2-42f9-ba25-0b9dca7133de admin admin] PATH_INFO: `/v3/projects/c31f3d4b5efb4e2ca01993de5a065eee` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:35.509654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676f574-bcf2-42f9-ba25-0b9dca7133de admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31f3d4b5efb4e2ca01993de5a065eee)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:35.511171 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e676f574-bcf2-42f9-ba25-0b9dca7133de admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:35.576028 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e676f574-bcf2-42f9-ba25-0b9dca7133de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31f3d4b5efb4e2ca01993de5a065eee', 'request_id': 'req-e676f574-bcf2-42f9-ba25-0b9dca7133de'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:35.582006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e676f574-bcf2-42f9-ba25-0b9dca7133de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31f3d4b5efb4e2ca01993de5a065eee', 'request_id': 'req-e676f574-bcf2-42f9-ba25-0b9dca7133de'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:35.584584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:35.590566 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e676f574-bcf2-42f9-ba25-0b9dca7133de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31f3d4b5efb4e2ca01993de5a065eee', 'request_id': 'req-e676f574-bcf2-42f9-ba25-0b9dca7133de'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:35.606439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e676f574-bcf2-42f9-ba25-0b9dca7133de admin admin] The token cache is being invalidate because project c31f3d4b5efb4e2ca01993de5a065eee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:39:35.606761 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e676f574-bcf2-42f9-ba25-0b9dca7133de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:35.607781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e676f574-bcf2-42f9-ba25-0b9dca7133de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:39:35.609903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1097/2211] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:39:35 2022] DELETE /identity/v3/projects/c31f3d4b5efb4e2ca01993de5a065eee => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:39:35.615438 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcf7c0-bd5d-4b97-8fc3-8cd634995c6a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:35.615817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcf7c0-bd5d-4b97-8fc3-8cd634995c6a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:35.616165 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fcf7c0-bd5d-4b97-8fc3-8cd634995c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:35.637823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d3fcf7c0-bd5d-4b97-8fc3-8cd634995c6a None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:35.639036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d3fcf7c0-bd5d-4b97-8fc3-8cd634995c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:35.700633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1115/2212] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:39:35.708463 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa51a57-69ce-4346-94c5-cbf8ddff3652 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:35.708786 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa51a57-69ce-4346-94c5-cbf8ddff3652 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:35.709063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa51a57-69ce-4346-94c5-cbf8ddff3652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:35.729477 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3fa51a57-69ce-4346-94c5-cbf8ddff3652 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:35.730682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3fa51a57-69ce-4346-94c5-cbf8ddff3652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:35.739138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1098/2213] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:35.743438 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcf7c0-bd5d-4b97-8fc3-8cd634995c6a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:35.753592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fcf7c0-bd5d-4b97-8fc3-8cd634995c6a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:35.758208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e0bae-4650-40b4-a4a2-c008527ccfc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:35.758819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e0bae-4650-40b4-a4a2-c008527ccfc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:35.759102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e0bae-4650-40b4-a4a2-c008527ccfc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:35.759926 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e0bae-4650-40b4-a4a2-c008527ccfc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:35.760586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e0bae-4650-40b4-a4a2-c008527ccfc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:39:35.760927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e0bae-4650-40b4-a4a2-c008527ccfc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:35.762553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e0bae-4650-40b4-a4a2-c008527ccfc2 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:35.776188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1116/2214] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:39:35.780647 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa51a57-69ce-4346-94c5-cbf8ddff3652 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:35.789787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa51a57-69ce-4346-94c5-cbf8ddff3652 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:35.794726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747aec36-9153-426d-8800-423cdfc8bfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:35.795323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747aec36-9153-426d-8800-423cdfc8bfde admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:35.795600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747aec36-9153-426d-8800-423cdfc8bfde admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:35.795871 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747aec36-9153-426d-8800-423cdfc8bfde admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:35.796500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747aec36-9153-426d-8800-423cdfc8bfde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:35.798422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747aec36-9153-426d-8800-423cdfc8bfde admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:35.825845 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1099/2215] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:39:35 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:39:35.830221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e0bae-4650-40b4-a4a2-c008527ccfc2 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:35.840930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e0bae-4650-40b4-a4a2-c008527ccfc2 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:35.906833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ed4a4-d1b2-4676-866b-80e66216b3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:35.907511 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ed4a4-d1b2-4676-866b-80e66216b3aa admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:35.907782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ed4a4-d1b2-4676-866b-80e66216b3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:35.908057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ed4a4-d1b2-4676-866b-80e66216b3aa admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:35.908701 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ed4a4-d1b2-4676-866b-80e66216b3aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:35.910810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648ed4a4-d1b2-4676-866b-80e66216b3aa admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:35.937441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1117/2216] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:39:35 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:39:35.938597 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747aec36-9153-426d-8800-423cdfc8bfde admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:35.949565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747aec36-9153-426d-8800-423cdfc8bfde admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:35.954205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c15fc-0b2e-4a64-bb50-f794ae2196ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:35.954803 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c15fc-0b2e-4a64-bb50-f794ae2196ba admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:35.955081 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c15fc-0b2e-4a64-bb50-f794ae2196ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:35.955351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c15fc-0b2e-4a64-bb50-f794ae2196ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:35.955992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c15fc-0b2e-4a64-bb50-f794ae2196ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:35.957610 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c15fc-0b2e-4a64-bb50-f794ae2196ba admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:35.968357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1100/2217] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:39:35.972613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ed4a4-d1b2-4676-866b-80e66216b3aa admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:35.982593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ed4a4-d1b2-4676-866b-80e66216b3aa admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:35.987496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11bb0ba-df50-4472-827c-907e57a55bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:35.988099 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bb0ba-df50-4472-827c-907e57a55bbb admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:35.988355 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bb0ba-df50-4472-827c-907e57a55bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:35.988627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11bb0ba-df50-4472-827c-907e57a55bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:35.989298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11bb0ba-df50-4472-827c-907e57a55bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:35.990906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11bb0ba-df50-4472-827c-907e57a55bbb admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:35.992320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:36.007271 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1118/2218] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:39:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:39:36.008479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c15fc-0b2e-4a64-bb50-f794ae2196ba admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:36.019394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c15fc-0b2e-4a64-bb50-f794ae2196ba admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:36.024060 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf3f38-8001-493d-8420-3c00e374bfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:36.024772 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf3f38-8001-493d-8420-3c00e374bfb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:36.025646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf3f38-8001-493d-8420-3c00e374bfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:36.025921 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaf3f38-8001-493d-8420-3c00e374bfb0 admin admin] PATH_INFO: `/v3/projects/c897cb69620144679ba70f884cf4c1da/users/5b17394203004ff59a2046bfe2c4bcec/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:36.041034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf3f38-8001-493d-8420-3c00e374bfb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c897cb69620144679ba70f884cf4c1da, user_id=5b17394203004ff59a2046bfe2c4bcec, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:36.043711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaf3f38-8001-493d-8420-3c00e374bfb0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:36.058178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1101/2219] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:39:36 2022] PUT /identity/v3/projects/c897cb69620144679ba70f884cf4c1da/users/5b17394203004ff59a2046bfe2c4bcec/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:39:36.068100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7daf0-6753-4609-abaa-e9e246dd724d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:36.068524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7daf0-6753-4609-abaa-e9e246dd724d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:36.068898 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7daf0-6753-4609-abaa-e9e246dd724d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:36.096172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-edd7daf0-6753-4609-abaa-e9e246dd724d None None] MFA Rules not processed for user `5b17394203004ff59a2046bfe2c4bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:36.097394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-edd7daf0-6753-4609-abaa-e9e246dd724d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:36.160765 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1119/2220] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:36.171501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf3f38-8001-493d-8420-3c00e374bfb0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:36.173202 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-feaf3f38-8001-493d-8420-3c00e374bfb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:36.228368 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaf3f38-8001-493d-8420-3c00e374bfb0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:36.231945 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e51f8-4446-4836-a5f6-ee80d27bb883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:36.232537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e51f8-4446-4836-a5f6-ee80d27bb883 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:36.232842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e51f8-4446-4836-a5f6-ee80d27bb883 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:36.233115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e51f8-4446-4836-a5f6-ee80d27bb883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:36.241200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e51f8-4446-4836-a5f6-ee80d27bb883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:36.242604 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e51f8-4446-4836-a5f6-ee80d27bb883 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:36.251782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1102/2221] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:39:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:39:37.607212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6360ce-b704-45d4-8daf-87654ce01e0d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:37.607757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6360ce-b704-45d4-8daf-87654ce01e0d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:37.607757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6360ce-b704-45d4-8daf-87654ce01e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:37.627191 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-bb6360ce-b704-45d4-8daf-87654ce01e0d None None] MFA Rules not processed for user `5b17394203004ff59a2046bfe2c4bcec`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:37.628399 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-bb6360ce-b704-45d4-8daf-87654ce01e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:37.641463 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1120/2222] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:44.902632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57528c5c-daab-4170-9a16-4d815bfeee83 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:44.903157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57528c5c-daab-4170-9a16-4d815bfeee83 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:44.903157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57528c5c-daab-4170-9a16-4d815bfeee83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:44.921968 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-57528c5c-daab-4170-9a16-4d815bfeee83 None None] MFA Rules not processed for user `4bad46590fab4c94a789626e42aca76d`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:44.923171 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-57528c5c-daab-4170-9a16-4d815bfeee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:44.984313 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1103/2223] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:39:44 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:45.527189 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4422d-0ea8-4a0e-8a35-cb6f59b5c05d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:45.527731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4422d-0ea8-4a0e-8a35-cb6f59b5c05d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:45.527939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4422d-0ea8-4a0e-8a35-cb6f59b5c05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:45.549524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a5e4422d-0ea8-4a0e-8a35-cb6f59b5c05d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:45.550828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a5e4422d-0ea8-4a0e-8a35-cb6f59b5c05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:45.657820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1121/2224] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Sep 13 06:39:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:39:45.843526 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57528c5c-daab-4170-9a16-4d815bfeee83 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:45.844995 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-57528c5c-daab-4170-9a16-4d815bfeee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:45.887014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:39:45.954717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57528c5c-daab-4170-9a16-4d815bfeee83 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:45.960874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0b966-9f69-44d2-a588-e27c2de0b7ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:45.961602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0b966-9f69-44d2-a588-e27c2de0b7ea service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:45.961989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0b966-9f69-44d2-a588-e27c2de0b7ea service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:45.962329 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0b966-9f69-44d2-a588-e27c2de0b7ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:45.972348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0b966-9f69-44d2-a588-e27c2de0b7ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:45.973987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0b966-9f69-44d2-a588-e27c2de0b7ea service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:45.984374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1104/2225] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:39:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:39:49.059633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a7f1-4739-43da-8c3e-aeb619e5233b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:49.060094 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a7f1-4739-43da-8c3e-aeb619e5233b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:49.060174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be95a7f1-4739-43da-8c3e-aeb619e5233b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:49.079702 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-be95a7f1-4739-43da-8c3e-aeb619e5233b None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:49.080954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-be95a7f1-4739-43da-8c3e-aeb619e5233b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:49.142212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1122/2226] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 13 06:39:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:49.194280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0b966-9f69-44d2-a588-e27c2de0b7ea service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:49.195698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-78f0b966-9f69-44d2-a588-e27c2de0b7ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:49.270249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0b966-9f69-44d2-a588-e27c2de0b7ea service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:49.275334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd538771-fc3c-493a-b8ed-053f9cec4236 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:49.283488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd538771-fc3c-493a-b8ed-053f9cec4236 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:49.283488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd538771-fc3c-493a-b8ed-053f9cec4236 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:49.283488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd538771-fc3c-493a-b8ed-053f9cec4236 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:49.296389 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd538771-fc3c-493a-b8ed-053f9cec4236 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:49.298111 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd538771-fc3c-493a-b8ed-053f9cec4236 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:49.307593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1105/2227] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:39:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 06:39:49.712775 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63362819-c078-4bb9-b260-250c571069d4 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:49.713483 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63362819-c078-4bb9-b260-250c571069d4 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:49.714158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63362819-c078-4bb9-b260-250c571069d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:49.746994 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-63362819-c078-4bb9-b260-250c571069d4 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:49.748704 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-63362819-c078-4bb9-b260-250c571069d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:49.763820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1123/2228] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Sep 13 06:39:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:49.800110 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd538771-fc3c-493a-b8ed-053f9cec4236 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:49.801822 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cd538771-fc3c-493a-b8ed-053f9cec4236 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:49.833802 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd538771-fc3c-493a-b8ed-053f9cec4236 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:49.849364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09243d5-6df7-4f8d-9f64-a564bedcbf91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:49.850222 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09243d5-6df7-4f8d-9f64-a564bedcbf91 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:49.850434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09243d5-6df7-4f8d-9f64-a564bedcbf91 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:49.850512 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09243d5-6df7-4f8d-9f64-a564bedcbf91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:49.875726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09243d5-6df7-4f8d-9f64-a564bedcbf91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:49.877374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09243d5-6df7-4f8d-9f64-a564bedcbf91 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:49.911421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1106/2229] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:39:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:39:54.133435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08b441-84be-4c03-a91b-303589642ff6 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:54.135224 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08b441-84be-4c03-a91b-303589642ff6 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:54.135513 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08b441-84be-4c03-a91b-303589642ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:54.156982 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-be08b441-84be-4c03-a91b-303589642ff6 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:39:54.158528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-be08b441-84be-4c03-a91b-303589642ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:39:54.168079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1124/2230] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Sep 13 06:39:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:39:54.192869 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09243d5-6df7-4f8d-9f64-a564bedcbf91 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:39:54.205346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09243d5-6df7-4f8d-9f64-a564bedcbf91 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:39:54.216448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5726153-0f63-438a-ad23-bcfffdd916cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:39:54.220678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5726153-0f63-438a-ad23-bcfffdd916cf service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:39:54.222461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5726153-0f63-438a-ad23-bcfffdd916cf service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:39:54.222945 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5726153-0f63-438a-ad23-bcfffdd916cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:39:54.239771 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5726153-0f63-438a-ad23-bcfffdd916cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:39:54.241699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5726153-0f63-438a-ad23-bcfffdd916cf service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:39:54.263203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1107/2231] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:39:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:40:00.303196 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fbb5b-3b3a-4b84-ac31-32383d6db355 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:00.303878 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fbb5b-3b3a-4b84-ac31-32383d6db355 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:00.303878 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56fbb5b-3b3a-4b84-ac31-32383d6db355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:00.328084 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-c56fbb5b-3b3a-4b84-ac31-32383d6db355 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:00.329424 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c56fbb5b-3b3a-4b84-ac31-32383d6db355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:00.347141 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1125/2232] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Sep 13 06:40:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:40:00.387890 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5726153-0f63-438a-ad23-bcfffdd916cf service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:00.402086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5726153-0f63-438a-ad23-bcfffdd916cf service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:00.411100 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3b6b5-869d-4644-be46-ea2224be00d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:00.412383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3b6b5-869d-4644-be46-ea2224be00d2 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:00.412886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3b6b5-869d-4644-be46-ea2224be00d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:00.413390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3b6b5-869d-4644-be46-ea2224be00d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:00.428175 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3b6b5-869d-4644-be46-ea2224be00d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:00.441197 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e3b6b5-869d-4644-be46-ea2224be00d2 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:00.454070 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1108/2233] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:40:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:40:02.785248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6daab-83b3-4b01-a978-0691d9bf4602 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:02.785731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6daab-83b3-4b01-a978-0691d9bf4602 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:02.785828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d6daab-83b3-4b01-a978-0691d9bf4602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:02.794084 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:02.806635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-22d6daab-83b3-4b01-a978-0691d9bf4602 None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:02.807917 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-22d6daab-83b3-4b01-a978-0691d9bf4602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:02.815224 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1126/2234] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 13 06:40:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:02.827803 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3b6b5-869d-4644-be46-ea2224be00d2 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:02.839357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3b6b5-869d-4644-be46-ea2224be00d2 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:02.844558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600afb0-e7d4-4242-901d-e9b7c44f8dc3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:02.845170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600afb0-e7d4-4242-901d-e9b7c44f8dc3 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:02.845448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600afb0-e7d4-4242-901d-e9b7c44f8dc3 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:02.845716 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6600afb0-e7d4-4242-901d-e9b7c44f8dc3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:02.853923 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600afb0-e7d4-4242-901d-e9b7c44f8dc3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:02.855477 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6600afb0-e7d4-4242-901d-e9b7c44f8dc3 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:02.863298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1109/2235] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:40:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 06:40:03.379911 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff569d4-0a8a-4005-8e1a-f5bd413b2cfa None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:03.380192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff569d4-0a8a-4005-8e1a-f5bd413b2cfa None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:03.380460 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff569d4-0a8a-4005-8e1a-f5bd413b2cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:03.399656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8ff569d4-0a8a-4005-8e1a-f5bd413b2cfa None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:03.400971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8ff569d4-0a8a-4005-8e1a-f5bd413b2cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:03.409544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1127/2236] 10.222.0.42 () {58 vars in 967 bytes} [Tue Sep 13 06:40:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:03.422400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600afb0-e7d4-4242-901d-e9b7c44f8dc3 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:03.433369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6600afb0-e7d4-4242-901d-e9b7c44f8dc3 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:03.438362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c032081-4f79-4659-94e7-88a1e80415b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:03.438951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c032081-4f79-4659-94e7-88a1e80415b1 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:03.439234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c032081-4f79-4659-94e7-88a1e80415b1 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:03.439510 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c032081-4f79-4659-94e7-88a1e80415b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:03.448924 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c032081-4f79-4659-94e7-88a1e80415b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:03.450717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c032081-4f79-4659-94e7-88a1e80415b1 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:03.459490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1110/2237] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:40:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 06:40:03.695000 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458515bb-e5c3-4b51-9d0e-c16dda338f02 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:03.695361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458515bb-e5c3-4b51-9d0e-c16dda338f02 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:03.696242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458515bb-e5c3-4b51-9d0e-c16dda338f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:03.715778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-458515bb-e5c3-4b51-9d0e-c16dda338f02 None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:03.717117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-458515bb-e5c3-4b51-9d0e-c16dda338f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:03.724340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1128/2238] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 13 06:40:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:03.736735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c032081-4f79-4659-94e7-88a1e80415b1 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:03.748008 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c032081-4f79-4659-94e7-88a1e80415b1 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:03.753023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9552d0a-4e1c-4230-ad21-bb4b4e80ebd1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:03.753608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9552d0a-4e1c-4230-ad21-bb4b4e80ebd1 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:03.753908 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9552d0a-4e1c-4230-ad21-bb4b4e80ebd1 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:03.754181 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9552d0a-4e1c-4230-ad21-bb4b4e80ebd1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:03.762681 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9552d0a-4e1c-4230-ad21-bb4b4e80ebd1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:03.764377 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9552d0a-4e1c-4230-ad21-bb4b4e80ebd1 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:03.772112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1111/2239] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:40:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 06:40:04.087187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03395bc-cc90-46db-88b8-fe0054f551e3 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:04.087664 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03395bc-cc90-46db-88b8-fe0054f551e3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:04.087900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03395bc-cc90-46db-88b8-fe0054f551e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:04.107589 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-c03395bc-cc90-46db-88b8-fe0054f551e3 None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:04.109000 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c03395bc-cc90-46db-88b8-fe0054f551e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:04.116549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1129/2240] 10.222.0.42 () {58 vars in 967 bytes} [Tue Sep 13 06:40:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:04.130214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9552d0a-4e1c-4230-ad21-bb4b4e80ebd1 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:04.141369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9552d0a-4e1c-4230-ad21-bb4b4e80ebd1 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:04.146412 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545125ec-6136-4fc7-9a4e-ae6cbcd23db4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:04.147133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545125ec-6136-4fc7-9a4e-ae6cbcd23db4 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:04.147424 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545125ec-6136-4fc7-9a4e-ae6cbcd23db4 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:04.147704 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545125ec-6136-4fc7-9a4e-ae6cbcd23db4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:04.156192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545125ec-6136-4fc7-9a4e-ae6cbcd23db4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:04.157794 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545125ec-6136-4fc7-9a4e-ae6cbcd23db4 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:04.166435 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1112/2241] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:40:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 06:40:05.534183 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be200c-e1b7-4300-811b-cab638395076 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:05.534626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be200c-e1b7-4300-811b-cab638395076 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:05.534626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be200c-e1b7-4300-811b-cab638395076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:05.557503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a5be200c-e1b7-4300-811b-cab638395076 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:05.558717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a5be200c-e1b7-4300-811b-cab638395076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:05.568930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1130/2242] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Sep 13 06:40:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:05.587955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545125ec-6136-4fc7-9a4e-ae6cbcd23db4 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:05.595202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb7ed0-fc03-426d-9906-f355efd6adc4 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:05.595482 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb7ed0-fc03-426d-9906-f355efd6adc4 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:05.595752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb7ed0-fc03-426d-9906-f355efd6adc4 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:05.597315 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1131/2243] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 13 06:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:40:05.603729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545125ec-6136-4fc7-9a4e-ae6cbcd23db4 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:05.604442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985c2d8-d57f-486d-ad3c-897cc46da245 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:05.604762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985c2d8-d57f-486d-ad3c-897cc46da245 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:05.605216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985c2d8-d57f-486d-ad3c-897cc46da245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:05.609197 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f79d84-bba1-4081-8805-8553842d5de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:05.609797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f79d84-bba1-4081-8805-8553842d5de4 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:05.610077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f79d84-bba1-4081-8805-8553842d5de4 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:05.610351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f79d84-bba1-4081-8805-8553842d5de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:05.622165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f79d84-bba1-4081-8805-8553842d5de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:05.627078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-5985c2d8-d57f-486d-ad3c-897cc46da245 None None] MFA Rules not processed for user `7fbb67072ba544e39073787eb25fcf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:05.628322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5985c2d8-d57f-486d-ad3c-897cc46da245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:05.630085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f79d84-bba1-4081-8805-8553842d5de4 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:05.639173 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1132/2244] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 13 06:40:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:40:05.652068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1113/2245] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:40:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:40:05.660012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985c2d8-d57f-486d-ad3c-897cc46da245 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:05.663125 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5985c2d8-d57f-486d-ad3c-897cc46da245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:05.726369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985c2d8-d57f-486d-ad3c-897cc46da245 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:05.730088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef51fed-a272-48b5-80fc-5603f35e7de1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc0c92f881e40c9abe067d3a6d4251b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:05.730704 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef51fed-a272-48b5-80fc-5603f35e7de1 service glance] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:05.730985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef51fed-a272-48b5-80fc-5603f35e7de1 service glance] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:05.731255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef51fed-a272-48b5-80fc-5603f35e7de1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:05.741566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef51fed-a272-48b5-80fc-5603f35e7de1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:05.743030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef51fed-a272-48b5-80fc-5603f35e7de1 service glance] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:05.754122 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1133/2246] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:40:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:40:05.835470 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ffc83-38b6-4b96-80f8-c3a87ef3a26f None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:05.835677 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ffc83-38b6-4b96-80f8-c3a87ef3a26f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:05.835937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63ffc83-38b6-4b96-80f8-c3a87ef3a26f None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:05.837868 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1114/2247] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 13 06:40:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:40:05.842610 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bdcf2-8d19-4ac0-82c3-afe16f40b6d6 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:05.842903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bdcf2-8d19-4ac0-82c3-afe16f40b6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:05.843181 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46bdcf2-8d19-4ac0-82c3-afe16f40b6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:05.862906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a46bdcf2-8d19-4ac0-82c3-afe16f40b6d6 None None] MFA Rules not processed for user `a5efc921a219444bb0b45e8b4d08dcc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:05.864123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a46bdcf2-8d19-4ac0-82c3-afe16f40b6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:05.918870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1134/2248] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 13 06:40:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:05.930381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ffc83-38b6-4b96-80f8-c3a87ef3a26f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:05.932045 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b63ffc83-38b6-4b96-80f8-c3a87ef3a26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:05.939433 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:05.946312 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63ffc83-38b6-4b96-80f8-c3a87ef3a26f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:05.949832 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c610b-f24a-4d10-8ee2-df20f0a712aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:05.950446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c610b-f24a-4d10-8ee2-df20f0a712aa service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:05.950725 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c610b-f24a-4d10-8ee2-df20f0a712aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:05.950996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c610b-f24a-4d10-8ee2-df20f0a712aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:05.957787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c610b-f24a-4d10-8ee2-df20f0a712aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:05.959182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c610b-f24a-4d10-8ee2-df20f0a712aa service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:05.967252 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1115/2249] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:40:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:40:06.051980 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e675e6-65a6-44b6-9544-09703b9bc9bc None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:06.052276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e675e6-65a6-44b6-9544-09703b9bc9bc None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:06.052550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e675e6-65a6-44b6-9544-09703b9bc9bc None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:06.053928 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1135/2250] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 13 06:40:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:40:06.059551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebcf6a-5766-499d-86ae-f440c0738732 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:06.059841 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebcf6a-5766-499d-86ae-f440c0738732 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:06.060116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ebcf6a-5766-499d-86ae-f440c0738732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:06.080133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-88ebcf6a-5766-499d-86ae-f440c0738732 None None] MFA Rules not processed for user `7fbb67072ba544e39073787eb25fcf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:06.081346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-88ebcf6a-5766-499d-86ae-f440c0738732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:06.091270 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1116/2251] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 13 06:40:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:06.101425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e675e6-65a6-44b6-9544-09703b9bc9bc None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:06.112849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e675e6-65a6-44b6-9544-09703b9bc9bc None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:06.116449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c3b79-7644-449d-bd44-825850c0184a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:06.117087 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c3b79-7644-449d-bd44-825850c0184a service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:06.117369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c3b79-7644-449d-bd44-825850c0184a service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:06.117643 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c3b79-7644-449d-bd44-825850c0184a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:06.127952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c3b79-7644-449d-bd44-825850c0184a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:06.129412 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c3b79-7644-449d-bd44-825850c0184a service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:06.139834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1136/2252] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:40:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:40:06.324939 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebcf6a-5766-499d-86ae-f440c0738732 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:06.335521 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ebcf6a-5766-499d-86ae-f440c0738732 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:06.340578 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd4205-1c7c-46f4-8d76-49e33fef479f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:06.341229 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd4205-1c7c-46f4-8d76-49e33fef479f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:06.341560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd4205-1c7c-46f4-8d76-49e33fef479f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:06.341805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd4205-1c7c-46f4-8d76-49e33fef479f admin admin] PATH_INFO: `/v3/users/5b17394203004ff59a2046bfe2c4bcec` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:06.342933 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd4205-1c7c-46f4-8d76-49e33fef479f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b17394203004ff59a2046bfe2c4bcec)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:06.345140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fd4205-1c7c-46f4-8d76-49e33fef479f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:06.407630 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-88fd4205-1c7c-46f4-8d76-49e33fef479f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b17394203004ff59a2046bfe2c4bcec'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:40:06.423720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-88fd4205-1c7c-46f4-8d76-49e33fef479f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b17394203004ff59a2046bfe2c4bcec'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:40:06.437999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-88fd4205-1c7c-46f4-8d76-49e33fef479f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b17394203004ff59a2046bfe2c4bcec'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:40:06.447425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-88fd4205-1c7c-46f4-8d76-49e33fef479f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b17394203004ff59a2046bfe2c4bcec'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:40:06.448313 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-88fd4205-1c7c-46f4-8d76-49e33fef479f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b17394203004ff59a2046bfe2c4bcec'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:40:06.454810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1117/2253] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:40:06 2022] DELETE /identity/v3/users/5b17394203004ff59a2046bfe2c4bcec => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:40:06.459479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3db5e-c3c8-477d-81f6-e8cf75af237e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:06.459769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3db5e-c3c8-477d-81f6-e8cf75af237e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:06.460046 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3db5e-c3c8-477d-81f6-e8cf75af237e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:06.481249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-96d3db5e-c3c8-477d-81f6-e8cf75af237e None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:06.482464 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-96d3db5e-c3c8-477d-81f6-e8cf75af237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:06.549899 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1137/2254] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:40:06.559586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd4205-1c7c-46f4-8d76-49e33fef479f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:06.561071 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-88fd4205-1c7c-46f4-8d76-49e33fef479f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:06.621173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fd4205-1c7c-46f4-8d76-49e33fef479f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:06.625098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b5762f-73fd-4573-b806-e7d2e8654f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:06.625713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5762f-73fd-4573-b806-e7d2e8654f81 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:06.625998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5762f-73fd-4573-b806-e7d2e8654f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:06.626281 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b5762f-73fd-4573-b806-e7d2e8654f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:06.636237 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5762f-73fd-4573-b806-e7d2e8654f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:06.637755 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b5762f-73fd-4573-b806-e7d2e8654f81 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:06.650248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1118/2255] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:40:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:40:06.863617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3db5e-c3c8-477d-81f6-e8cf75af237e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:06.865190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-96d3db5e-c3c8-477d-81f6-e8cf75af237e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:06.874689 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:06.879307 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3db5e-c3c8-477d-81f6-e8cf75af237e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:06.885984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe210fc-66a7-4308-8dea-9230632f3a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:06.886821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe210fc-66a7-4308-8dea-9230632f3a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:06.887102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe210fc-66a7-4308-8dea-9230632f3a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:06.887571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe210fc-66a7-4308-8dea-9230632f3a3e admin admin] PATH_INFO: `/v3/projects/c897cb69620144679ba70f884cf4c1da` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:06.888968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe210fc-66a7-4308-8dea-9230632f3a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c897cb69620144679ba70f884cf4c1da)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:06.890900 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe210fc-66a7-4308-8dea-9230632f3a3e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:06.944317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8fe210fc-66a7-4308-8dea-9230632f3a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c897cb69620144679ba70f884cf4c1da', 'request_id': 'req-8fe210fc-66a7-4308-8dea-9230632f3a3e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:40:06.952222 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8fe210fc-66a7-4308-8dea-9230632f3a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c897cb69620144679ba70f884cf4c1da', 'request_id': 'req-8fe210fc-66a7-4308-8dea-9230632f3a3e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:40:06.958274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8fe210fc-66a7-4308-8dea-9230632f3a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c897cb69620144679ba70f884cf4c1da', 'request_id': 'req-8fe210fc-66a7-4308-8dea-9230632f3a3e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:40:06.970163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8fe210fc-66a7-4308-8dea-9230632f3a3e admin admin] The token cache is being invalidate because project c897cb69620144679ba70f884cf4c1da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:40:06.970459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8fe210fc-66a7-4308-8dea-9230632f3a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:40:06.971152 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8fe210fc-66a7-4308-8dea-9230632f3a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:40:06.972847 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1138/2256] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:40:06 2022] DELETE /identity/v3/projects/c897cb69620144679ba70f884cf4c1da => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:40:06.978236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621124b3-bfbe-447d-b7a1-97feeb8bb49c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:06.978604 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621124b3-bfbe-447d-b7a1-97feeb8bb49c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:06.978956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621124b3-bfbe-447d-b7a1-97feeb8bb49c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:07.000330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-621124b3-bfbe-447d-b7a1-97feeb8bb49c None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:07.001698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-621124b3-bfbe-447d-b7a1-97feeb8bb49c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:07.062365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:07.066086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1119/2257] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:40:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:07.075088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9423d-ea73-4a22-a540-f8cfb3eda9db None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:07.075456 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9423d-ea73-4a22-a540-f8cfb3eda9db None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:07.075806 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb9423d-ea73-4a22-a540-f8cfb3eda9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:07.097132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-aeb9423d-ea73-4a22-a540-f8cfb3eda9db None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:07.098435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-aeb9423d-ea73-4a22-a540-f8cfb3eda9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:07.107476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1139/2258] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:40:07.111793 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621124b3-bfbe-447d-b7a1-97feeb8bb49c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:07.122877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621124b3-bfbe-447d-b7a1-97feeb8bb49c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:07.127638 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868320b-e026-42d5-9fe2-eb4fff582150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:07.128321 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868320b-e026-42d5-9fe2-eb4fff582150 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:07.128749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868320b-e026-42d5-9fe2-eb4fff582150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:07.129249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868320b-e026-42d5-9fe2-eb4fff582150 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:07.130513 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868320b-e026-42d5-9fe2-eb4fff582150 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:40:07.131168 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868320b-e026-42d5-9fe2-eb4fff582150 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:07.133667 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868320b-e026-42d5-9fe2-eb4fff582150 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:07.151791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1120/2259] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:40:07.156906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9423d-ea73-4a22-a540-f8cfb3eda9db None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:07.186770 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb9423d-ea73-4a22-a540-f8cfb3eda9db None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:07.193845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b605866-fddd-400d-ab01-48e86d862e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:07.194453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b605866-fddd-400d-ab01-48e86d862e69 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:07.194731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b605866-fddd-400d-ab01-48e86d862e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:07.197784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b605866-fddd-400d-ab01-48e86d862e69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:07.198542 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b605866-fddd-400d-ab01-48e86d862e69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:07.200522 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b605866-fddd-400d-ab01-48e86d862e69 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:07.229586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1140/2260] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:40:07 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:40:07.233777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868320b-e026-42d5-9fe2-eb4fff582150 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:07.255862 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868320b-e026-42d5-9fe2-eb4fff582150 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:07.321385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd2f43-fceb-45fc-b55b-5a7dbafa6ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:07.322008 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd2f43-fceb-45fc-b55b-5a7dbafa6ae6 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:07.322292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd2f43-fceb-45fc-b55b-5a7dbafa6ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:07.322566 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd2f43-fceb-45fc-b55b-5a7dbafa6ae6 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:07.323225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd2f43-fceb-45fc-b55b-5a7dbafa6ae6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:07.325215 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd2f43-fceb-45fc-b55b-5a7dbafa6ae6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:07.349457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1121/2261] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:40:07 2022] POST /identity/v3/users => generated 287 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:40:07.350635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b605866-fddd-400d-ab01-48e86d862e69 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:07.361691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b605866-fddd-400d-ab01-48e86d862e69 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:07.366295 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573911c-2728-4a8b-9eda-041300f6b503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:07.366892 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573911c-2728-4a8b-9eda-041300f6b503 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:07.367181 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573911c-2728-4a8b-9eda-041300f6b503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:07.368017 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573911c-2728-4a8b-9eda-041300f6b503 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:07.368958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573911c-2728-4a8b-9eda-041300f6b503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:07.370550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573911c-2728-4a8b-9eda-041300f6b503 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:07.381127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1141/2262] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:40:07.385475 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd2f43-fceb-45fc-b55b-5a7dbafa6ae6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:07.395396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd2f43-fceb-45fc-b55b-5a7dbafa6ae6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:07.400087 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48ec065-058d-4aa6-8919-3eee99c36269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:07.400720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ec065-058d-4aa6-8919-3eee99c36269 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:07.400994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ec065-058d-4aa6-8919-3eee99c36269 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:07.401274 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48ec065-058d-4aa6-8919-3eee99c36269 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:07.401920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ec065-058d-4aa6-8919-3eee99c36269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:07.403625 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48ec065-058d-4aa6-8919-3eee99c36269 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:07.415352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1122/2263] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:40:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:40:07.419898 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573911c-2728-4a8b-9eda-041300f6b503 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:07.430716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573911c-2728-4a8b-9eda-041300f6b503 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:07.435426 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d79fa-cd4b-42c3-b025-4490a46fc11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:07.436080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d79fa-cd4b-42c3-b025-4490a46fc11c admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:07.436361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d79fa-cd4b-42c3-b025-4490a46fc11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:07.436636 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6d79fa-cd4b-42c3-b025-4490a46fc11c admin admin] PATH_INFO: `/v3/projects/3cc6990b08964020b981f20a452e220b/users/2786a5ef016e45fb940e568a0305cd24/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:07.451175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d79fa-cd4b-42c3-b025-4490a46fc11c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cc6990b08964020b981f20a452e220b, user_id=2786a5ef016e45fb940e568a0305cd24, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:07.453868 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6d79fa-cd4b-42c3-b025-4490a46fc11c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:07.467366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1142/2264] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:40:07 2022] PUT /identity/v3/projects/3cc6990b08964020b981f20a452e220b/users/2786a5ef016e45fb940e568a0305cd24/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:40:07.472086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828e3e8-e010-4ca8-9331-bc12d683b242 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:07.472378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828e3e8-e010-4ca8-9331-bc12d683b242 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:07.472651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828e3e8-e010-4ca8-9331-bc12d683b242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:07.494492 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b828e3e8-e010-4ca8-9331-bc12d683b242 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:07.495695 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b828e3e8-e010-4ca8-9331-bc12d683b242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:07.561183 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1123/2265] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:40:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:07.568283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d79fa-cd4b-42c3-b025-4490a46fc11c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:07.570137 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fa6d79fa-cd4b-42c3-b025-4490a46fc11c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:07.655398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6d79fa-cd4b-42c3-b025-4490a46fc11c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:07.660011 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da9fe-cd32-4c90-ab4b-35528b8ed105 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:07.660636 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da9fe-cd32-4c90-ab4b-35528b8ed105 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:07.661730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da9fe-cd32-4c90-ab4b-35528b8ed105 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:07.662018 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98da9fe-cd32-4c90-ab4b-35528b8ed105 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:07.673108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98da9fe-cd32-4c90-ab4b-35528b8ed105 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:07.674727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98da9fe-cd32-4c90-ab4b-35528b8ed105 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:07.684603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1143/2266] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:40:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:40:09.774834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cc97f-a3b9-4d57-8a8f-8fc4e62a4b3a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:09.775340 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cc97f-a3b9-4d57-8a8f-8fc4e62a4b3a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:09.775423 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541cc97f-a3b9-4d57-8a8f-8fc4e62a4b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:09.814942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-541cc97f-a3b9-4d57-8a8f-8fc4e62a4b3a None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:09.817487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-541cc97f-a3b9-4d57-8a8f-8fc4e62a4b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:09.835186 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1124/2267] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Sep 13 06:40:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:09.866730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da9fe-cd32-4c90-ab4b-35528b8ed105 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:09.868292 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f98da9fe-cd32-4c90-ab4b-35528b8ed105 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:09.934241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:09.998759 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98da9fe-cd32-4c90-ab4b-35528b8ed105 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:10.005384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc8b70-d077-423a-a6e8-363a54b356aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:10.006165 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc8b70-d077-423a-a6e8-363a54b356aa service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:10.006554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc8b70-d077-423a-a6e8-363a54b356aa service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:10.006934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc8b70-d077-423a-a6e8-363a54b356aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:10.017425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc8b70-d077-423a-a6e8-363a54b356aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:10.019796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc8b70-d077-423a-a6e8-363a54b356aa service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:10.031931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1144/2268] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:40:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:40:12.499951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e4b5a-1cc8-4720-8a79-7418f1962911 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:12.500450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e4b5a-1cc8-4720-8a79-7418f1962911 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:12.502420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e4b5a-1cc8-4720-8a79-7418f1962911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:12.546623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d33e4b5a-1cc8-4720-8a79-7418f1962911 None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:12.549868 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d33e4b5a-1cc8-4720-8a79-7418f1962911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:12.602390 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf04021-e30e-4ab5-a060-204cdd09f9be None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:12.602894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf04021-e30e-4ab5-a060-204cdd09f9be None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:12.602995 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf04021-e30e-4ab5-a060-204cdd09f9be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:12.634169 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1125/2269] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 13 06:40:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:12.645479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-dbf04021-e30e-4ab5-a060-204cdd09f9be None None] MFA Rules not processed for user `2786a5ef016e45fb940e568a0305cd24`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:12.646725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-dbf04021-e30e-4ab5-a060-204cdd09f9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:12.647597 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e4b5a-1cc8-4720-8a79-7418f1962911 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:12.649086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d33e4b5a-1cc8-4720-8a79-7418f1962911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:12.655205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:12.724588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1145/2270] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:40:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:40:12.729350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf04021-e30e-4ab5-a060-204cdd09f9be None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:12.739068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e4b5a-1cc8-4720-8a79-7418f1962911 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:12.740403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf04021-e30e-4ab5-a060-204cdd09f9be None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:12.745102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e7d9c-1fcf-483c-a5fe-9ae8e6c56d8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:12.745722 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e7d9c-1fcf-483c-a5fe-9ae8e6c56d8d service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:12.745996 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa702dc9-f219-4b91-8400-727227e76a22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:12.746124 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e7d9c-1fcf-483c-a5fe-9ae8e6c56d8d service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:12.746265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843e7d9c-1fcf-483c-a5fe-9ae8e6c56d8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:12.746681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa702dc9-f219-4b91-8400-727227e76a22 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:12.746963 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa702dc9-f219-4b91-8400-727227e76a22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:12.747528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa702dc9-f219-4b91-8400-727227e76a22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:12.748330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa702dc9-f219-4b91-8400-727227e76a22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:12.750371 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa702dc9-f219-4b91-8400-727227e76a22 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:12.756563 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e7d9c-1fcf-483c-a5fe-9ae8e6c56d8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:12.758487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843e7d9c-1fcf-483c-a5fe-9ae8e6c56d8d service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:12.769280 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1126/2271] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:40:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 06:40:12.785449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1146/2272] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:40:12 2022] POST /identity/v3/projects => generated 371 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:40:12.787789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e7d9c-1fcf-483c-a5fe-9ae8e6c56d8d service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:12.799627 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843e7d9c-1fcf-483c-a5fe-9ae8e6c56d8d service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:12.905133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c9f83-a4ef-42a5-9072-4b16657a005d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:12.905761 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c9f83-a4ef-42a5-9072-4b16657a005d admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:12.906053 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c9f83-a4ef-42a5-9072-4b16657a005d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:12.906544 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c9f83-a4ef-42a5-9072-4b16657a005d admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:12.907205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c9f83-a4ef-42a5-9072-4b16657a005d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:12.909518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c9f83-a4ef-42a5-9072-4b16657a005d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:12.948588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1127/2273] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:40:12 2022] POST /identity/v3/users => generated 292 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:40:12.949631 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa702dc9-f219-4b91-8400-727227e76a22 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:12.961515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa702dc9-f219-4b91-8400-727227e76a22 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:12.986684 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed33530-6085-482b-b8e8-e143486a204a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:12.987374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed33530-6085-482b-b8e8-e143486a204a admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:12.987664 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed33530-6085-482b-b8e8-e143486a204a admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:12.988067 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed33530-6085-482b-b8e8-e143486a204a admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:12.988633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed33530-6085-482b-b8e8-e143486a204a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:12.990480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed33530-6085-482b-b8e8-e143486a204a admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:13.010698 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1147/2274] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:40:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:40:13.012443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c9f83-a4ef-42a5-9072-4b16657a005d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:13.031448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c9f83-a4ef-42a5-9072-4b16657a005d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:13.039828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef4331-82fe-44b0-8398-fd83baf6c2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:13.040430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4331-82fe-44b0-8398-fd83baf6c2c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:13.040735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4331-82fe-44b0-8398-fd83baf6c2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:13.041052 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ef4331-82fe-44b0-8398-fd83baf6c2c0 admin admin] PATH_INFO: `/v3/projects/f555288934ce42868dfe74e33975b16d/users/8bc5c58a1b7a4f18affba43b2d65eaf5/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:13.075077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef4331-82fe-44b0-8398-fd83baf6c2c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f555288934ce42868dfe74e33975b16d, user_id=8bc5c58a1b7a4f18affba43b2d65eaf5, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:13.078046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ef4331-82fe-44b0-8398-fd83baf6c2c0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:13.109587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1128/2275] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:40:13 2022] PUT /identity/v3/projects/f555288934ce42868dfe74e33975b16d/users/8bc5c58a1b7a4f18affba43b2d65eaf5/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:40:13.110785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed33530-6085-482b-b8e8-e143486a204a admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:13.132787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed33530-6085-482b-b8e8-e143486a204a admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:13.303849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86c8c4-1c2c-40d9-8486-8ae8160785e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:13.305325 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86c8c4-1c2c-40d9-8486-8ae8160785e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:13.305815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86c8c4-1c2c-40d9-8486-8ae8160785e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:13.308868 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86c8c4-1c2c-40d9-8486-8ae8160785e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:13.309685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86c8c4-1c2c-40d9-8486-8ae8160785e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:13.311827 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce86c8c4-1c2c-40d9-8486-8ae8160785e6 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:13.337743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1148/2276] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:40:13 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:40:13.342188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef4331-82fe-44b0-8398-fd83baf6c2c0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:13.360929 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ef4331-82fe-44b0-8398-fd83baf6c2c0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:13.383543 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb00f-3e43-440e-9b79-e074d48e4d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:13.384237 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb00f-3e43-440e-9b79-e074d48e4d91 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:13.384513 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb00f-3e43-440e-9b79-e074d48e4d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:13.384814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcb00f-3e43-440e-9b79-e074d48e4d91 admin admin] PATH_INFO: `/v3/projects/f555288934ce42868dfe74e33975b16d/users/8bc5c58a1b7a4f18affba43b2d65eaf5/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:13.397261 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcb00f-3e43-440e-9b79-e074d48e4d91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f555288934ce42868dfe74e33975b16d, user_id=8bc5c58a1b7a4f18affba43b2d65eaf5, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:13.399974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcb00f-3e43-440e-9b79-e074d48e4d91 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:13.460769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1129/2277] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:40:13 2022] PUT /identity/v3/projects/f555288934ce42868dfe74e33975b16d/users/8bc5c58a1b7a4f18affba43b2d65eaf5/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:40:20.190184 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd3782-f845-42f2-ab51-fffc1d39eff9 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:20.190814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd3782-f845-42f2-ab51-fffc1d39eff9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:20.190814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fd3782-f845-42f2-ab51-fffc1d39eff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:20.207460 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:20.244554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f8fd3782-f845-42f2-ab51-fffc1d39eff9 None None] MFA Rules not processed for user `8bc5c58a1b7a4f18affba43b2d65eaf5`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:20.246102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f8fd3782-f845-42f2-ab51-fffc1d39eff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:20.366570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1149/2278] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:40:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:20.380647 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb00f-3e43-440e-9b79-e074d48e4d91 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:20.382487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b0fcb00f-3e43-440e-9b79-e074d48e4d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:20.441389 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:20.471976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcb00f-3e43-440e-9b79-e074d48e4d91 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:20.478095 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29edf1aa-bdca-4777-aaf3-d731d0ac6742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:20.478715 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edf1aa-bdca-4777-aaf3-d731d0ac6742 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:20.478990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edf1aa-bdca-4777-aaf3-d731d0ac6742 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:20.479259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29edf1aa-bdca-4777-aaf3-d731d0ac6742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:20.541978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edf1aa-bdca-4777-aaf3-d731d0ac6742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:20.543583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29edf1aa-bdca-4777-aaf3-d731d0ac6742 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:20.552924 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1130/2279] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:40:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:40:22.077901 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b51be1-d80c-449e-882e-307d09fdaf11 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:22.078503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b51be1-d80c-449e-882e-307d09fdaf11 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:22.078503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b51be1-d80c-449e-882e-307d09fdaf11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:22.101065 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-95b51be1-d80c-449e-882e-307d09fdaf11 None None] MFA Rules not processed for user `2786a5ef016e45fb940e568a0305cd24`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:22.102697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-95b51be1-d80c-449e-882e-307d09fdaf11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:22.115359 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1150/2280] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:40:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:30.548992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=36 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:32.095307 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=35 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:34.891771 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d5775-760d-4ff9-be25-5125a4815658 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:34.892274 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d5775-760d-4ff9-be25-5125a4815658 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:34.892390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574d5775-760d-4ff9-be25-5125a4815658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:34.914768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-574d5775-760d-4ff9-be25-5125a4815658 None None] MFA Rules not processed for user `8505dee31512437ba7b6de3512dcc76a`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:34.915979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-574d5775-760d-4ff9-be25-5125a4815658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:34.954801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f75df5-f235-458a-b72b-3939848f77d7 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:34.955742 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f75df5-f235-458a-b72b-3939848f77d7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:34.956242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f75df5-f235-458a-b72b-3939848f77d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:34.976476 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1131/2281] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:40:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:34.990816 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b8f75df5-f235-458a-b72b-3939848f77d7 None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:34.993028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b8f75df5-f235-458a-b72b-3939848f77d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:35.051045 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1151/2282] 10.222.0.42 () {58 vars in 967 bytes} [Tue Sep 13 06:40:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:35.063769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d5775-760d-4ff9-be25-5125a4815658 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:35.131312 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574d5775-760d-4ff9-be25-5125a4815658 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:35.137091 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e1c98c-300d-4644-8761-24a331a0e967 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:35.137884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1c98c-300d-4644-8761-24a331a0e967 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:35.138164 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1c98c-300d-4644-8761-24a331a0e967 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:35.138440 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e1c98c-300d-4644-8761-24a331a0e967 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:35.146668 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1c98c-300d-4644-8761-24a331a0e967 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:35.148327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e1c98c-300d-4644-8761-24a331a0e967 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:35.156504 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1132/2283] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:40:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 06:40:36.174609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f75df5-f235-458a-b72b-3939848f77d7 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:36.176074 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b8f75df5-f235-458a-b72b-3939848f77d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:36.247539 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f75df5-f235-458a-b72b-3939848f77d7 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:36.252832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91db0a-b818-419d-b003-dea77a3caa09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84a23931b60457e865f056352a396d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:36.253439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91db0a-b818-419d-b003-dea77a3caa09 service placement] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:36.253723 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91db0a-b818-419d-b003-dea77a3caa09 service placement] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:36.253993 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c91db0a-b818-419d-b003-dea77a3caa09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:36.255872 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9c91db0a-b818-419d-b003-dea77a3caa09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:36.267565 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91db0a-b818-419d-b003-dea77a3caa09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:36.269197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c91db0a-b818-419d-b003-dea77a3caa09 service placement] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:36.278886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1152/2284] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:40:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:40:39.475305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5eedf-849b-4967-b481-68912fda1ed1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:39.476500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5eedf-849b-4967-b481-68912fda1ed1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:39.476500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb5eedf-849b-4967-b481-68912fda1ed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:39.498012 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5bb5eedf-849b-4967-b481-68912fda1ed1 None None] MFA Rules not processed for user `3dbc133fc3244186bbadc30cad04173e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:39.499237 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5bb5eedf-849b-4967-b481-68912fda1ed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:39.563809 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1133/2285] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:40:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:40:46.274708 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=57 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:49.556729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=82 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:40:52.022114 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91db0a-b818-419d-b003-dea77a3caa09 service placement] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:52.023545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9c91db0a-b818-419d-b003-dea77a3caa09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:52.078626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c91db0a-b818-419d-b003-dea77a3caa09 service placement] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:52.082142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c746bf2-f026-434e-848a-e69b80fbe764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:52.082730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c746bf2-f026-434e-848a-e69b80fbe764 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:52.083108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c746bf2-f026-434e-848a-e69b80fbe764 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:52.083390 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c746bf2-f026-434e-848a-e69b80fbe764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:52.092162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c746bf2-f026-434e-848a-e69b80fbe764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:52.093604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c746bf2-f026-434e-848a-e69b80fbe764 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:52.102875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1153/2286] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:40:52 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:40:56.821225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800c07b-4d83-4fbf-8725-28f40e2663b8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:56.821811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800c07b-4d83-4fbf-8725-28f40e2663b8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:56.821811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1800c07b-4d83-4fbf-8725-28f40e2663b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:56.846540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1800c07b-4d83-4fbf-8725-28f40e2663b8 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:40:56.848650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1800c07b-4d83-4fbf-8725-28f40e2663b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:40:56.911337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1134/2287] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Sep 13 06:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:40:56.932497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c746bf2-f026-434e-848a-e69b80fbe764 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:40:56.949350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c746bf2-f026-434e-848a-e69b80fbe764 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:40:56.955727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009ab07-01cb-4a28-be81-1240380e999a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:40:56.956481 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009ab07-01cb-4a28-be81-1240380e999a service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:40:56.956890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009ab07-01cb-4a28-be81-1240380e999a service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:40:56.957239 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1009ab07-01cb-4a28-be81-1240380e999a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:40:56.966862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009ab07-01cb-4a28-be81-1240380e999a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:40:56.968610 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1009ab07-01cb-4a28-be81-1240380e999a service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:40:56.978888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1154/2288] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:41:01.131084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b0ab0-0258-46b2-b043-8f92a3fc7231 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:01.131574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b0ab0-0258-46b2-b043-8f92a3fc7231 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:01.131672 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3b0ab0-0258-46b2-b043-8f92a3fc7231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:01.151318 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-aa3b0ab0-0258-46b2-b043-8f92a3fc7231 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:41:01.152508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-aa3b0ab0-0258-46b2-b043-8f92a3fc7231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:41:01.160307 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1135/2289] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Sep 13 06:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:41:01.176033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009ab07-01cb-4a28-be81-1240380e999a service nova] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:01.187227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1009ab07-01cb-4a28-be81-1240380e999a service nova] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:01.192695 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f0123-e049-456f-acac-2576dd8ed75d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:01.193277 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f0123-e049-456f-acac-2576dd8ed75d service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:01.193551 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f0123-e049-456f-acac-2576dd8ed75d service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:01.193818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472f0123-e049-456f-acac-2576dd8ed75d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:01.202517 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f0123-e049-456f-acac-2576dd8ed75d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:01.204089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472f0123-e049-456f-acac-2576dd8ed75d service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:01.214327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1155/2290] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:41:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:41:04.187614 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d2477-fa46-4ae3-9165-c7f7d55a1151 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:04.188103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d2477-fa46-4ae3-9165-c7f7d55a1151 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:04.188103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d2477-fa46-4ae3-9165-c7f7d55a1151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:04.207359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-fa2d2477-fa46-4ae3-9165-c7f7d55a1151 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:41:04.208553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-fa2d2477-fa46-4ae3-9165-c7f7d55a1151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:41:04.219010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1136/2291] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Sep 13 06:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:41:04.234501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f0123-e049-456f-acac-2576dd8ed75d service nova] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:04.247453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472f0123-e049-456f-acac-2576dd8ed75d service nova] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:04.252967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3364fcc-9fa2-4aba-af3f-3cfc6a558d9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:04.253677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3364fcc-9fa2-4aba-af3f-3cfc6a558d9a service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:04.253960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3364fcc-9fa2-4aba-af3f-3cfc6a558d9a service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:04.254232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3364fcc-9fa2-4aba-af3f-3cfc6a558d9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:04.263147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3364fcc-9fa2-4aba-af3f-3cfc6a558d9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:04.264769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3364fcc-9fa2-4aba-af3f-3cfc6a558d9a service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:04.274029 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1156/2292] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:41:08.368626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d6a68-be5b-4174-b038-b984ebcb83c7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:08.369160 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d6a68-be5b-4174-b038-b984ebcb83c7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:08.369265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d6a68-be5b-4174-b038-b984ebcb83c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:08.389241 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c43d6a68-be5b-4174-b038-b984ebcb83c7 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:41:08.390441 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c43d6a68-be5b-4174-b038-b984ebcb83c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:41:08.399023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1137/2293] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Sep 13 06:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:41:08.431105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3364fcc-9fa2-4aba-af3f-3cfc6a558d9a service nova] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:08.442024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3364fcc-9fa2-4aba-af3f-3cfc6a558d9a service nova] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:08.447421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2fe73-7492-438a-9927-53716b8d4549 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:08.447996 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2fe73-7492-438a-9927-53716b8d4549 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:08.448271 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2fe73-7492-438a-9927-53716b8d4549 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:08.448539 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2fe73-7492-438a-9927-53716b8d4549 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:08.456511 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2fe73-7492-438a-9927-53716b8d4549 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:08.458110 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2fe73-7492-438a-9927-53716b8d4549 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:08.467909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1157/2294] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:41:12.577659 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1028c5-f248-4eff-a0d8-3d7e1a067d51 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:12.578194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1028c5-f248-4eff-a0d8-3d7e1a067d51 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:12.578298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1028c5-f248-4eff-a0d8-3d7e1a067d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:12.601443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1f1028c5-f248-4eff-a0d8-3d7e1a067d51 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:41:12.602632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1f1028c5-f248-4eff-a0d8-3d7e1a067d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:41:12.610437 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1138/2295] 10.222.0.44 () {58 vars in 1016 bytes} [Tue Sep 13 06:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:41:12.628590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2fe73-7492-438a-9927-53716b8d4549 service nova] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:12.640492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2fe73-7492-438a-9927-53716b8d4549 service nova] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:12.649406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312ff42c-cd6d-4d28-8257-439e1f4b8d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:12.650008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ff42c-cd6d-4d28-8257-439e1f4b8d56 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:12.650384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ff42c-cd6d-4d28-8257-439e1f4b8d56 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:12.650655 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312ff42c-cd6d-4d28-8257-439e1f4b8d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:12.659465 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ff42c-cd6d-4d28-8257-439e1f4b8d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:12.661221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312ff42c-cd6d-4d28-8257-439e1f4b8d56 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:12.671455 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1158/2296] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:41:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:41:22.596187 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=39 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:22.666740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=56 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:26.946502 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af1327-7bdd-4afd-a07a-de47f2e96c7b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:26.947074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af1327-7bdd-4afd-a07a-de47f2e96c7b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:26.947074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af1327-7bdd-4afd-a07a-de47f2e96c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:26.966880 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a9af1327-7bdd-4afd-a07a-de47f2e96c7b None None] MFA Rules not processed for user `4bad46590fab4c94a789626e42aca76d`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:41:26.968083 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a9af1327-7bdd-4afd-a07a-de47f2e96c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:41:27.034518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1139/2297] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:41:26 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:41:37.027152 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=25 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:37.126319 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4734ab-5144-4b8f-ad8e-cf6bfad92285 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:37.126729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4734ab-5144-4b8f-ad8e-cf6bfad92285 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:37.126863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4734ab-5144-4b8f-ad8e-cf6bfad92285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:37.145609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-fe4734ab-5144-4b8f-ad8e-cf6bfad92285 None None] MFA Rules not processed for user `cfdd9d86fbce4b0881a94ab730500ae6`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:41:37.147304 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fe4734ab-5144-4b8f-ad8e-cf6bfad92285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:41:37.203747 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1159/2298] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:41:37 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:41:44.536688 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af1327-7bdd-4afd-a07a-de47f2e96c7b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:44.538165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a9af1327-7bdd-4afd-a07a-de47f2e96c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:41:44.551788 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af1327-7bdd-4afd-a07a-de47f2e96c7b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:44.556903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0e47aa-d710-4563-83ff-38edc879d41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:44.557521 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e47aa-d710-4563-83ff-38edc879d41c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:44.557797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e47aa-d710-4563-83ff-38edc879d41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:44.558069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0e47aa-d710-4563-83ff-38edc879d41c admin admin] PATH_INFO: `/v3/users/3dbc133fc3244186bbadc30cad04173e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:44.559190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e47aa-d710-4563-83ff-38edc879d41c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dbc133fc3244186bbadc30cad04173e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:44.561113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0e47aa-d710-4563-83ff-38edc879d41c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:44.609974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7c0e47aa-d710-4563-83ff-38edc879d41c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dbc133fc3244186bbadc30cad04173e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:44.618022 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7c0e47aa-d710-4563-83ff-38edc879d41c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dbc133fc3244186bbadc30cad04173e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:44.634148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7c0e47aa-d710-4563-83ff-38edc879d41c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dbc133fc3244186bbadc30cad04173e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:44.642043 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7c0e47aa-d710-4563-83ff-38edc879d41c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dbc133fc3244186bbadc30cad04173e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:44.642773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-7c0e47aa-d710-4563-83ff-38edc879d41c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dbc133fc3244186bbadc30cad04173e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:44.649338 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1140/2299] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:41:44 2022] DELETE /identity/v3/users/3dbc133fc3244186bbadc30cad04173e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:41:44.851283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4734ab-5144-4b8f-ad8e-cf6bfad92285 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:44.862600 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4734ab-5144-4b8f-ad8e-cf6bfad92285 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:44.923844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188b7989-d859-4039-8b9f-1f30c29b3989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:44.924467 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b7989-d859-4039-8b9f-1f30c29b3989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:44.924786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b7989-d859-4039-8b9f-1f30c29b3989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:44.925077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188b7989-d859-4039-8b9f-1f30c29b3989 admin admin] PATH_INFO: `/v3/projects/eeda99c9af924b49875177994ad3a96c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:44.926219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b7989-d859-4039-8b9f-1f30c29b3989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeda99c9af924b49875177994ad3a96c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:44.928748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188b7989-d859-4039-8b9f-1f30c29b3989 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:44.972956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-188b7989-d859-4039-8b9f-1f30c29b3989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeda99c9af924b49875177994ad3a96c', 'request_id': 'req-188b7989-d859-4039-8b9f-1f30c29b3989'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:44.980735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-188b7989-d859-4039-8b9f-1f30c29b3989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeda99c9af924b49875177994ad3a96c', 'request_id': 'req-188b7989-d859-4039-8b9f-1f30c29b3989'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:44.986243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-188b7989-d859-4039-8b9f-1f30c29b3989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeda99c9af924b49875177994ad3a96c', 'request_id': 'req-188b7989-d859-4039-8b9f-1f30c29b3989'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:44.997850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-188b7989-d859-4039-8b9f-1f30c29b3989 admin admin] The token cache is being invalidate because project eeda99c9af924b49875177994ad3a96c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:41:44.998135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-188b7989-d859-4039-8b9f-1f30c29b3989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:44.998801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-188b7989-d859-4039-8b9f-1f30c29b3989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:45.000244 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1160/2300] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:41:44 2022] DELETE /identity/v3/projects/eeda99c9af924b49875177994ad3a96c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:41:45.006740 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c8075-1226-40fb-8f74-342f569c6b6d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:45.007504 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c8075-1226-40fb-8f74-342f569c6b6d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:45.007938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083c8075-1226-40fb-8f74-342f569c6b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:45.033020 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-083c8075-1226-40fb-8f74-342f569c6b6d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:41:45.034377 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-083c8075-1226-40fb-8f74-342f569c6b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:41:45.102432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1141/2301] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:41:45.110341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ddd93-13e4-4a00-a78f-2cd05d11cf6f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:45.110625 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ddd93-13e4-4a00-a78f-2cd05d11cf6f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:45.111069 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ddd93-13e4-4a00-a78f-2cd05d11cf6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:45.131972 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-eb9ddd93-13e4-4a00-a78f-2cd05d11cf6f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:41:45.133227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-eb9ddd93-13e4-4a00-a78f-2cd05d11cf6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:41:45.141180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1161/2302] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:41:45.145554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c8075-1226-40fb-8f74-342f569c6b6d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:45.162872 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083c8075-1226-40fb-8f74-342f569c6b6d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:45.167689 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14203462-5926-4985-8cca-b4f8c76ede22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:45.168301 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14203462-5926-4985-8cca-b4f8c76ede22 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:45.168582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14203462-5926-4985-8cca-b4f8c76ede22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:45.168887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14203462-5926-4985-8cca-b4f8c76ede22 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:45.169541 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14203462-5926-4985-8cca-b4f8c76ede22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:41:45.169848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14203462-5926-4985-8cca-b4f8c76ede22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:45.171436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14203462-5926-4985-8cca-b4f8c76ede22 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:45.183234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1142/2303] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:41:45.187691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ddd93-13e4-4a00-a78f-2cd05d11cf6f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:45.196970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ddd93-13e4-4a00-a78f-2cd05d11cf6f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:45.201583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2be12-6f0b-4298-896a-0de7d5af533c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:45.202174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2be12-6f0b-4298-896a-0de7d5af533c admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:45.202454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2be12-6f0b-4298-896a-0de7d5af533c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:45.202725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a2be12-6f0b-4298-896a-0de7d5af533c admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:45.203354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2be12-6f0b-4298-896a-0de7d5af533c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:45.205293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a2be12-6f0b-4298-896a-0de7d5af533c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:45.237313 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1162/2304] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:41:45 2022] POST /identity/v3/projects => generated 397 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:41:45.238489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14203462-5926-4985-8cca-b4f8c76ede22 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:45.249094 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14203462-5926-4985-8cca-b4f8c76ede22 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:45.309128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c616afd-cb79-4cb3-990b-6d75632a7879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:45.309735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c616afd-cb79-4cb3-990b-6d75632a7879 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:45.310012 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c616afd-cb79-4cb3-990b-6d75632a7879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:45.310281 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c616afd-cb79-4cb3-990b-6d75632a7879 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:45.310919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c616afd-cb79-4cb3-990b-6d75632a7879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:45.312855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c616afd-cb79-4cb3-990b-6d75632a7879 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:45.321621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:45.337791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1143/2305] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:41:45 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:41:45.341874 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2be12-6f0b-4298-896a-0de7d5af533c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:45.352373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a2be12-6f0b-4298-896a-0de7d5af533c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:45.357152 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fc0ea-0a14-4fd5-8142-74b63957ff65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:45.357762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fc0ea-0a14-4fd5-8142-74b63957ff65 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:45.358046 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fc0ea-0a14-4fd5-8142-74b63957ff65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:45.358325 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fc0ea-0a14-4fd5-8142-74b63957ff65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:45.359022 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fc0ea-0a14-4fd5-8142-74b63957ff65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:45.360602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fc0ea-0a14-4fd5-8142-74b63957ff65 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:45.361958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:45.373473 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1163/2306] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:41:45.377389 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c616afd-cb79-4cb3-990b-6d75632a7879 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:45.387977 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c616afd-cb79-4cb3-990b-6d75632a7879 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:45.392692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03407524-cb51-468d-a280-0eaed1e23de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:45.393303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03407524-cb51-468d-a280-0eaed1e23de1 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:45.393587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03407524-cb51-468d-a280-0eaed1e23de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:45.393866 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03407524-cb51-468d-a280-0eaed1e23de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:45.394510 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03407524-cb51-468d-a280-0eaed1e23de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:45.396179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03407524-cb51-468d-a280-0eaed1e23de1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:45.407232 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1144/2307] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:41:45.412541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fc0ea-0a14-4fd5-8142-74b63957ff65 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:45.422991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fc0ea-0a14-4fd5-8142-74b63957ff65 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:45.430600 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fac05-5731-4de0-8c70-5afcdde42596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:45.431355 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fac05-5731-4de0-8c70-5afcdde42596 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:45.431698 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fac05-5731-4de0-8c70-5afcdde42596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:45.432038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44fac05-5731-4de0-8c70-5afcdde42596 admin admin] PATH_INFO: `/v3/projects/60915557518f4d9a91e87dab51608ba1/users/b95453fb595047d29aec6a604167e1d7/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:45.452879 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fac05-5731-4de0-8c70-5afcdde42596 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60915557518f4d9a91e87dab51608ba1, user_id=b95453fb595047d29aec6a604167e1d7, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:45.455744 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44fac05-5731-4de0-8c70-5afcdde42596 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:45.480879 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1164/2308] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:41:45 2022] PUT /identity/v3/projects/60915557518f4d9a91e87dab51608ba1/users/b95453fb595047d29aec6a604167e1d7/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:41:45.486539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fae7a4-3033-43a4-b0db-fdd0a90da0f8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:45.486994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fae7a4-3033-43a4-b0db-fdd0a90da0f8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:45.487362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fae7a4-3033-43a4-b0db-fdd0a90da0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:45.517080 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-69fae7a4-3033-43a4-b0db-fdd0a90da0f8 None None] MFA Rules not processed for user `b95453fb595047d29aec6a604167e1d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:41:45.518293 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-69fae7a4-3033-43a4-b0db-fdd0a90da0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:41:45.580385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1145/2309] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:41:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:41:45.591649 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fac05-5731-4de0-8c70-5afcdde42596 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:45.593418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c44fac05-5731-4de0-8c70-5afcdde42596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:41:45.663066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44fac05-5731-4de0-8c70-5afcdde42596 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:45.666717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82520a91-cbbb-43bb-aa17-dd559083b910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:45.667318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82520a91-cbbb-43bb-aa17-dd559083b910 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:45.667594 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82520a91-cbbb-43bb-aa17-dd559083b910 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:45.667863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82520a91-cbbb-43bb-aa17-dd559083b910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:45.676386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82520a91-cbbb-43bb-aa17-dd559083b910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:45.678560 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82520a91-cbbb-43bb-aa17-dd559083b910 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:45.687936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1165/2310] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:41:45 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:41:50.920825 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fae7a4-3033-43a4-b0db-fdd0a90da0f8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:51.014529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fae7a4-3033-43a4-b0db-fdd0a90da0f8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:51.020153 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23e7bf-780d-44de-be6e-a89d70c9d375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:51.021852 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23e7bf-780d-44de-be6e-a89d70c9d375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:51.022147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23e7bf-780d-44de-be6e-a89d70c9d375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:51.022412 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b23e7bf-780d-44de-be6e-a89d70c9d375 admin admin] PATH_INFO: `/v3/users/b95453fb595047d29aec6a604167e1d7` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:51.023555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23e7bf-780d-44de-be6e-a89d70c9d375 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b95453fb595047d29aec6a604167e1d7)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:51.025491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b23e7bf-780d-44de-be6e-a89d70c9d375 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:51.073972 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8b23e7bf-780d-44de-be6e-a89d70c9d375 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b95453fb595047d29aec6a604167e1d7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:51.080908 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8b23e7bf-780d-44de-be6e-a89d70c9d375 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b95453fb595047d29aec6a604167e1d7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:51.090880 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:51.093327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8b23e7bf-780d-44de-be6e-a89d70c9d375 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b95453fb595047d29aec6a604167e1d7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:51.102600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8b23e7bf-780d-44de-be6e-a89d70c9d375 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b95453fb595047d29aec6a604167e1d7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:51.103250 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8b23e7bf-780d-44de-be6e-a89d70c9d375 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b95453fb595047d29aec6a604167e1d7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:51.110049 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1146/2311] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:41:50 2022] DELETE /identity/v3/users/b95453fb595047d29aec6a604167e1d7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:41:51.114395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aba785-31f8-452e-abba-6551c3e7d6b2 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:51.115421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aba785-31f8-452e-abba-6551c3e7d6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:51.115504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aba785-31f8-452e-abba-6551c3e7d6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:51.136873 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a8aba785-31f8-452e-abba-6551c3e7d6b2 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:41:51.138100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a8aba785-31f8-452e-abba-6551c3e7d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:41:51.200274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1166/2312] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:41:51.209720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23e7bf-780d-44de-be6e-a89d70c9d375 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:51.211249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8b23e7bf-780d-44de-be6e-a89d70c9d375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:41:51.270039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b23e7bf-780d-44de-be6e-a89d70c9d375 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:51.273828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c27844-681a-4642-8a13-74a0990f6e89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:51.274445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c27844-681a-4642-8a13-74a0990f6e89 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:51.274704 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c27844-681a-4642-8a13-74a0990f6e89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:51.274973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c27844-681a-4642-8a13-74a0990f6e89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:51.284381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c27844-681a-4642-8a13-74a0990f6e89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:51.285833 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c27844-681a-4642-8a13-74a0990f6e89 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:51.295337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1147/2313] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:41:51.572238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aba785-31f8-452e-abba-6551c3e7d6b2 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:41:51.573804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a8aba785-31f8-452e-abba-6551c3e7d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:41:51.586849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aba785-31f8-452e-abba-6551c3e7d6b2 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:41:51.591944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d3e0a-d30f-42ce-9432-32524984fd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:41:51.592579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d3e0a-d30f-42ce-9432-32524984fd76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:51.592934 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d3e0a-d30f-42ce-9432-32524984fd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:51.593334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d3e0a-d30f-42ce-9432-32524984fd76 admin admin] PATH_INFO: `/v3/projects/60915557518f4d9a91e87dab51608ba1` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:51.594479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d3e0a-d30f-42ce-9432-32524984fd76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60915557518f4d9a91e87dab51608ba1)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:41:51.597017 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d3e0a-d30f-42ce-9432-32524984fd76 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:41:51.654580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a68d3e0a-d30f-42ce-9432-32524984fd76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60915557518f4d9a91e87dab51608ba1', 'request_id': 'req-a68d3e0a-d30f-42ce-9432-32524984fd76'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:51.663287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a68d3e0a-d30f-42ce-9432-32524984fd76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60915557518f4d9a91e87dab51608ba1', 'request_id': 'req-a68d3e0a-d30f-42ce-9432-32524984fd76'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:51.669214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a68d3e0a-d30f-42ce-9432-32524984fd76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60915557518f4d9a91e87dab51608ba1', 'request_id': 'req-a68d3e0a-d30f-42ce-9432-32524984fd76'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:51.676350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:41:51.681676 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a68d3e0a-d30f-42ce-9432-32524984fd76 admin admin] The token cache is being invalidate because project 60915557518f4d9a91e87dab51608ba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:41:51.682327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a68d3e0a-d30f-42ce-9432-32524984fd76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:51.683469 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a68d3e0a-d30f-42ce-9432-32524984fd76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:41:51.691608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1167/2314] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:41:51 2022] DELETE /identity/v3/projects/60915557518f4d9a91e87dab51608ba1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:41:51.722301 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479cdee-1f40-4323-83af-639f19906f91 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:41:51.722695 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479cdee-1f40-4323-83af-639f19906f91 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:41:51.723051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479cdee-1f40-4323-83af-639f19906f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:41:51.744641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3479cdee-1f40-4323-83af-639f19906f91 None None] MFA Rules not processed for user `8505dee31512437ba7b6de3512dcc76a`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:41:51.746025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3479cdee-1f40-4323-83af-639f19906f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:41:51.807299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1148/2315] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:41:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:42:01.694791 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:01.800088 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=2,keystone:SELECT=54,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:24.840243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177350c8-dd25-4074-ab9d-1b3f314a3e67 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:24.840817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177350c8-dd25-4074-ab9d-1b3f314a3e67 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:24.840924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177350c8-dd25-4074-ab9d-1b3f314a3e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:24.859632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-177350c8-dd25-4074-ab9d-1b3f314a3e67 None None] MFA Rules not processed for user `a05d9cf1223b44589ab5586ec50a5b2f`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:24.860841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-177350c8-dd25-4074-ab9d-1b3f314a3e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:24.916046 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1168/2316] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:42:34.021130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479cdee-1f40-4323-83af-639f19906f91 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:34.022583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3479cdee-1f40-4323-83af-639f19906f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:34.082390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479cdee-1f40-4323-83af-639f19906f91 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:34.085960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47ac76-7ff7-44ba-8275-9fe45d2e75dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:34.086560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47ac76-7ff7-44ba-8275-9fe45d2e75dc service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:34.086838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47ac76-7ff7-44ba-8275-9fe45d2e75dc service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:34.087118 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47ac76-7ff7-44ba-8275-9fe45d2e75dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:34.088848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1d47ac76-7ff7-44ba-8275-9fe45d2e75dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:34.166407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47ac76-7ff7-44ba-8275-9fe45d2e75dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:34.168436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47ac76-7ff7-44ba-8275-9fe45d2e75dc service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:34.180840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1149/2317] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:42:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:42:34.909007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=25 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:36.896956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177350c8-dd25-4074-ab9d-1b3f314a3e67 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:36.898324 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-177350c8-dd25-4074-ab9d-1b3f314a3e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:36.910171 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177350c8-dd25-4074-ab9d-1b3f314a3e67 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:36.914149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f04bd0-6224-4ae0-b31e-230f01761535 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:36.914734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f04bd0-6224-4ae0-b31e-230f01761535 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:36.915011 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f04bd0-6224-4ae0-b31e-230f01761535 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:36.915279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f04bd0-6224-4ae0-b31e-230f01761535 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:36.916978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-24f04bd0-6224-4ae0-b31e-230f01761535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:36.979491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f04bd0-6224-4ae0-b31e-230f01761535 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:36.981237 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f04bd0-6224-4ae0-b31e-230f01761535 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:36.991924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1169/2318] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:42:37.370659 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47ac76-7ff7-44ba-8275-9fe45d2e75dc service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:37.379824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47ac76-7ff7-44ba-8275-9fe45d2e75dc service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:37.383818 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41a45e-137b-492f-be32-5f696dc71ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:37.384421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41a45e-137b-492f-be32-5f696dc71ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:37.384733 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41a45e-137b-492f-be32-5f696dc71ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:37.385013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41a45e-137b-492f-be32-5f696dc71ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:37.386778 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4d41a45e-137b-492f-be32-5f696dc71ab3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:37.401029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41a45e-137b-492f-be32-5f696dc71ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:37.402415 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41a45e-137b-492f-be32-5f696dc71ab3 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:37.415086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1150/2319] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:42:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:42:40.560596 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f04bd0-6224-4ae0-b31e-230f01761535 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:40.562186 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-24f04bd0-6224-4ae0-b31e-230f01761535 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:40.581393 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f04bd0-6224-4ae0-b31e-230f01761535 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:40.586816 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70f58e7-8a9f-4f15-ad6f-b1caed70740d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:40.587469 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f58e7-8a9f-4f15-ad6f-b1caed70740d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:40.587743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f58e7-8a9f-4f15-ad6f-b1caed70740d admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:40.588005 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70f58e7-8a9f-4f15-ad6f-b1caed70740d admin admin] PATH_INFO: `/v3/users/4bad46590fab4c94a789626e42aca76d` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:40.589202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f58e7-8a9f-4f15-ad6f-b1caed70740d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bad46590fab4c94a789626e42aca76d)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:40.591119 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70f58e7-8a9f-4f15-ad6f-b1caed70740d admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:40.665388 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a70f58e7-8a9f-4f15-ad6f-b1caed70740d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bad46590fab4c94a789626e42aca76d'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:40.673597 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a70f58e7-8a9f-4f15-ad6f-b1caed70740d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bad46590fab4c94a789626e42aca76d'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:40.688404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a70f58e7-8a9f-4f15-ad6f-b1caed70740d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bad46590fab4c94a789626e42aca76d'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:40.689594 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a70f58e7-8a9f-4f15-ad6f-b1caed70740d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bad46590fab4c94a789626e42aca76d'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:40.705599 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a70f58e7-8a9f-4f15-ad6f-b1caed70740d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bad46590fab4c94a789626e42aca76d'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:40.723858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1170/2320] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:42:40 2022] DELETE /identity/v3/users/4bad46590fab4c94a789626e42aca76d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:40.938506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41a45e-137b-492f-be32-5f696dc71ab3 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:40.950167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41a45e-137b-492f-be32-5f696dc71ab3 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:41.030560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139fe6ce-e5bd-42dd-a1bc-05d19f528e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:41.031212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fe6ce-e5bd-42dd-a1bc-05d19f528e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:41.031497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fe6ce-e5bd-42dd-a1bc-05d19f528e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:41.031777 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fe6ce-e5bd-42dd-a1bc-05d19f528e3a admin admin] PATH_INFO: `/v3/projects/934624a4612647b6aa32687bfd843241` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:41.032946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fe6ce-e5bd-42dd-a1bc-05d19f528e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=934624a4612647b6aa32687bfd843241)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:41.034872 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139fe6ce-e5bd-42dd-a1bc-05d19f528e3a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:41.087953 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:41.106111 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-139fe6ce-e5bd-42dd-a1bc-05d19f528e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '934624a4612647b6aa32687bfd843241', 'request_id': 'req-139fe6ce-e5bd-42dd-a1bc-05d19f528e3a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:41.114428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-139fe6ce-e5bd-42dd-a1bc-05d19f528e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '934624a4612647b6aa32687bfd843241', 'request_id': 'req-139fe6ce-e5bd-42dd-a1bc-05d19f528e3a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:41.122128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-139fe6ce-e5bd-42dd-a1bc-05d19f528e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '934624a4612647b6aa32687bfd843241', 'request_id': 'req-139fe6ce-e5bd-42dd-a1bc-05d19f528e3a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:41.138025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-139fe6ce-e5bd-42dd-a1bc-05d19f528e3a admin admin] The token cache is being invalidate because project 934624a4612647b6aa32687bfd843241 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:42:41.138625 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-139fe6ce-e5bd-42dd-a1bc-05d19f528e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:41.139757 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-139fe6ce-e5bd-42dd-a1bc-05d19f528e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:41.144731 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1151/2321] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:42:40 2022] DELETE /identity/v3/projects/934624a4612647b6aa32687bfd843241 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:41.150144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89386e07-3c5f-403f-9d8a-c6185cfe8c6c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:41.151310 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89386e07-3c5f-403f-9d8a-c6185cfe8c6c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:41.151682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89386e07-3c5f-403f-9d8a-c6185cfe8c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:41.182870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-89386e07-3c5f-403f-9d8a-c6185cfe8c6c None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:41.184227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-89386e07-3c5f-403f-9d8a-c6185cfe8c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:41.252222 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1171/2322] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:42:41.261244 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f06a3-b417-43a6-ad45-cfd54ef4503c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:41.261656 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f06a3-b417-43a6-ad45-cfd54ef4503c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:41.262622 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f06a3-b417-43a6-ad45-cfd54ef4503c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:41.287495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0c4f06a3-b417-43a6-ad45-cfd54ef4503c None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:41.288898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0c4f06a3-b417-43a6-ad45-cfd54ef4503c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:41.302882 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1152/2323] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:42:41.305089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89386e07-3c5f-403f-9d8a-c6185cfe8c6c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:41.315751 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89386e07-3c5f-403f-9d8a-c6185cfe8c6c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:41.322122 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33b5a6-5a63-40ce-9c8e-a6568df73f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:41.322845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33b5a6-5a63-40ce-9c8e-a6568df73f43 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:41.323219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33b5a6-5a63-40ce-9c8e-a6568df73f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:41.323634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33b5a6-5a63-40ce-9c8e-a6568df73f43 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:41.324418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33b5a6-5a63-40ce-9c8e-a6568df73f43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:42:41.324893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33b5a6-5a63-40ce-9c8e-a6568df73f43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:41.326711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33b5a6-5a63-40ce-9c8e-a6568df73f43 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:41.328604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:41.340796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1172/2324] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:42:41.345631 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f06a3-b417-43a6-ad45-cfd54ef4503c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:41.361831 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f06a3-b417-43a6-ad45-cfd54ef4503c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:41.368320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08385c15-2369-4570-9512-d315377ae64d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:41.369054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08385c15-2369-4570-9512-d315377ae64d admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:41.369408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08385c15-2369-4570-9512-d315377ae64d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:41.369753 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08385c15-2369-4570-9512-d315377ae64d admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:41.370470 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08385c15-2369-4570-9512-d315377ae64d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:41.372576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08385c15-2369-4570-9512-d315377ae64d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:41.404058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1153/2325] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:42:41 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:42:41.409372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33b5a6-5a63-40ce-9c8e-a6568df73f43 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:41.425182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33b5a6-5a63-40ce-9c8e-a6568df73f43 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:41.494292 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d0038-644c-446b-acfa-60d01930a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:41.495039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d0038-644c-446b-acfa-60d01930a852 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:41.495447 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d0038-644c-446b-acfa-60d01930a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:41.495824 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d0038-644c-446b-acfa-60d01930a852 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:41.496574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d0038-644c-446b-acfa-60d01930a852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:41.498664 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d0038-644c-446b-acfa-60d01930a852 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:41.532732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1173/2326] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:42:41 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:42:41.536214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08385c15-2369-4570-9512-d315377ae64d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:41.546730 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08385c15-2369-4570-9512-d315377ae64d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:41.552153 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7681f-27aa-4551-a589-420a5408e0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:41.552816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7681f-27aa-4551-a589-420a5408e0e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:41.553101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7681f-27aa-4551-a589-420a5408e0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:41.553391 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea7681f-27aa-4551-a589-420a5408e0e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:41.554039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7681f-27aa-4551-a589-420a5408e0e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:41.555675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea7681f-27aa-4551-a589-420a5408e0e2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:41.566997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1154/2327] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:42:41.572651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d0038-644c-446b-acfa-60d01930a852 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:41.583952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d0038-644c-446b-acfa-60d01930a852 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:41.590335 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1407877-a111-408d-9ea0-cb49f39352c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:41.591773 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1407877-a111-408d-9ea0-cb49f39352c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:41.592231 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1407877-a111-408d-9ea0-cb49f39352c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:41.592697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1407877-a111-408d-9ea0-cb49f39352c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:41.593572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1407877-a111-408d-9ea0-cb49f39352c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:41.595340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1407877-a111-408d-9ea0-cb49f39352c1 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:41.611257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1174/2328] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:42:41.616137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7681f-27aa-4551-a589-420a5408e0e2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:41.627314 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea7681f-27aa-4551-a589-420a5408e0e2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:41.632595 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef37d60-111f-44dc-8b2c-dacd92a85da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:41.633306 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef37d60-111f-44dc-8b2c-dacd92a85da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:41.633586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef37d60-111f-44dc-8b2c-dacd92a85da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:41.633883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef37d60-111f-44dc-8b2c-dacd92a85da8 admin admin] PATH_INFO: `/v3/projects/c71dd6083aed4717992bbe698792e296/users/4f2ff8c755a94800801fb28788383ba4/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:41.653090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef37d60-111f-44dc-8b2c-dacd92a85da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c71dd6083aed4717992bbe698792e296, user_id=4f2ff8c755a94800801fb28788383ba4, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:41.655856 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef37d60-111f-44dc-8b2c-dacd92a85da8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:41.682209 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1155/2329] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:42:41 2022] PUT /identity/v3/projects/c71dd6083aed4717992bbe698792e296/users/4f2ff8c755a94800801fb28788383ba4/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:41.684730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87bee6-a0dc-4cb8-b095-edf997d62398 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:41.685347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87bee6-a0dc-4cb8-b095-edf997d62398 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:41.685778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb87bee6-a0dc-4cb8-b095-edf997d62398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:41.715877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-cb87bee6-a0dc-4cb8-b095-edf997d62398 None None] MFA Rules not processed for user `4f2ff8c755a94800801fb28788383ba4`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:41.717068 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-cb87bee6-a0dc-4cb8-b095-edf997d62398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:41.788998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1175/2330] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:42:41.793489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef37d60-111f-44dc-8b2c-dacd92a85da8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:41.858907 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef37d60-111f-44dc-8b2c-dacd92a85da8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:41.863631 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f9b80-826d-4b9d-a63d-b9db7aeb2735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:41.864231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f9b80-826d-4b9d-a63d-b9db7aeb2735 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:41.864509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f9b80-826d-4b9d-a63d-b9db7aeb2735 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:41.864901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f9b80-826d-4b9d-a63d-b9db7aeb2735 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:41.865753 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f9b80-826d-4b9d-a63d-b9db7aeb2735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:41.867764 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f9b80-826d-4b9d-a63d-b9db7aeb2735 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:41.893482 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1156/2331] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:42:41 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:42:41.898142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87bee6-a0dc-4cb8-b095-edf997d62398 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:41.908943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb87bee6-a0dc-4cb8-b095-edf997d62398 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:41.965823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb614f9d-9e96-4bcd-9736-9e04145e7c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:41.966477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb614f9d-9e96-4bcd-9736-9e04145e7c42 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:41.966705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb614f9d-9e96-4bcd-9736-9e04145e7c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:41.966971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb614f9d-9e96-4bcd-9736-9e04145e7c42 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:41.967593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb614f9d-9e96-4bcd-9736-9e04145e7c42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:41.969570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb614f9d-9e96-4bcd-9736-9e04145e7c42 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:41.979139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:41.991210 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1176/2332] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:42:41 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:42:41.996324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f9b80-826d-4b9d-a63d-b9db7aeb2735 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:42.013038 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f9b80-826d-4b9d-a63d-b9db7aeb2735 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:42.017845 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c097a78-5a4b-4944-83f6-2e67b4325e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:42.018445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c097a78-5a4b-4944-83f6-2e67b4325e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:42.018720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c097a78-5a4b-4944-83f6-2e67b4325e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:42.019083 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c097a78-5a4b-4944-83f6-2e67b4325e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:42.019803 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c097a78-5a4b-4944-83f6-2e67b4325e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:42.022142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c097a78-5a4b-4944-83f6-2e67b4325e82 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:42.035660 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1157/2333] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:42:42.039796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb614f9d-9e96-4bcd-9736-9e04145e7c42 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:42.049565 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb614f9d-9e96-4bcd-9736-9e04145e7c42 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:42.054103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276d287-224f-491e-a65b-79018f3d0705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:42.054744 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276d287-224f-491e-a65b-79018f3d0705 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:42.055020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276d287-224f-491e-a65b-79018f3d0705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:42.055302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1276d287-224f-491e-a65b-79018f3d0705 admin admin] PATH_INFO: `/v3/projects/10d2debfa03a431ebbff80643bf435f7/users/1cd5b990b77a40198620214a2165861c/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:42.071444 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276d287-224f-491e-a65b-79018f3d0705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d2debfa03a431ebbff80643bf435f7, user_id=1cd5b990b77a40198620214a2165861c, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:42.074146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1276d287-224f-491e-a65b-79018f3d0705 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:42.088140 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1177/2334] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:42:42 2022] PUT /identity/v3/projects/10d2debfa03a431ebbff80643bf435f7/users/1cd5b990b77a40198620214a2165861c/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:42.091897 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c097a78-5a4b-4944-83f6-2e67b4325e82 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:42.102013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c097a78-5a4b-4944-83f6-2e67b4325e82 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:42.127956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:42.162918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9c4e5-b79e-4184-991f-5b76e9618472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:42.163554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9c4e5-b79e-4184-991f-5b76e9618472 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:42.163837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9c4e5-b79e-4184-991f-5b76e9618472 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:42.164108 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9c4e5-b79e-4184-991f-5b76e9618472 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:42.164859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9c4e5-b79e-4184-991f-5b76e9618472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:42.166574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9c4e5-b79e-4184-991f-5b76e9618472 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:42.178014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1158/2335] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:42:42.181849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276d287-224f-491e-a65b-79018f3d0705 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:42.193660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1276d287-224f-491e-a65b-79018f3d0705 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:42.198737 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e446b2-9e17-4e14-8b91-c6a999375639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:42.199453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e446b2-9e17-4e14-8b91-c6a999375639 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:42.199850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e446b2-9e17-4e14-8b91-c6a999375639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:42.200031 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e446b2-9e17-4e14-8b91-c6a999375639 admin admin] PATH_INFO: `/v3/projects/10d2debfa03a431ebbff80643bf435f7/users/1cd5b990b77a40198620214a2165861c/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:42.203092 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e446b2-9e17-4e14-8b91-c6a999375639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10d2debfa03a431ebbff80643bf435f7, user_id=1cd5b990b77a40198620214a2165861c, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:42.206144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e446b2-9e17-4e14-8b91-c6a999375639 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:42.221187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1178/2336] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:42:42 2022] PUT /identity/v3/projects/10d2debfa03a431ebbff80643bf435f7/users/1cd5b990b77a40198620214a2165861c/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:42:42.232077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a1976-ed91-4d39-b645-262c99ef85d1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:42.232360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a1976-ed91-4d39-b645-262c99ef85d1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:42.232633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a1976-ed91-4d39-b645-262c99ef85d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:42.265250 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4a6a1976-ed91-4d39-b645-262c99ef85d1 None None] MFA Rules not processed for user `1cd5b990b77a40198620214a2165861c`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:42.266565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4a6a1976-ed91-4d39-b645-262c99ef85d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:42.354127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1159/2337] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:42:42.366457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e446b2-9e17-4e14-8b91-c6a999375639 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:42.368724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-47e446b2-9e17-4e14-8b91-c6a999375639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:42.428277 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e446b2-9e17-4e14-8b91-c6a999375639 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:42.431876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aeb795-2d79-4865-9c1f-85d24cea97f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:42.432470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeb795-2d79-4865-9c1f-85d24cea97f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:42.432778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeb795-2d79-4865-9c1f-85d24cea97f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:42.433050 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aeb795-2d79-4865-9c1f-85d24cea97f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:42.442332 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aeb795-2d79-4865-9c1f-85d24cea97f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:42.443759 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aeb795-2d79-4865-9c1f-85d24cea97f0 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:42.452972 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1179/2338] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:42:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:42:42.531547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a1976-ed91-4d39-b645-262c99ef85d1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:42.540891 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a1976-ed91-4d39-b645-262c99ef85d1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:42.544392 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b3ec7-cc31-472d-b2e3-ff1507a5bc25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:42.545009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b3ec7-cc31-472d-b2e3-ff1507a5bc25 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:42.545290 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b3ec7-cc31-472d-b2e3-ff1507a5bc25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:42.545561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b3ec7-cc31-472d-b2e3-ff1507a5bc25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:42.601862 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b3ec7-cc31-472d-b2e3-ff1507a5bc25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:42.603298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b3ec7-cc31-472d-b2e3-ff1507a5bc25 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:42.613253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1160/2339] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:42:42 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:42:46.856656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c4a96-bcd1-489b-99f7-55680b03edac None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:46.857217 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c4a96-bcd1-489b-99f7-55680b03edac None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:46.857693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3c4a96-bcd1-489b-99f7-55680b03edac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:46.878937 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-4d3c4a96-bcd1-489b-99f7-55680b03edac None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:46.880755 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4d3c4a96-bcd1-489b-99f7-55680b03edac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:46.946248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1180/2340] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 13 06:42:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:42:47.005766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b3ec7-cc31-472d-b2e3-ff1507a5bc25 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:47.007357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-122b3ec7-cc31-472d-b2e3-ff1507a5bc25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:47.062472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:47.090252 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b3ec7-cc31-472d-b2e3-ff1507a5bc25 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:47.096212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95718189-cd44-470d-b551-e10306648b98 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:47.096881 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95718189-cd44-470d-b551-e10306648b98 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:47.097162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95718189-cd44-470d-b551-e10306648b98 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:47.097433 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95718189-cd44-470d-b551-e10306648b98 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:47.107213 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95718189-cd44-470d-b551-e10306648b98 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:47.108847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95718189-cd44-470d-b551-e10306648b98 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:47.118593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1161/2341] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:42:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 06:42:49.563122 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c4a96-bcd1-489b-99f7-55680b03edac None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:49.693284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3c4a96-bcd1-489b-99f7-55680b03edac None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:49.698076 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996452b-5df1-4b56-b3fa-5434228f9d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:49.698860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996452b-5df1-4b56-b3fa-5434228f9d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:49.700612 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996452b-5df1-4b56-b3fa-5434228f9d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:49.700612 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996452b-5df1-4b56-b3fa-5434228f9d1e admin admin] PATH_INFO: `/v3/users/4f2ff8c755a94800801fb28788383ba4` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:49.702973 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996452b-5df1-4b56-b3fa-5434228f9d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f2ff8c755a94800801fb28788383ba4)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:49.705006 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996452b-5df1-4b56-b3fa-5434228f9d1e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:49.717163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:49.800544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b996452b-5df1-4b56-b3fa-5434228f9d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f2ff8c755a94800801fb28788383ba4'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:49.810425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b996452b-5df1-4b56-b3fa-5434228f9d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f2ff8c755a94800801fb28788383ba4'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:49.828216 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b996452b-5df1-4b56-b3fa-5434228f9d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f2ff8c755a94800801fb28788383ba4'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:49.829305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b996452b-5df1-4b56-b3fa-5434228f9d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f2ff8c755a94800801fb28788383ba4'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:49.852431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b996452b-5df1-4b56-b3fa-5434228f9d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f2ff8c755a94800801fb28788383ba4'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:49.861393 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1181/2342] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:42:49 2022] DELETE /identity/v3/users/4f2ff8c755a94800801fb28788383ba4 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:49.865683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb7a6f-1a86-4605-97a5-d04045998e6b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:49.866137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb7a6f-1a86-4605-97a5-d04045998e6b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:49.866240 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb7a6f-1a86-4605-97a5-d04045998e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:49.887072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-27cb7a6f-1a86-4605-97a5-d04045998e6b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:49.888372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-27cb7a6f-1a86-4605-97a5-d04045998e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:49.993803 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1162/2343] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:42:50.004018 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996452b-5df1-4b56-b3fa-5434228f9d1e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:50.006094 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b996452b-5df1-4b56-b3fa-5434228f9d1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:50.087436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996452b-5df1-4b56-b3fa-5434228f9d1e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:50.091296 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eaa87-a5d3-4cd4-b646-30f1341fe79b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:50.091921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eaa87-a5d3-4cd4-b646-30f1341fe79b service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:50.092197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eaa87-a5d3-4cd4-b646-30f1341fe79b service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:50.092468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1eaa87-a5d3-4cd4-b646-30f1341fe79b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:50.103407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1eaa87-a5d3-4cd4-b646-30f1341fe79b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:50.105025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1eaa87-a5d3-4cd4-b646-30f1341fe79b service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:50.120804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1182/2344] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:42:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:42:50.519319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb7a6f-1a86-4605-97a5-d04045998e6b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:50.520872 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-27cb7a6f-1a86-4605-97a5-d04045998e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:50.533576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb7a6f-1a86-4605-97a5-d04045998e6b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:50.539266 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b96228-2696-452e-95c3-bd3f909aad0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:50.540088 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b96228-2696-452e-95c3-bd3f909aad0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:50.540443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b96228-2696-452e-95c3-bd3f909aad0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:50.540884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b96228-2696-452e-95c3-bd3f909aad0d admin admin] PATH_INFO: `/v3/projects/c71dd6083aed4717992bbe698792e296` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:50.542090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b96228-2696-452e-95c3-bd3f909aad0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c71dd6083aed4717992bbe698792e296)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:50.544071 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b96228-2696-452e-95c3-bd3f909aad0d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:50.601385 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eaa87-a5d3-4cd4-b646-30f1341fe79b service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:50.603665 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9c1eaa87-a5d3-4cd4-b646-30f1341fe79b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:50.607553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b4b96228-2696-452e-95c3-bd3f909aad0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c71dd6083aed4717992bbe698792e296', 'request_id': 'req-b4b96228-2696-452e-95c3-bd3f909aad0d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:50.622039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b4b96228-2696-452e-95c3-bd3f909aad0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c71dd6083aed4717992bbe698792e296', 'request_id': 'req-b4b96228-2696-452e-95c3-bd3f909aad0d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:50.630040 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b4b96228-2696-452e-95c3-bd3f909aad0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c71dd6083aed4717992bbe698792e296', 'request_id': 'req-b4b96228-2696-452e-95c3-bd3f909aad0d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:50.657374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b4b96228-2696-452e-95c3-bd3f909aad0d admin admin] The token cache is being invalidate because project c71dd6083aed4717992bbe698792e296 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:42:50.657923 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b4b96228-2696-452e-95c3-bd3f909aad0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:50.659588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b4b96228-2696-452e-95c3-bd3f909aad0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:50.663239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1163/2345] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:42:50 2022] DELETE /identity/v3/projects/c71dd6083aed4717992bbe698792e296 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:50.667236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b96228-2696-452e-95c3-bd3f909aad0d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:50.668840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b4b96228-2696-452e-95c3-bd3f909aad0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:50.727690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1eaa87-a5d3-4cd4-b646-30f1341fe79b service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:50.754414 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:50.778397 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b96228-2696-452e-95c3-bd3f909aad0d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:50.786488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682dda5-de74-4792-bbad-c08c431ea885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:50.787146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682dda5-de74-4792-bbad-c08c431ea885 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:50.787426 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682dda5-de74-4792-bbad-c08c431ea885 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:50.787707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e682dda5-de74-4792-bbad-c08c431ea885 admin admin] PATH_INFO: `/v3/users/1cd5b990b77a40198620214a2165861c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:50.790410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682dda5-de74-4792-bbad-c08c431ea885 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd5b990b77a40198620214a2165861c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:50.792861 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e682dda5-de74-4792-bbad-c08c431ea885 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:50.796443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:50.848218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8b1c9a-1d07-4606-8e15-fc96f7abd569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:50.848937 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b1c9a-1d07-4606-8e15-fc96f7abd569 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:50.849247 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b1c9a-1d07-4606-8e15-fc96f7abd569 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:50.849553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8b1c9a-1d07-4606-8e15-fc96f7abd569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:50.851367 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fa8b1c9a-1d07-4606-8e15-fc96f7abd569 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:50.883512 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e682dda5-de74-4792-bbad-c08c431ea885 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd5b990b77a40198620214a2165861c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:50.899248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e682dda5-de74-4792-bbad-c08c431ea885 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd5b990b77a40198620214a2165861c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:50.933646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e682dda5-de74-4792-bbad-c08c431ea885 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd5b990b77a40198620214a2165861c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:50.946146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e682dda5-de74-4792-bbad-c08c431ea885 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd5b990b77a40198620214a2165861c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:50.949960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-e682dda5-de74-4792-bbad-c08c431ea885 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd5b990b77a40198620214a2165861c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:50.962656 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1164/2346] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:42:50 2022] DELETE /identity/v3/users/1cd5b990b77a40198620214a2165861c => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:50.962855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b1c9a-1d07-4606-8e15-fc96f7abd569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:50.962855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8b1c9a-1d07-4606-8e15-fc96f7abd569 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:50.995558 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1183/2347] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:42:50 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:42:51.386242 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682dda5-de74-4792-bbad-c08c431ea885 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:51.387613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e682dda5-de74-4792-bbad-c08c431ea885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:51.495530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e682dda5-de74-4792-bbad-c08c431ea885 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:51.501542 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66276b-2d78-49c5-8094-4f09c1fd7e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:51.502136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66276b-2d78-49c5-8094-4f09c1fd7e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:51.502420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66276b-2d78-49c5-8094-4f09c1fd7e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:51.502698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66276b-2d78-49c5-8094-4f09c1fd7e7a admin admin] PATH_INFO: `/v3/projects/10d2debfa03a431ebbff80643bf435f7` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:51.503905 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66276b-2d78-49c5-8094-4f09c1fd7e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=10d2debfa03a431ebbff80643bf435f7)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:51.506369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66276b-2d78-49c5-8094-4f09c1fd7e7a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:51.560782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3e66276b-2d78-49c5-8094-4f09c1fd7e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10d2debfa03a431ebbff80643bf435f7', 'request_id': 'req-3e66276b-2d78-49c5-8094-4f09c1fd7e7a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:51.567957 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3e66276b-2d78-49c5-8094-4f09c1fd7e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10d2debfa03a431ebbff80643bf435f7', 'request_id': 'req-3e66276b-2d78-49c5-8094-4f09c1fd7e7a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:51.574853 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3e66276b-2d78-49c5-8094-4f09c1fd7e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10d2debfa03a431ebbff80643bf435f7', 'request_id': 'req-3e66276b-2d78-49c5-8094-4f09c1fd7e7a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:51.594668 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3e66276b-2d78-49c5-8094-4f09c1fd7e7a admin admin] The token cache is being invalidate because project 10d2debfa03a431ebbff80643bf435f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:42:51.595268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3e66276b-2d78-49c5-8094-4f09c1fd7e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:51.596571 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3e66276b-2d78-49c5-8094-4f09c1fd7e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:51.598900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1165/2348] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:42:51 2022] DELETE /identity/v3/projects/10d2debfa03a431ebbff80643bf435f7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:51.605062 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3359fd-1aaa-4bde-9db5-b104bdcfef7a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:51.605604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3359fd-1aaa-4bde-9db5-b104bdcfef7a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:51.606023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3359fd-1aaa-4bde-9db5-b104bdcfef7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:51.640539 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-bc3359fd-1aaa-4bde-9db5-b104bdcfef7a None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:51.642174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-bc3359fd-1aaa-4bde-9db5-b104bdcfef7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:51.744844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1184/2349] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:42:51.747399 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051e57f-51b0-4d40-a7c4-64d2a6039184 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:51.747691 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051e57f-51b0-4d40-a7c4-64d2a6039184 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:51.747998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051e57f-51b0-4d40-a7c4-64d2a6039184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:51.770630 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-c051e57f-51b0-4d40-a7c4-64d2a6039184 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:51.772708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c051e57f-51b0-4d40-a7c4-64d2a6039184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:51.780699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1166/2350] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:42:51.787700 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3359fd-1aaa-4bde-9db5-b104bdcfef7a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:51.796334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3359fd-1aaa-4bde-9db5-b104bdcfef7a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:51.801929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc052f-ca2c-4967-a416-2ccced839d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:51.802650 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc052f-ca2c-4967-a416-2ccced839d67 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:51.803003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc052f-ca2c-4967-a416-2ccced839d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:51.803348 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cc052f-ca2c-4967-a416-2ccced839d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:51.804205 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc052f-ca2c-4967-a416-2ccced839d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:42:51.804599 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc052f-ca2c-4967-a416-2ccced839d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:51.806397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cc052f-ca2c-4967-a416-2ccced839d67 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:51.832836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1185/2351] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:42:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:42:51.836095 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051e57f-51b0-4d40-a7c4-64d2a6039184 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:51.842984 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:51.848812 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c051e57f-51b0-4d40-a7c4-64d2a6039184 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:51.857524 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f926e-9b4e-420b-aed6-81d127d149f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:51.858150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f926e-9b4e-420b-aed6-81d127d149f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:51.858430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f926e-9b4e-420b-aed6-81d127d149f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:51.858702 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f926e-9b4e-420b-aed6-81d127d149f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:51.859468 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f926e-9b4e-420b-aed6-81d127d149f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:51.861964 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f926e-9b4e-420b-aed6-81d127d149f7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:51.907514 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1167/2352] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:42:51 2022] POST /identity/v3/projects => generated 369 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:42:51.908787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc052f-ca2c-4967-a416-2ccced839d67 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:51.924843 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cc052f-ca2c-4967-a416-2ccced839d67 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:51.972301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:51.986484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36ea9b-e6af-4563-997f-a065df0a542c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:51.987109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36ea9b-e6af-4563-997f-a065df0a542c admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:51.987377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36ea9b-e6af-4563-997f-a065df0a542c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:51.987654 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab36ea9b-e6af-4563-997f-a065df0a542c admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:51.988879 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36ea9b-e6af-4563-997f-a065df0a542c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:51.990885 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab36ea9b-e6af-4563-997f-a065df0a542c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:52.017950 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1186/2353] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:42:51 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:42:52.019444 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f926e-9b4e-420b-aed6-81d127d149f7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:52.030326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f926e-9b4e-420b-aed6-81d127d149f7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:52.037838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe4c1b-e2a0-4cf3-bcaf-b10681355613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:52.038468 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe4c1b-e2a0-4cf3-bcaf-b10681355613 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:52.038809 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe4c1b-e2a0-4cf3-bcaf-b10681355613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:52.039254 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfe4c1b-e2a0-4cf3-bcaf-b10681355613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:52.039917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe4c1b-e2a0-4cf3-bcaf-b10681355613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:52.041581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfe4c1b-e2a0-4cf3-bcaf-b10681355613 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:52.053968 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1168/2354] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:42:52.057929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36ea9b-e6af-4563-997f-a065df0a542c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:52.069025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab36ea9b-e6af-4563-997f-a065df0a542c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:52.074743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb33f39-f220-4517-beab-4238bb6ceecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:52.075706 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb33f39-f220-4517-beab-4238bb6ceecf admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:52.076203 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb33f39-f220-4517-beab-4238bb6ceecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:52.076825 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb33f39-f220-4517-beab-4238bb6ceecf admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:52.077757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb33f39-f220-4517-beab-4238bb6ceecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:52.079888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb33f39-f220-4517-beab-4238bb6ceecf admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:52.095997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1187/2355] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:42:52.098069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe4c1b-e2a0-4cf3-bcaf-b10681355613 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:52.108636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfe4c1b-e2a0-4cf3-bcaf-b10681355613 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:52.113693 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130d1ad-588d-4552-8235-e2d29a4e0454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:52.114367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130d1ad-588d-4552-8235-e2d29a4e0454 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:52.114674 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130d1ad-588d-4552-8235-e2d29a4e0454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:52.114951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130d1ad-588d-4552-8235-e2d29a4e0454 admin admin] PATH_INFO: `/v3/projects/9c572ff38f664dc0956969d72949b068/users/9e25e8f317fe4cc1afb997005a660d41/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:52.133152 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130d1ad-588d-4552-8235-e2d29a4e0454 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c572ff38f664dc0956969d72949b068, user_id=9e25e8f317fe4cc1afb997005a660d41, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:52.136012 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2130d1ad-588d-4552-8235-e2d29a4e0454 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:52.151395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1169/2356] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:42:52 2022] PUT /identity/v3/projects/9c572ff38f664dc0956969d72949b068/users/9e25e8f317fe4cc1afb997005a660d41/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:52.164119 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c00d5-1d52-4302-a2e7-4b171a7a799c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:52.164429 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c00d5-1d52-4302-a2e7-4b171a7a799c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:52.164742 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c00d5-1d52-4302-a2e7-4b171a7a799c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:52.199276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-927c00d5-1d52-4302-a2e7-4b171a7a799c None None] MFA Rules not processed for user `9e25e8f317fe4cc1afb997005a660d41`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:52.200581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-927c00d5-1d52-4302-a2e7-4b171a7a799c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:52.279682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1188/2357] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:52 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:42:52.281342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130d1ad-588d-4552-8235-e2d29a4e0454 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:52.361007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130d1ad-588d-4552-8235-e2d29a4e0454 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:52.366589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff5202-18f7-41e4-841b-ffcfbc08fe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:52.367418 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff5202-18f7-41e4-841b-ffcfbc08fe30 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:52.368148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff5202-18f7-41e4-841b-ffcfbc08fe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:52.368582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ff5202-18f7-41e4-841b-ffcfbc08fe30 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:52.369400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff5202-18f7-41e4-841b-ffcfbc08fe30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:52.371293 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ff5202-18f7-41e4-841b-ffcfbc08fe30 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:52.424059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1170/2358] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:42:52 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:42:52.428570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c00d5-1d52-4302-a2e7-4b171a7a799c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:52.442852 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c00d5-1d52-4302-a2e7-4b171a7a799c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:52.520609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796564e7-a3de-4d2c-a9cb-953f693f3e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:52.521912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796564e7-a3de-4d2c-a9cb-953f693f3e94 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:52.522401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796564e7-a3de-4d2c-a9cb-953f693f3e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:52.522876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796564e7-a3de-4d2c-a9cb-953f693f3e94 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:52.523806 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796564e7-a3de-4d2c-a9cb-953f693f3e94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:52.525994 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796564e7-a3de-4d2c-a9cb-953f693f3e94 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:52.551254 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1189/2359] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:42:52 2022] POST /identity/v3/users => generated 290 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:42:52.555805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff5202-18f7-41e4-841b-ffcfbc08fe30 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:52.571372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ff5202-18f7-41e4-841b-ffcfbc08fe30 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:52.577886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd8362-d198-44b5-8a15-6ccb6d39f1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:52.578498 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd8362-d198-44b5-8a15-6ccb6d39f1df admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:52.578788 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd8362-d198-44b5-8a15-6ccb6d39f1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:52.579065 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd8362-d198-44b5-8a15-6ccb6d39f1df admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:52.579748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd8362-d198-44b5-8a15-6ccb6d39f1df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:52.581447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd8362-d198-44b5-8a15-6ccb6d39f1df admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:52.596451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1171/2360] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:42:52.601398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796564e7-a3de-4d2c-a9cb-953f693f3e94 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:52.614891 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796564e7-a3de-4d2c-a9cb-953f693f3e94 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:52.620173 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb76e7-80b1-421b-b1f1-e1e0a753e02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:52.621001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb76e7-80b1-421b-b1f1-e1e0a753e02d admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:52.621292 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb76e7-80b1-421b-b1f1-e1e0a753e02d admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:52.621569 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcb76e7-80b1-421b-b1f1-e1e0a753e02d admin admin] PATH_INFO: `/v3/projects/250f165c323d47fe9735576f38a6b7d5/users/197c12df7ff746efb13c5c400a45eb4f/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:52.651586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb76e7-80b1-421b-b1f1-e1e0a753e02d admin admin] RBAC: Authorizing `identity:create_grant(project_id=250f165c323d47fe9735576f38a6b7d5, user_id=197c12df7ff746efb13c5c400a45eb4f, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:52.654490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcb76e7-80b1-421b-b1f1-e1e0a753e02d admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:52.672651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1190/2361] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:42:52 2022] PUT /identity/v3/projects/250f165c323d47fe9735576f38a6b7d5/users/197c12df7ff746efb13c5c400a45eb4f/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:52.677401 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd8362-d198-44b5-8a15-6ccb6d39f1df admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:52.689434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd8362-d198-44b5-8a15-6ccb6d39f1df admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:52.756301 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a657a4de-9f5e-4cd5-b3f5-e060f661f2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:52.757245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657a4de-9f5e-4cd5-b3f5-e060f661f2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:52.757529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657a4de-9f5e-4cd5-b3f5-e060f661f2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:52.757809 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a657a4de-9f5e-4cd5-b3f5-e060f661f2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:52.758480 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657a4de-9f5e-4cd5-b3f5-e060f661f2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:52.760090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a657a4de-9f5e-4cd5-b3f5-e060f661f2a3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:52.772531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1172/2362] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:42:52.776459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb76e7-80b1-421b-b1f1-e1e0a753e02d admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:52.790051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcb76e7-80b1-421b-b1f1-e1e0a753e02d admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:52.794700 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a71eb-7ee4-42b7-aae8-6ee95328fa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:52.795346 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a71eb-7ee4-42b7-aae8-6ee95328fa00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:52.795655 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a71eb-7ee4-42b7-aae8-6ee95328fa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:52.795893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a71eb-7ee4-42b7-aae8-6ee95328fa00 admin admin] PATH_INFO: `/v3/projects/250f165c323d47fe9735576f38a6b7d5/users/197c12df7ff746efb13c5c400a45eb4f/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:52.797930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a71eb-7ee4-42b7-aae8-6ee95328fa00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=250f165c323d47fe9735576f38a6b7d5, user_id=197c12df7ff746efb13c5c400a45eb4f, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:52.800570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a71eb-7ee4-42b7-aae8-6ee95328fa00 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:52.812684 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1191/2363] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:42:52 2022] PUT /identity/v3/projects/250f165c323d47fe9735576f38a6b7d5/users/197c12df7ff746efb13c5c400a45eb4f/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:42:52.822854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38331b94-b5c7-4799-a404-c75099c176d8 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:52.823148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38331b94-b5c7-4799-a404-c75099c176d8 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:52.823424 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38331b94-b5c7-4799-a404-c75099c176d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:52.854489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-38331b94-b5c7-4799-a404-c75099c176d8 None None] MFA Rules not processed for user `197c12df7ff746efb13c5c400a45eb4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:52.855763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-38331b94-b5c7-4799-a404-c75099c176d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:52.861990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:52.956556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1173/2364] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:42:52.964317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a71eb-7ee4-42b7-aae8-6ee95328fa00 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:52.968810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-774a71eb-7ee4-42b7-aae8-6ee95328fa00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:52.980924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:53.049270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a71eb-7ee4-42b7-aae8-6ee95328fa00 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:53.054316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11962b-1f91-4d09-ba59-e8ab8ad17dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:53.055227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11962b-1f91-4d09-ba59-e8ab8ad17dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:53.055717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11962b-1f91-4d09-ba59-e8ab8ad17dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:53.056149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11962b-1f91-4d09-ba59-e8ab8ad17dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:53.067633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11962b-1f91-4d09-ba59-e8ab8ad17dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:53.070194 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11962b-1f91-4d09-ba59-e8ab8ad17dc7 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:53.083638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1192/2365] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:42:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:42:55.131840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38331b94-b5c7-4799-a404-c75099c176d8 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:55.227147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38331b94-b5c7-4799-a404-c75099c176d8 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:55.234522 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39817689-2767-4e13-9bf4-1b4fc92d573e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:55.235235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39817689-2767-4e13-9bf4-1b4fc92d573e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:55.235520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39817689-2767-4e13-9bf4-1b4fc92d573e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:55.235959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39817689-2767-4e13-9bf4-1b4fc92d573e admin admin] PATH_INFO: `/v3/users/9e25e8f317fe4cc1afb997005a660d41` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:55.237311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39817689-2767-4e13-9bf4-1b4fc92d573e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e25e8f317fe4cc1afb997005a660d41)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:55.239800 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39817689-2767-4e13-9bf4-1b4fc92d573e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:55.328258 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-39817689-2767-4e13-9bf4-1b4fc92d573e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e25e8f317fe4cc1afb997005a660d41'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:55.345560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-39817689-2767-4e13-9bf4-1b4fc92d573e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e25e8f317fe4cc1afb997005a660d41'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:55.372843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-39817689-2767-4e13-9bf4-1b4fc92d573e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e25e8f317fe4cc1afb997005a660d41'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:55.385036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-39817689-2767-4e13-9bf4-1b4fc92d573e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e25e8f317fe4cc1afb997005a660d41'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:55.386160 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-39817689-2767-4e13-9bf4-1b4fc92d573e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e25e8f317fe4cc1afb997005a660d41'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:55.398186 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1174/2366] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:42:55 2022] DELETE /identity/v3/users/9e25e8f317fe4cc1afb997005a660d41 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:55.399006 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70fc47-7fa7-4c13-9b81-a7c734618819 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:55.399502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70fc47-7fa7-4c13-9b81-a7c734618819 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:55.399609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70fc47-7fa7-4c13-9b81-a7c734618819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:55.424171 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0f70fc47-7fa7-4c13-9b81-a7c734618819 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:55.425522 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0f70fc47-7fa7-4c13-9b81-a7c734618819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:55.520212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1193/2367] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:42:55.530867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39817689-2767-4e13-9bf4-1b4fc92d573e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:55.532370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-39817689-2767-4e13-9bf4-1b4fc92d573e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:55.567396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:55.619005 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39817689-2767-4e13-9bf4-1b4fc92d573e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:55.623625 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3b496-1179-4373-a10d-2bd010f52b39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:55.624562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3b496-1179-4373-a10d-2bd010f52b39 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:55.625029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3b496-1179-4373-a10d-2bd010f52b39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:55.625480 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3b496-1179-4373-a10d-2bd010f52b39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:55.658972 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3b496-1179-4373-a10d-2bd010f52b39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:55.660833 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d3b496-1179-4373-a10d-2bd010f52b39 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:55.674828 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1175/2368] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:42:56.058234 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70fc47-7fa7-4c13-9b81-a7c734618819 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:56.058234 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0f70fc47-7fa7-4c13-9b81-a7c734618819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:56.077671 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70fc47-7fa7-4c13-9b81-a7c734618819 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:56.092757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:56.093416 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:56.093746 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:56.094022 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19 admin admin] PATH_INFO: `/v3/projects/9c572ff38f664dc0956969d72949b068` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:56.096051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c572ff38f664dc0956969d72949b068)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:56.098144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:56.165168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c572ff38f664dc0956969d72949b068', 'request_id': 'req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:56.184028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c572ff38f664dc0956969d72949b068', 'request_id': 'req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:56.191255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c572ff38f664dc0956969d72949b068', 'request_id': 'req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:56.204763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19 admin admin] The token cache is being invalidate because project 9c572ff38f664dc0956969d72949b068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:42:56.204763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:56.206165 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:56.207561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1194/2369] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:42:56 2022] DELETE /identity/v3/projects/9c572ff38f664dc0956969d72949b068 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:56.211743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3b496-1179-4373-a10d-2bd010f52b39 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:56.223202 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3b496-1179-4373-a10d-2bd010f52b39 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:56.297510 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a0980-6fa6-4b25-abd3-9ed670bbd0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:56.298422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a0980-6fa6-4b25-abd3-9ed670bbd0e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:56.299534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a0980-6fa6-4b25-abd3-9ed670bbd0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:56.300025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a0980-6fa6-4b25-abd3-9ed670bbd0e1 admin admin] PATH_INFO: `/v3/users/197c12df7ff746efb13c5c400a45eb4f` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:56.301965 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a0980-6fa6-4b25-abd3-9ed670bbd0e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=197c12df7ff746efb13c5c400a45eb4f)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:56.304359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a0980-6fa6-4b25-abd3-9ed670bbd0e1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:56.391749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b58a0980-6fa6-4b25-abd3-9ed670bbd0e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '197c12df7ff746efb13c5c400a45eb4f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:56.400472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b58a0980-6fa6-4b25-abd3-9ed670bbd0e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '197c12df7ff746efb13c5c400a45eb4f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:56.421886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b58a0980-6fa6-4b25-abd3-9ed670bbd0e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '197c12df7ff746efb13c5c400a45eb4f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:56.437994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b58a0980-6fa6-4b25-abd3-9ed670bbd0e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '197c12df7ff746efb13c5c400a45eb4f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:56.439072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b58a0980-6fa6-4b25-abd3-9ed670bbd0e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '197c12df7ff746efb13c5c400a45eb4f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:56.448128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1176/2370] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:42:56 2022] DELETE /identity/v3/users/197c12df7ff746efb13c5c400a45eb4f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:42:56.842709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:56.847582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:56.879769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa3761-ea95-4dd2-ba0c-a43ae4842a19 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:56.922473 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:56.957384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698590c6-42e3-4e33-b736-c25fa7efb9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:56.958119 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698590c6-42e3-4e33-b736-c25fa7efb9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:56.958423 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698590c6-42e3-4e33-b736-c25fa7efb9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:56.958699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698590c6-42e3-4e33-b736-c25fa7efb9b3 admin admin] PATH_INFO: `/v3/projects/250f165c323d47fe9735576f38a6b7d5` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:56.959855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698590c6-42e3-4e33-b736-c25fa7efb9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=250f165c323d47fe9735576f38a6b7d5)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:56.961816 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698590c6-42e3-4e33-b736-c25fa7efb9b3 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:57.046034 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-698590c6-42e3-4e33-b736-c25fa7efb9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '250f165c323d47fe9735576f38a6b7d5', 'request_id': 'req-698590c6-42e3-4e33-b736-c25fa7efb9b3'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:57.057709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-698590c6-42e3-4e33-b736-c25fa7efb9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '250f165c323d47fe9735576f38a6b7d5', 'request_id': 'req-698590c6-42e3-4e33-b736-c25fa7efb9b3'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:57.072523 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-698590c6-42e3-4e33-b736-c25fa7efb9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '250f165c323d47fe9735576f38a6b7d5', 'request_id': 'req-698590c6-42e3-4e33-b736-c25fa7efb9b3'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:57.089302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-698590c6-42e3-4e33-b736-c25fa7efb9b3 admin admin] The token cache is being invalidate because project 250f165c323d47fe9735576f38a6b7d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:42:57.089695 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-698590c6-42e3-4e33-b736-c25fa7efb9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:57.092806 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-698590c6-42e3-4e33-b736-c25fa7efb9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:57.094357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1195/2371] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:42:56 2022] DELETE /identity/v3/projects/250f165c323d47fe9735576f38a6b7d5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:57.099944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0cc8a-c9a1-471a-bc8c-e7cc164620b6 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:57.100399 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0cc8a-c9a1-471a-bc8c-e7cc164620b6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:57.100842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff0cc8a-c9a1-471a-bc8c-e7cc164620b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:57.122851 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7ff0cc8a-c9a1-471a-bc8c-e7cc164620b6 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:57.124363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7ff0cc8a-c9a1-471a-bc8c-e7cc164620b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:57.177488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:57.224137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1177/2372] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:42:57.235364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f98917-48ef-4b58-9bac-f09e2eb2ea92 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:57.235652 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f98917-48ef-4b58-9bac-f09e2eb2ea92 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:57.235932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f98917-48ef-4b58-9bac-f09e2eb2ea92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:57.257130 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b1f98917-48ef-4b58-9bac-f09e2eb2ea92 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:57.258350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b1f98917-48ef-4b58-9bac-f09e2eb2ea92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:57.267433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1196/2373] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:42:57.272076 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0cc8a-c9a1-471a-bc8c-e7cc164620b6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:57.293682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff0cc8a-c9a1-471a-bc8c-e7cc164620b6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:57.301257 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd523d8f-2013-4a04-9f4a-d21b36944889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:57.301878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd523d8f-2013-4a04-9f4a-d21b36944889 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:57.302304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd523d8f-2013-4a04-9f4a-d21b36944889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:57.302585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd523d8f-2013-4a04-9f4a-d21b36944889 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:57.303423 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd523d8f-2013-4a04-9f4a-d21b36944889 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:42:57.303551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd523d8f-2013-4a04-9f4a-d21b36944889 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:57.307220 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd523d8f-2013-4a04-9f4a-d21b36944889 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:57.323449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1178/2374] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:42:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:42:57.330068 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f98917-48ef-4b58-9bac-f09e2eb2ea92 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:57.340896 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f98917-48ef-4b58-9bac-f09e2eb2ea92 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:57.346258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc29550-44d5-43a8-a5cb-9ad49aed928f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:57.346868 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc29550-44d5-43a8-a5cb-9ad49aed928f admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:57.347164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc29550-44d5-43a8-a5cb-9ad49aed928f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:57.347667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc29550-44d5-43a8-a5cb-9ad49aed928f admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:57.348247 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc29550-44d5-43a8-a5cb-9ad49aed928f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:57.350394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc29550-44d5-43a8-a5cb-9ad49aed928f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:57.396587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1197/2375] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:42:57 2022] POST /identity/v3/projects => generated 385 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:42:57.401782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd523d8f-2013-4a04-9f4a-d21b36944889 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:57.420552 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd523d8f-2013-4a04-9f4a-d21b36944889 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:57.506360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b81b1-5937-40c3-9115-500179589a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:57.507254 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b81b1-5937-40c3-9115-500179589a52 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:57.507550 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b81b1-5937-40c3-9115-500179589a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:57.507795 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b81b1-5937-40c3-9115-500179589a52 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:57.508436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b81b1-5937-40c3-9115-500179589a52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:57.510390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b81b1-5937-40c3-9115-500179589a52 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:57.546240 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1179/2376] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:42:57 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:42:57.548049 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc29550-44d5-43a8-a5cb-9ad49aed928f admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:57.570423 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc29550-44d5-43a8-a5cb-9ad49aed928f admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:57.580548 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032c519-53ca-44fa-9f8b-771f599edaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:57.582901 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032c519-53ca-44fa-9f8b-771f599edaf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:57.583613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032c519-53ca-44fa-9f8b-771f599edaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:57.583740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6032c519-53ca-44fa-9f8b-771f599edaf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:57.584508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032c519-53ca-44fa-9f8b-771f599edaf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:57.586697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6032c519-53ca-44fa-9f8b-771f599edaf2 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:57.602346 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1198/2377] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:42:57.603538 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b81b1-5937-40c3-9115-500179589a52 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:57.618077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b81b1-5937-40c3-9115-500179589a52 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:57.629395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e24261-1137-434c-a2f5-7f83c77320ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:57.630409 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e24261-1137-434c-a2f5-7f83c77320ab admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:57.630855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e24261-1137-434c-a2f5-7f83c77320ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:57.631292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e24261-1137-434c-a2f5-7f83c77320ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:57.632113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e24261-1137-434c-a2f5-7f83c77320ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:57.633735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e24261-1137-434c-a2f5-7f83c77320ab admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:57.651958 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1180/2378] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:42:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:42:57.652971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032c519-53ca-44fa-9f8b-771f599edaf2 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:57.663752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6032c519-53ca-44fa-9f8b-771f599edaf2 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:57.669720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff179975-2f93-48e5-9956-bd55c0a7a7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:57.670662 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff179975-2f93-48e5-9956-bd55c0a7a7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:57.671114 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff179975-2f93-48e5-9956-bd55c0a7a7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:57.671552 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff179975-2f93-48e5-9956-bd55c0a7a7fe admin admin] PATH_INFO: `/v3/projects/77bfea9e9df24e598c946b3ed038d976/users/076560ffab6640bd97463fe4c16a8683/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:57.689011 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff179975-2f93-48e5-9956-bd55c0a7a7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=77bfea9e9df24e598c946b3ed038d976, user_id=076560ffab6640bd97463fe4c16a8683, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:57.692194 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff179975-2f93-48e5-9956-bd55c0a7a7fe admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:57.724265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1199/2379] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:42:57 2022] PUT /identity/v3/projects/77bfea9e9df24e598c946b3ed038d976/users/076560ffab6640bd97463fe4c16a8683/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:42:57.734846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5ae6c-6b6c-414e-953f-c129034e7784 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:57.736114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5ae6c-6b6c-414e-953f-c129034e7784 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:57.736114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b5ae6c-6b6c-414e-953f-c129034e7784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:57.769643 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-68b5ae6c-6b6c-414e-953f-c129034e7784 None None] MFA Rules not processed for user `076560ffab6640bd97463fe4c16a8683`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:57.771041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-68b5ae6c-6b6c-414e-953f-c129034e7784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:57.852917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1181/2380] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:42:57.857080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff179975-2f93-48e5-9956-bd55c0a7a7fe admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:57.939631 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff179975-2f93-48e5-9956-bd55c0a7a7fe admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:57.945248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d871d56-f8ff-442a-bf25-aa1ef5881ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:57.945981 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d871d56-f8ff-442a-bf25-aa1ef5881ce0 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:57.946367 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d871d56-f8ff-442a-bf25-aa1ef5881ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:57.946763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d871d56-f8ff-442a-bf25-aa1ef5881ce0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:57.947506 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d871d56-f8ff-442a-bf25-aa1ef5881ce0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:57.949591 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d871d56-f8ff-442a-bf25-aa1ef5881ce0 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:57.954968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:57.983904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1200/2381] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:42:57 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:42:57.988913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5ae6c-6b6c-414e-953f-c129034e7784 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:58.010517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b5ae6c-6b6c-414e-953f-c129034e7784 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:58.074579 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:58.097056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79034b2f-8784-48d7-8f06-c846c85ed5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:58.098515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79034b2f-8784-48d7-8f06-c846c85ed5a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:58.098901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79034b2f-8784-48d7-8f06-c846c85ed5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:58.099279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79034b2f-8784-48d7-8f06-c846c85ed5a5 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:58.100056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79034b2f-8784-48d7-8f06-c846c85ed5a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:58.102218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79034b2f-8784-48d7-8f06-c846c85ed5a5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:58.141803 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1182/2382] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:42:57 2022] POST /identity/v3/users => generated 300 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:42:58.142637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d871d56-f8ff-442a-bf25-aa1ef5881ce0 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:58.154595 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d871d56-f8ff-442a-bf25-aa1ef5881ce0 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:58.161789 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1778f-3b4d-4680-81a8-4169fa15d816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:58.162395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1778f-3b4d-4680-81a8-4169fa15d816 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:58.162598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1778f-3b4d-4680-81a8-4169fa15d816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:58.163044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1778f-3b4d-4680-81a8-4169fa15d816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:58.164379 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1778f-3b4d-4680-81a8-4169fa15d816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:58.166310 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1778f-3b4d-4680-81a8-4169fa15d816 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:58.181077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1201/2383] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:42:58.185337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79034b2f-8784-48d7-8f06-c846c85ed5a5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:58.196495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79034b2f-8784-48d7-8f06-c846c85ed5a5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:58.203129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30f98a-8e3e-4e79-9ba6-7da985dc463f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:58.203797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30f98a-8e3e-4e79-9ba6-7da985dc463f admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:58.204084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30f98a-8e3e-4e79-9ba6-7da985dc463f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:58.204356 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f30f98a-8e3e-4e79-9ba6-7da985dc463f admin admin] PATH_INFO: `/v3/projects/f43a50c399474264a604ce5cb60331ec/users/aceeb108f1ad413c86e4b267dcf34a28/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:58.234821 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30f98a-8e3e-4e79-9ba6-7da985dc463f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43a50c399474264a604ce5cb60331ec, user_id=aceeb108f1ad413c86e4b267dcf34a28, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:58.237534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f30f98a-8e3e-4e79-9ba6-7da985dc463f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:58.252922 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1183/2384] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:42:58 2022] PUT /identity/v3/projects/f43a50c399474264a604ce5cb60331ec/users/aceeb108f1ad413c86e4b267dcf34a28/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:58.257169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1778f-3b4d-4680-81a8-4169fa15d816 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:58.268234 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1778f-3b4d-4680-81a8-4169fa15d816 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:58.336924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee9f082-1923-4701-90f2-898b949082e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:58.337545 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9f082-1923-4701-90f2-898b949082e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:58.337829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9f082-1923-4701-90f2-898b949082e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:58.338103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee9f082-1923-4701-90f2-898b949082e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:58.338842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9f082-1923-4701-90f2-898b949082e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:58.340721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee9f082-1923-4701-90f2-898b949082e2 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:58.352905 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1202/2385] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:42:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:42:58.357039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30f98a-8e3e-4e79-9ba6-7da985dc463f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:58.367428 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f30f98a-8e3e-4e79-9ba6-7da985dc463f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:58.372398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11603d1-0b93-428d-87c0-84528d64d506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:58.373151 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11603d1-0b93-428d-87c0-84528d64d506 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:58.373500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11603d1-0b93-428d-87c0-84528d64d506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:58.373841 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11603d1-0b93-428d-87c0-84528d64d506 admin admin] PATH_INFO: `/v3/projects/f43a50c399474264a604ce5cb60331ec/users/aceeb108f1ad413c86e4b267dcf34a28/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:58.375845 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11603d1-0b93-428d-87c0-84528d64d506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f43a50c399474264a604ce5cb60331ec, user_id=aceeb108f1ad413c86e4b267dcf34a28, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:58.378618 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11603d1-0b93-428d-87c0-84528d64d506 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:58.389173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1184/2386] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:42:58 2022] PUT /identity/v3/projects/f43a50c399474264a604ce5cb60331ec/users/aceeb108f1ad413c86e4b267dcf34a28/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:58.400120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bf00c-9290-4808-af6b-830e9f22d033 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:58.400410 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bf00c-9290-4808-af6b-830e9f22d033 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:58.400721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205bf00c-9290-4808-af6b-830e9f22d033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:58.432042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-205bf00c-9290-4808-af6b-830e9f22d033 None None] MFA Rules not processed for user `aceeb108f1ad413c86e4b267dcf34a28`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:58.433314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-205bf00c-9290-4808-af6b-830e9f22d033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:58.504858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1203/2387] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:58 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:42:58.515865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11603d1-0b93-428d-87c0-84528d64d506 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:58.517782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e11603d1-0b93-428d-87c0-84528d64d506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:58.578654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11603d1-0b93-428d-87c0-84528d64d506 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:58.582669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee63001-ae6a-4ed1-ac79-21390f306c55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:58.583310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee63001-ae6a-4ed1-ac79-21390f306c55 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:58.583706 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee63001-ae6a-4ed1-ac79-21390f306c55 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:58.583987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee63001-ae6a-4ed1-ac79-21390f306c55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:58.593547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee63001-ae6a-4ed1-ac79-21390f306c55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:58.595004 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee63001-ae6a-4ed1-ac79-21390f306c55 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:58.605200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1185/2388] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:42:58 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:42:59.268253 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bf00c-9290-4808-af6b-830e9f22d033 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:59.333293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:59.341856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205bf00c-9290-4808-af6b-830e9f22d033 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:59.347260 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b62654-7c31-4151-bd12-e2b0dac667cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:59.348434 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b62654-7c31-4151-bd12-e2b0dac667cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:59.348739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b62654-7c31-4151-bd12-e2b0dac667cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:59.349013 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b62654-7c31-4151-bd12-e2b0dac667cf admin admin] PATH_INFO: `/v3/users/076560ffab6640bd97463fe4c16a8683` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:59.350410 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b62654-7c31-4151-bd12-e2b0dac667cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=076560ffab6640bd97463fe4c16a8683)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:59.352227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b62654-7c31-4151-bd12-e2b0dac667cf admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:59.406720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-91b62654-7c31-4151-bd12-e2b0dac667cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '076560ffab6640bd97463fe4c16a8683'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:59.414571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-91b62654-7c31-4151-bd12-e2b0dac667cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '076560ffab6640bd97463fe4c16a8683'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:59.428313 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-91b62654-7c31-4151-bd12-e2b0dac667cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '076560ffab6640bd97463fe4c16a8683'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:59.429230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-91b62654-7c31-4151-bd12-e2b0dac667cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '076560ffab6640bd97463fe4c16a8683'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:59.438056 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-91b62654-7c31-4151-bd12-e2b0dac667cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '076560ffab6640bd97463fe4c16a8683'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:42:59.444269 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1204/2389] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:42:59 2022] DELETE /identity/v3/users/076560ffab6640bd97463fe4c16a8683 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:42:59.448932 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043e82c-c51c-4235-b356-60aa89eff997 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:59.449461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043e82c-c51c-4235-b356-60aa89eff997 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:59.449569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6043e82c-c51c-4235-b356-60aa89eff997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:59.469568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-6043e82c-c51c-4235-b356-60aa89eff997 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:59.470781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6043e82c-c51c-4235-b356-60aa89eff997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:59.494167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ba14c-6b50-4ddc-88f6-e97cddffb36b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:59.494471 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ba14c-6b50-4ddc-88f6-e97cddffb36b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:59.494753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ba14c-6b50-4ddc-88f6-e97cddffb36b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:59.514132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-fe8ba14c-6b50-4ddc-88f6-e97cddffb36b None None] MFA Rules not processed for user `8505dee31512437ba7b6de3512dcc76a`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:42:59.515391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fe8ba14c-6b50-4ddc-88f6-e97cddffb36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:59.537999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1186/2390] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:42:59.547818 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043e82c-c51c-4235-b356-60aa89eff997 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:59.549403 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6043e82c-c51c-4235-b356-60aa89eff997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:59.570715 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1205/2391] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:42:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:42:59.589178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:42:59.608617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6043e82c-c51c-4235-b356-60aa89eff997 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:59.612285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4c31-8f7b-47d0-b40d-ef9dd948ef4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:59.612982 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4c31-8f7b-47d0-b40d-ef9dd948ef4b service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:59.613271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4c31-8f7b-47d0-b40d-ef9dd948ef4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:59.613547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1c4c31-8f7b-47d0-b40d-ef9dd948ef4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:59.623385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c4c31-8f7b-47d0-b40d-ef9dd948ef4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:59.624870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1c4c31-8f7b-47d0-b40d-ef9dd948ef4b service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:59.635675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1187/2392] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:42:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:42:59.929409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ba14c-6b50-4ddc-88f6-e97cddffb36b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:59.930854 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fe8ba14c-6b50-4ddc-88f6-e97cddffb36b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:59.943634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ba14c-6b50-4ddc-88f6-e97cddffb36b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:59.947196 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42923ba8-6f28-428c-943e-563ed3877242 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:59.947790 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42923ba8-6f28-428c-943e-563ed3877242 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:59.948066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42923ba8-6f28-428c-943e-563ed3877242 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:59.948333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42923ba8-6f28-428c-943e-563ed3877242 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:59.950082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-42923ba8-6f28-428c-943e-563ed3877242 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:59.959863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42923ba8-6f28-428c-943e-563ed3877242 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:59.961311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42923ba8-6f28-428c-943e-563ed3877242 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:42:59.969570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1206/2393] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:42:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:42:59.971486 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4c31-8f7b-47d0-b40d-ef9dd948ef4b service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:42:59.972929 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6e1c4c31-8f7b-47d0-b40d-ef9dd948ef4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:42:59.986281 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1c4c31-8f7b-47d0-b40d-ef9dd948ef4b service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:42:59.991550 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07809560-af3e-4dca-a1fe-f1ff742b9a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:42:59.992131 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07809560-af3e-4dca-a1fe-f1ff742b9a2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:42:59.992408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07809560-af3e-4dca-a1fe-f1ff742b9a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:42:59.992948 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07809560-af3e-4dca-a1fe-f1ff742b9a2c admin admin] PATH_INFO: `/v3/projects/77bfea9e9df24e598c946b3ed038d976` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:42:59.994122 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07809560-af3e-4dca-a1fe-f1ff742b9a2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=77bfea9e9df24e598c946b3ed038d976)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:42:59.996001 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07809560-af3e-4dca-a1fe-f1ff742b9a2c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:00.051769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07809560-af3e-4dca-a1fe-f1ff742b9a2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77bfea9e9df24e598c946b3ed038d976', 'request_id': 'req-07809560-af3e-4dca-a1fe-f1ff742b9a2c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:00.058604 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07809560-af3e-4dca-a1fe-f1ff742b9a2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77bfea9e9df24e598c946b3ed038d976', 'request_id': 'req-07809560-af3e-4dca-a1fe-f1ff742b9a2c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:00.066076 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07809560-af3e-4dca-a1fe-f1ff742b9a2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77bfea9e9df24e598c946b3ed038d976', 'request_id': 'req-07809560-af3e-4dca-a1fe-f1ff742b9a2c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:00.081804 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07809560-af3e-4dca-a1fe-f1ff742b9a2c admin admin] The token cache is being invalidate because project 77bfea9e9df24e598c946b3ed038d976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:43:00.082416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07809560-af3e-4dca-a1fe-f1ff742b9a2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:00.083096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-07809560-af3e-4dca-a1fe-f1ff742b9a2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:00.084608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1188/2394] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:42:59 2022] DELETE /identity/v3/projects/77bfea9e9df24e598c946b3ed038d976 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:00.088540 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42923ba8-6f28-428c-943e-563ed3877242 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:00.103153 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42923ba8-6f28-428c-943e-563ed3877242 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:00.167785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f0ff0-c8e1-4d69-b9da-c01d6f58a33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:00.168762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f0ff0-c8e1-4d69-b9da-c01d6f58a33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:00.169206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f0ff0-c8e1-4d69-b9da-c01d6f58a33f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:00.169641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f0ff0-c8e1-4d69-b9da-c01d6f58a33f admin admin] PATH_INFO: `/v3/users/aceeb108f1ad413c86e4b267dcf34a28` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:00.170983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f0ff0-c8e1-4d69-b9da-c01d6f58a33f admin admin] RBAC: Authorizing `identity:delete_user(user_id=aceeb108f1ad413c86e4b267dcf34a28)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:00.173146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f0ff0-c8e1-4d69-b9da-c01d6f58a33f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:00.179528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:00.233907 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-fb2f0ff0-c8e1-4d69-b9da-c01d6f58a33f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aceeb108f1ad413c86e4b267dcf34a28'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:00.241357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-fb2f0ff0-c8e1-4d69-b9da-c01d6f58a33f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aceeb108f1ad413c86e4b267dcf34a28'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:00.254053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-fb2f0ff0-c8e1-4d69-b9da-c01d6f58a33f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aceeb108f1ad413c86e4b267dcf34a28'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:00.254872 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-fb2f0ff0-c8e1-4d69-b9da-c01d6f58a33f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aceeb108f1ad413c86e4b267dcf34a28'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:00.263501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-fb2f0ff0-c8e1-4d69-b9da-c01d6f58a33f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aceeb108f1ad413c86e4b267dcf34a28'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:00.270961 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1207/2395] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:43:00 2022] DELETE /identity/v3/users/aceeb108f1ad413c86e4b267dcf34a28 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:00.320725 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e12ae-7a40-4776-a1c1-19653044a767 None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:00.321020 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e12ae-7a40-4776-a1c1-19653044a767 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:00.321296 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e12ae-7a40-4776-a1c1-19653044a767 None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:00.322924 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1189/2396] 10.222.0.42 () {54 vars in 961 bytes} [Tue Sep 13 06:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:43:00.328683 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e4793-e4a5-4d88-b0a9-a7a6de0eee41 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:00.328993 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e4793-e4a5-4d88-b0a9-a7a6de0eee41 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:00.329279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e4793-e4a5-4d88-b0a9-a7a6de0eee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:00.351494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b77e4793-e4a5-4d88-b0a9-a7a6de0eee41 None None] MFA Rules not processed for user `b84a23931b60457e865f056352a396d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:00.352841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b77e4793-e4a5-4d88-b0a9-a7a6de0eee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:00.424573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1208/2397] 10.222.0.42 () {58 vars in 1058 bytes} [Tue Sep 13 06:43:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:00.432989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e12ae-7a40-4776-a1c1-19653044a767 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:00.447787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e12ae-7a40-4776-a1c1-19653044a767 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:00.452779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24302114-5ccc-4ed9-af19-14420794b07b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84a23931b60457e865f056352a396d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:00.454012 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24302114-5ccc-4ed9-af19-14420794b07b service placement] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:00.454296 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24302114-5ccc-4ed9-af19-14420794b07b service placement] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:00.454572 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24302114-5ccc-4ed9-af19-14420794b07b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:00.456323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-24302114-5ccc-4ed9-af19-14420794b07b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:00.468923 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24302114-5ccc-4ed9-af19-14420794b07b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:00.470230 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24302114-5ccc-4ed9-af19-14420794b07b service placement] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:00.481500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1190/2398] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:00.589450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e4793-e4a5-4d88-b0a9-a7a6de0eee41 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:00.590913 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b77e4793-e4a5-4d88-b0a9-a7a6de0eee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:00.670522 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e4793-e4a5-4d88-b0a9-a7a6de0eee41 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:00.675263 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c158f94-ab68-4174-bc9d-625e63be69d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:00.676423 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c158f94-ab68-4174-bc9d-625e63be69d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:00.676731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c158f94-ab68-4174-bc9d-625e63be69d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:00.677007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c158f94-ab68-4174-bc9d-625e63be69d8 admin admin] PATH_INFO: `/v3/projects/f43a50c399474264a604ce5cb60331ec` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:00.678124 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c158f94-ab68-4174-bc9d-625e63be69d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f43a50c399474264a604ce5cb60331ec)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:00.680350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c158f94-ab68-4174-bc9d-625e63be69d8 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:00.708622 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:00.732212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-2c158f94-ab68-4174-bc9d-625e63be69d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f43a50c399474264a604ce5cb60331ec', 'request_id': 'req-2c158f94-ab68-4174-bc9d-625e63be69d8'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:00.741918 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-2c158f94-ab68-4174-bc9d-625e63be69d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f43a50c399474264a604ce5cb60331ec', 'request_id': 'req-2c158f94-ab68-4174-bc9d-625e63be69d8'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:00.748320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-2c158f94-ab68-4174-bc9d-625e63be69d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f43a50c399474264a604ce5cb60331ec', 'request_id': 'req-2c158f94-ab68-4174-bc9d-625e63be69d8'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:00.759845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-2c158f94-ab68-4174-bc9d-625e63be69d8 admin admin] The token cache is being invalidate because project f43a50c399474264a604ce5cb60331ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:43:00.760218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-2c158f94-ab68-4174-bc9d-625e63be69d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:00.760805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-2c158f94-ab68-4174-bc9d-625e63be69d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:00.762518 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1209/2399] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:43:00 2022] DELETE /identity/v3/projects/f43a50c399474264a604ce5cb60331ec => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:00.767929 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de810026-c736-4679-945a-dea69071579a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:00.768284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de810026-c736-4679-945a-dea69071579a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:00.768627 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de810026-c736-4679-945a-dea69071579a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:00.789774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-de810026-c736-4679-945a-dea69071579a None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:00.791023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-de810026-c736-4679-945a-dea69071579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:00.854594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1191/2400] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:00.864100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c62298-4fe3-4244-b609-048453849118 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:00.864327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c62298-4fe3-4244-b609-048453849118 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:00.864635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c62298-4fe3-4244-b609-048453849118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:00.884889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-16c62298-4fe3-4244-b609-048453849118 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:00.886120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-16c62298-4fe3-4244-b609-048453849118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:00.894144 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1210/2401] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:00.898379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de810026-c736-4679-945a-dea69071579a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:00.908603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de810026-c736-4679-945a-dea69071579a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:00.914182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8c52f-6911-49ff-8141-9c0fa92ecb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:00.914773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8c52f-6911-49ff-8141-9c0fa92ecb2d admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:00.915050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8c52f-6911-49ff-8141-9c0fa92ecb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:00.915319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a8c52f-6911-49ff-8141-9c0fa92ecb2d admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:00.915985 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8c52f-6911-49ff-8141-9c0fa92ecb2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:43:00.916287 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8c52f-6911-49ff-8141-9c0fa92ecb2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:00.917911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a8c52f-6911-49ff-8141-9c0fa92ecb2d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:00.931636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1192/2402] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:43:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:43:00.935977 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c62298-4fe3-4244-b609-048453849118 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:00.945373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c62298-4fe3-4244-b609-048453849118 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:00.950056 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da5941-79db-4cde-acb8-5db40a7f349d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:00.950650 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da5941-79db-4cde-acb8-5db40a7f349d admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:00.950929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da5941-79db-4cde-acb8-5db40a7f349d admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:00.951201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da5941-79db-4cde-acb8-5db40a7f349d admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:00.951836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da5941-79db-4cde-acb8-5db40a7f349d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:00.953787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da5941-79db-4cde-acb8-5db40a7f349d admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:00.983651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1211/2403] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:43:00 2022] POST /identity/v3/projects => generated 361 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:43:00.988536 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8c52f-6911-49ff-8141-9c0fa92ecb2d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:00.999268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a8c52f-6911-49ff-8141-9c0fa92ecb2d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:01.032195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:01.058426 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656cdc3-312c-46b2-9561-2837d4fd6d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:01.059031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656cdc3-312c-46b2-9561-2837d4fd6d7f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:01.059311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656cdc3-312c-46b2-9561-2837d4fd6d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:01.059584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656cdc3-312c-46b2-9561-2837d4fd6d7f admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:01.060224 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656cdc3-312c-46b2-9561-2837d4fd6d7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:01.062157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656cdc3-312c-46b2-9561-2837d4fd6d7f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:01.082711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1193/2404] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:43:00 2022] POST /identity/v3/users => generated 281 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:43:01.087305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da5941-79db-4cde-acb8-5db40a7f349d admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:01.099457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da5941-79db-4cde-acb8-5db40a7f349d admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:01.109772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022279f8-7243-4408-85c9-cf43edf79aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:01.110497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022279f8-7243-4408-85c9-cf43edf79aea admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:01.110839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022279f8-7243-4408-85c9-cf43edf79aea admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:01.111176 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022279f8-7243-4408-85c9-cf43edf79aea admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:01.111930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022279f8-7243-4408-85c9-cf43edf79aea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:01.114336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022279f8-7243-4408-85c9-cf43edf79aea admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:01.127772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1212/2405] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:43:01.129236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656cdc3-312c-46b2-9561-2837d4fd6d7f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:01.140174 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656cdc3-312c-46b2-9561-2837d4fd6d7f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:01.147191 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8039f964-f620-47ec-9563-a9b7602f2b32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:01.147814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039f964-f620-47ec-9563-a9b7602f2b32 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:01.148155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039f964-f620-47ec-9563-a9b7602f2b32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:01.148362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8039f964-f620-47ec-9563-a9b7602f2b32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:01.149088 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039f964-f620-47ec-9563-a9b7602f2b32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:01.150680 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8039f964-f620-47ec-9563-a9b7602f2b32 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:01.163858 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1194/2406] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:43:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:43:01.168225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022279f8-7243-4408-85c9-cf43edf79aea admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:01.178744 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022279f8-7243-4408-85c9-cf43edf79aea admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:01.183482 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ba09a-6a3b-4ce9-a670-627ff9e5ae4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:01.184156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ba09a-6a3b-4ce9-a670-627ff9e5ae4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:01.184437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ba09a-6a3b-4ce9-a670-627ff9e5ae4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:01.184737 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ba09a-6a3b-4ce9-a670-627ff9e5ae4a admin admin] PATH_INFO: `/v3/projects/41592f7dfb114b1ca7061dbc348f5f09/users/04470bd855f04e0b867802e663179d18/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:01.200417 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ba09a-6a3b-4ce9-a670-627ff9e5ae4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41592f7dfb114b1ca7061dbc348f5f09, user_id=04470bd855f04e0b867802e663179d18, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:01.203107 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02ba09a-6a3b-4ce9-a670-627ff9e5ae4a admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:01.218632 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1213/2407] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:43:01 2022] PUT /identity/v3/projects/41592f7dfb114b1ca7061dbc348f5f09/users/04470bd855f04e0b867802e663179d18/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:01.229928 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80182a8f-d934-4d04-8b77-78e4d2f4662d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:01.230235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80182a8f-d934-4d04-8b77-78e4d2f4662d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:01.230536 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80182a8f-d934-4d04-8b77-78e4d2f4662d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:01.260284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-80182a8f-d934-4d04-8b77-78e4d2f4662d None None] MFA Rules not processed for user `04470bd855f04e0b867802e663179d18`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:01.261690 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-80182a8f-d934-4d04-8b77-78e4d2f4662d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:01.341387 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1195/2408] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:01.379784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ba09a-6a3b-4ce9-a670-627ff9e5ae4a admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:01.381873 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c02ba09a-6a3b-4ce9-a670-627ff9e5ae4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:01.449377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ba09a-6a3b-4ce9-a670-627ff9e5ae4a admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:01.453186 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4960deba-ff6e-4c0c-9a5e-febbbf6eabbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:01.453796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960deba-ff6e-4c0c-9a5e-febbbf6eabbd service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:01.454077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960deba-ff6e-4c0c-9a5e-febbbf6eabbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:01.454349 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4960deba-ff6e-4c0c-9a5e-febbbf6eabbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:01.463411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960deba-ff6e-4c0c-9a5e-febbbf6eabbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:01.464873 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4960deba-ff6e-4c0c-9a5e-febbbf6eabbd service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:01.474342 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1214/2409] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:01.496910 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80182a8f-d934-4d04-8b77-78e4d2f4662d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:01.557127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80182a8f-d934-4d04-8b77-78e4d2f4662d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:01.562187 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8daa7-77df-49aa-a12c-0ac6fb9af15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:01.562759 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8daa7-77df-49aa-a12c-0ac6fb9af15a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:01.563038 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8daa7-77df-49aa-a12c-0ac6fb9af15a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:01.563311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d8daa7-77df-49aa-a12c-0ac6fb9af15a admin admin] PATH_INFO: `/v3/users/04470bd855f04e0b867802e663179d18` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:01.564455 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8daa7-77df-49aa-a12c-0ac6fb9af15a admin admin] RBAC: Authorizing `identity:delete_user(user_id=04470bd855f04e0b867802e663179d18)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:01.566475 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d8daa7-77df-49aa-a12c-0ac6fb9af15a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:01.625671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:01.630523 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a2d8daa7-77df-49aa-a12c-0ac6fb9af15a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04470bd855f04e0b867802e663179d18'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:01.639540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a2d8daa7-77df-49aa-a12c-0ac6fb9af15a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04470bd855f04e0b867802e663179d18'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:01.657445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a2d8daa7-77df-49aa-a12c-0ac6fb9af15a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04470bd855f04e0b867802e663179d18'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:01.666650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a2d8daa7-77df-49aa-a12c-0ac6fb9af15a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04470bd855f04e0b867802e663179d18'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:01.667750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a2d8daa7-77df-49aa-a12c-0ac6fb9af15a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04470bd855f04e0b867802e663179d18'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:01.675068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1196/2410] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:43:01 2022] DELETE /identity/v3/users/04470bd855f04e0b867802e663179d18 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:01.680106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf603016-8b4a-45e9-a86b-9fdb7a3b5497 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:01.680451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf603016-8b4a-45e9-a86b-9fdb7a3b5497 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:01.680847 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf603016-8b4a-45e9-a86b-9fdb7a3b5497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:01.715808 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-cf603016-8b4a-45e9-a86b-9fdb7a3b5497 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:01.718010 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-cf603016-8b4a-45e9-a86b-9fdb7a3b5497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:01.794817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:01.840571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1215/2411] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:01.852875 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8daa7-77df-49aa-a12c-0ac6fb9af15a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:01.855819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a2d8daa7-77df-49aa-a12c-0ac6fb9af15a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:01.930150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d8daa7-77df-49aa-a12c-0ac6fb9af15a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:01.933878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3138aa-bdf3-4284-85d4-7b4e510c903a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:01.934461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3138aa-bdf3-4284-85d4-7b4e510c903a service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:01.934711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3138aa-bdf3-4284-85d4-7b4e510c903a service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:01.934981 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3138aa-bdf3-4284-85d4-7b4e510c903a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:01.945175 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3138aa-bdf3-4284-85d4-7b4e510c903a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:01.946697 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3138aa-bdf3-4284-85d4-7b4e510c903a service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:01.956482 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1197/2412] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:02.365190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf603016-8b4a-45e9-a86b-9fdb7a3b5497 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:02.366398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3138aa-bdf3-4284-85d4-7b4e510c903a service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:02.371844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-cf603016-8b4a-45e9-a86b-9fdb7a3b5497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:02.385505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3138aa-bdf3-4284-85d4-7b4e510c903a service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:02.390382 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee305e7e-504b-4c7f-88ff-f0ddc3329932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:02.393863 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee305e7e-504b-4c7f-88ff-f0ddc3329932 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:02.393863 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee305e7e-504b-4c7f-88ff-f0ddc3329932 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:02.393863 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee305e7e-504b-4c7f-88ff-f0ddc3329932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:02.395732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf603016-8b4a-45e9-a86b-9fdb7a3b5497 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:02.398032 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ee305e7e-504b-4c7f-88ff-f0ddc3329932 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:02.407198 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873997d8-7aab-4581-ae71-3aa686ad4655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:02.407987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873997d8-7aab-4581-ae71-3aa686ad4655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:02.409752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873997d8-7aab-4581-ae71-3aa686ad4655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:02.410101 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873997d8-7aab-4581-ae71-3aa686ad4655 admin admin] PATH_INFO: `/v3/projects/41592f7dfb114b1ca7061dbc348f5f09` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:02.413246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873997d8-7aab-4581-ae71-3aa686ad4655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41592f7dfb114b1ca7061dbc348f5f09)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:02.416406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873997d8-7aab-4581-ae71-3aa686ad4655 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:02.420244 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee305e7e-504b-4c7f-88ff-f0ddc3329932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:02.422667 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee305e7e-504b-4c7f-88ff-f0ddc3329932 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:02.438549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1198/2413] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:02.531783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-873997d8-7aab-4581-ae71-3aa686ad4655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41592f7dfb114b1ca7061dbc348f5f09', 'request_id': 'req-873997d8-7aab-4581-ae71-3aa686ad4655'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:02.545571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-873997d8-7aab-4581-ae71-3aa686ad4655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41592f7dfb114b1ca7061dbc348f5f09', 'request_id': 'req-873997d8-7aab-4581-ae71-3aa686ad4655'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:02.554540 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-873997d8-7aab-4581-ae71-3aa686ad4655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41592f7dfb114b1ca7061dbc348f5f09', 'request_id': 'req-873997d8-7aab-4581-ae71-3aa686ad4655'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:02.577451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-873997d8-7aab-4581-ae71-3aa686ad4655 admin admin] The token cache is being invalidate because project 41592f7dfb114b1ca7061dbc348f5f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:43:02.578476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-873997d8-7aab-4581-ae71-3aa686ad4655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:02.579366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-873997d8-7aab-4581-ae71-3aa686ad4655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:02.584933 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1216/2414] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:43:02 2022] DELETE /identity/v3/projects/41592f7dfb114b1ca7061dbc348f5f09 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:02.588270 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022c7a3-d145-433d-9dd8-649b2d7ceaeb None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:02.588962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022c7a3-d145-433d-9dd8-649b2d7ceaeb None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:02.588962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7022c7a3-d145-433d-9dd8-649b2d7ceaeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:02.618858 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7022c7a3-d145-433d-9dd8-649b2d7ceaeb None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:02.620268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7022c7a3-d145-433d-9dd8-649b2d7ceaeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:02.716877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1199/2415] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:02.734876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71ee00-d81b-4b3c-98c0-faa6a8f48a3e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:02.735168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71ee00-d81b-4b3c-98c0-faa6a8f48a3e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:02.735501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f71ee00-d81b-4b3c-98c0-faa6a8f48a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:02.794199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8f71ee00-d81b-4b3c-98c0-faa6a8f48a3e None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:02.795656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8f71ee00-d81b-4b3c-98c0-faa6a8f48a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:02.808528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1217/2416] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:02.809910 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022c7a3-d145-433d-9dd8-649b2d7ceaeb None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:02.821587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7022c7a3-d145-433d-9dd8-649b2d7ceaeb None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:02.826533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef098c-74da-4837-8354-7289c6c76667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:02.827143 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef098c-74da-4837-8354-7289c6c76667 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:02.827425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef098c-74da-4837-8354-7289c6c76667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:02.827698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef098c-74da-4837-8354-7289c6c76667 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:02.828397 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef098c-74da-4837-8354-7289c6c76667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:43:02.828766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef098c-74da-4837-8354-7289c6c76667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:02.831834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef098c-74da-4837-8354-7289c6c76667 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:02.847239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1200/2417] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:43:02.848510 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71ee00-d81b-4b3c-98c0-faa6a8f48a3e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:02.858618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f71ee00-d81b-4b3c-98c0-faa6a8f48a3e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:02.864455 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd44c6-b1f5-407d-814a-93d2b6d50a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:02.865463 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd44c6-b1f5-407d-814a-93d2b6d50a8f admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:02.865917 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd44c6-b1f5-407d-814a-93d2b6d50a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:02.866495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bd44c6-b1f5-407d-814a-93d2b6d50a8f admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:02.867281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd44c6-b1f5-407d-814a-93d2b6d50a8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:02.871320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bd44c6-b1f5-407d-814a-93d2b6d50a8f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:02.910406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1218/2418] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:43:02 2022] POST /identity/v3/projects => generated 369 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:43:02.915012 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef098c-74da-4837-8354-7289c6c76667 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:02.930538 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef098c-74da-4837-8354-7289c6c76667 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:02.933152 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd44c6-b1f5-407d-814a-93d2b6d50a8f admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:02.935743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-53bd44c6-b1f5-407d-814a-93d2b6d50a8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:03.016469 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:03.041322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bd44c6-b1f5-407d-814a-93d2b6d50a8f admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:03.045386 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cd2da-b6c9-4504-b980-f654ed45db74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:03.046003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd2da-b6c9-4504-b980-f654ed45db74 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:03.046282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd2da-b6c9-4504-b980-f654ed45db74 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:03.046555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46cd2da-b6c9-4504-b980-f654ed45db74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:03.048178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863f544-ff55-4c35-97a9-214fe9ec7957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:03.048454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b46cd2da-b6c9-4504-b980-f654ed45db74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:03.049117 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863f544-ff55-4c35-97a9-214fe9ec7957 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:03.049490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863f544-ff55-4c35-97a9-214fe9ec7957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:03.049938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2863f544-ff55-4c35-97a9-214fe9ec7957 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:03.050805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863f544-ff55-4c35-97a9-214fe9ec7957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:03.053398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2863f544-ff55-4c35-97a9-214fe9ec7957 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:03.065375 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cd2da-b6c9-4504-b980-f654ed45db74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:03.069187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46cd2da-b6c9-4504-b980-f654ed45db74 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:03.085662 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1201/2419] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:43:02 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:43:03.086819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863f544-ff55-4c35-97a9-214fe9ec7957 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:03.096642 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1219/2420] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:43:03.099774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2863f544-ff55-4c35-97a9-214fe9ec7957 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:03.104839 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a3ff6-d92c-4f31-8c45-0e6ff651fd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:03.106216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a3ff6-d92c-4f31-8c45-0e6ff651fd5b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:03.106615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a3ff6-d92c-4f31-8c45-0e6ff651fd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:03.106990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23a3ff6-d92c-4f31-8c45-0e6ff651fd5b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:03.107900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a3ff6-d92c-4f31-8c45-0e6ff651fd5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:03.109758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23a3ff6-d92c-4f31-8c45-0e6ff651fd5b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:03.127521 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1202/2421] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:43:03.132755 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cd2da-b6c9-4504-b980-f654ed45db74 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:03.152131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46cd2da-b6c9-4504-b980-f654ed45db74 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:03.163259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cf286-44bf-41ae-8089-7bc12e90ff41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:03.166337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cf286-44bf-41ae-8089-7bc12e90ff41 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:03.166878 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cf286-44bf-41ae-8089-7bc12e90ff41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:03.167796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cf286-44bf-41ae-8089-7bc12e90ff41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:03.170649 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cf286-44bf-41ae-8089-7bc12e90ff41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:03.177257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3cf286-44bf-41ae-8089-7bc12e90ff41 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:03.200987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1220/2422] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:43:03.203243 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a3ff6-d92c-4f31-8c45-0e6ff651fd5b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:03.217113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23a3ff6-d92c-4f31-8c45-0e6ff651fd5b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:03.223015 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79025f-ccbe-4c62-b423-7c83b9ef6ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:03.224037 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79025f-ccbe-4c62-b423-7c83b9ef6ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:03.224429 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79025f-ccbe-4c62-b423-7c83b9ef6ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:03.225000 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79025f-ccbe-4c62-b423-7c83b9ef6ffe admin admin] PATH_INFO: `/v3/projects/7045363a6e834d9a910878d9ac5ff75a/users/f26e6e849c634599ab3d01d8e8ccc4ff/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:03.248819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79025f-ccbe-4c62-b423-7c83b9ef6ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7045363a6e834d9a910878d9ac5ff75a, user_id=f26e6e849c634599ab3d01d8e8ccc4ff, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:03.254151 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79025f-ccbe-4c62-b423-7c83b9ef6ffe admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:03.291067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1203/2423] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:43:03 2022] PUT /identity/v3/projects/7045363a6e834d9a910878d9ac5ff75a/users/f26e6e849c634599ab3d01d8e8ccc4ff/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:03.291745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380b734-1417-4d2e-9d47-f2129f59c42a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:03.292211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380b734-1417-4d2e-9d47-f2129f59c42a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:03.292522 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4380b734-1417-4d2e-9d47-f2129f59c42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:03.344003 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-4380b734-1417-4d2e-9d47-f2129f59c42a None None] MFA Rules not processed for user `f26e6e849c634599ab3d01d8e8ccc4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:03.345672 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4380b734-1417-4d2e-9d47-f2129f59c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:03.374703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:03.422946 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1221/2424] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:03 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:03.436274 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79025f-ccbe-4c62-b423-7c83b9ef6ffe admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:03.438308 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ef79025f-ccbe-4c62-b423-7c83b9ef6ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:03.510367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79025f-ccbe-4c62-b423-7c83b9ef6ffe admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:03.514179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01aa92-5b4c-4f6d-b225-269484dd338f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:03.514785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01aa92-5b4c-4f6d-b225-269484dd338f service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:03.515066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01aa92-5b4c-4f6d-b225-269484dd338f service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:03.515343 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01aa92-5b4c-4f6d-b225-269484dd338f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:03.525315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01aa92-5b4c-4f6d-b225-269484dd338f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:03.526876 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01aa92-5b4c-4f6d-b225-269484dd338f service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:03.536696 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1204/2425] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:05.984270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf83061-f66f-47fb-8c9f-75487cc2ac3d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:05.984804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf83061-f66f-47fb-8c9f-75487cc2ac3d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:05.984978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf83061-f66f-47fb-8c9f-75487cc2ac3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:06.005432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9bf83061-f66f-47fb-8c9f-75487cc2ac3d None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:06.006638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9bf83061-f66f-47fb-8c9f-75487cc2ac3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:06.062487 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1222/2426] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 13 06:43:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:06.074683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01aa92-5b4c-4f6d-b225-269484dd338f service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:06.076079 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7a01aa92-5b4c-4f6d-b225-269484dd338f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:06.147378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01aa92-5b4c-4f6d-b225-269484dd338f service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:06.152514 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ab575-16d3-4699-b4e5-09c98955fae6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:06.153148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ab575-16d3-4699-b4e5-09c98955fae6 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:06.153427 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ab575-16d3-4699-b4e5-09c98955fae6 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:06.153700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ab575-16d3-4699-b4e5-09c98955fae6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:06.162765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ab575-16d3-4699-b4e5-09c98955fae6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:06.164329 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ab575-16d3-4699-b4e5-09c98955fae6 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:06.173610 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1205/2427] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:43:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 06:43:06.633440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf83061-f66f-47fb-8c9f-75487cc2ac3d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:06.839157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf83061-f66f-47fb-8c9f-75487cc2ac3d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:06.858343 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6e34c-8f76-47ec-82ec-1ad0cee9e5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:06.858989 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6e34c-8f76-47ec-82ec-1ad0cee9e5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:06.859265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6e34c-8f76-47ec-82ec-1ad0cee9e5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:06.859536 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6e34c-8f76-47ec-82ec-1ad0cee9e5cc admin admin] PATH_INFO: `/v3/users/f26e6e849c634599ab3d01d8e8ccc4ff` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:06.860683 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6e34c-8f76-47ec-82ec-1ad0cee9e5cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f26e6e849c634599ab3d01d8e8ccc4ff)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:06.862666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a6e34c-8f76-47ec-82ec-1ad0cee9e5cc admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:06.923909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-19a6e34c-8f76-47ec-82ec-1ad0cee9e5cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f26e6e849c634599ab3d01d8e8ccc4ff'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:06.935686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-19a6e34c-8f76-47ec-82ec-1ad0cee9e5cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f26e6e849c634599ab3d01d8e8ccc4ff'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:06.950924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-19a6e34c-8f76-47ec-82ec-1ad0cee9e5cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f26e6e849c634599ab3d01d8e8ccc4ff'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:06.951667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-19a6e34c-8f76-47ec-82ec-1ad0cee9e5cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f26e6e849c634599ab3d01d8e8ccc4ff'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:06.953608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:06.965709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-19a6e34c-8f76-47ec-82ec-1ad0cee9e5cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f26e6e849c634599ab3d01d8e8ccc4ff'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:06.975839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1223/2428] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:43:06 2022] DELETE /identity/v3/users/f26e6e849c634599ab3d01d8e8ccc4ff => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:06.980790 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463b3e8-61ea-41f5-bd47-00e0e0ea8759 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:06.981158 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463b3e8-61ea-41f5-bd47-00e0e0ea8759 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:06.981497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463b3e8-61ea-41f5-bd47-00e0e0ea8759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:07.003662 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5463b3e8-61ea-41f5-bd47-00e0e0ea8759 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:07.005048 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5463b3e8-61ea-41f5-bd47-00e0e0ea8759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:07.028946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:07.078292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1206/2429] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:07.089643 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6e34c-8f76-47ec-82ec-1ad0cee9e5cc admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:07.091252 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-19a6e34c-8f76-47ec-82ec-1ad0cee9e5cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:07.177120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6e34c-8f76-47ec-82ec-1ad0cee9e5cc admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:07.181864 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d6918-0a10-4d62-ac81-64abd1a1c35d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:07.182532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6918-0a10-4d62-ac81-64abd1a1c35d service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:07.182811 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6918-0a10-4d62-ac81-64abd1a1c35d service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:07.183098 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d6918-0a10-4d62-ac81-64abd1a1c35d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:07.193591 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d6918-0a10-4d62-ac81-64abd1a1c35d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:07.195029 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d6918-0a10-4d62-ac81-64abd1a1c35d service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:07.216903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1224/2430] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:43:07.643781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463b3e8-61ea-41f5-bd47-00e0e0ea8759 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:07.646027 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5463b3e8-61ea-41f5-bd47-00e0e0ea8759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:07.675163 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463b3e8-61ea-41f5-bd47-00e0e0ea8759 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:07.680090 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa7ad8-2dd9-4cda-b297-5d52660b8bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:07.680770 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa7ad8-2dd9-4cda-b297-5d52660b8bd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:07.681056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa7ad8-2dd9-4cda-b297-5d52660b8bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:07.681396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa7ad8-2dd9-4cda-b297-5d52660b8bd2 admin admin] PATH_INFO: `/v3/projects/7045363a6e834d9a910878d9ac5ff75a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:07.682594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa7ad8-2dd9-4cda-b297-5d52660b8bd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7045363a6e834d9a910878d9ac5ff75a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:07.684610 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa7ad8-2dd9-4cda-b297-5d52660b8bd2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:07.748454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0daa7ad8-2dd9-4cda-b297-5d52660b8bd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7045363a6e834d9a910878d9ac5ff75a', 'request_id': 'req-0daa7ad8-2dd9-4cda-b297-5d52660b8bd2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:07.765206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0daa7ad8-2dd9-4cda-b297-5d52660b8bd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7045363a6e834d9a910878d9ac5ff75a', 'request_id': 'req-0daa7ad8-2dd9-4cda-b297-5d52660b8bd2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:07.778893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0daa7ad8-2dd9-4cda-b297-5d52660b8bd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7045363a6e834d9a910878d9ac5ff75a', 'request_id': 'req-0daa7ad8-2dd9-4cda-b297-5d52660b8bd2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:07.796896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0daa7ad8-2dd9-4cda-b297-5d52660b8bd2 admin admin] The token cache is being invalidate because project 7045363a6e834d9a910878d9ac5ff75a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:43:07.797395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0daa7ad8-2dd9-4cda-b297-5d52660b8bd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:07.798377 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0daa7ad8-2dd9-4cda-b297-5d52660b8bd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:07.803839 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1207/2431] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:43:07 2022] DELETE /identity/v3/projects/7045363a6e834d9a910878d9ac5ff75a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:07.807369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057db50-0057-4c5b-bbce-c462c73189e2 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:07.807369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057db50-0057-4c5b-bbce-c462c73189e2 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:07.807369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5057db50-0057-4c5b-bbce-c462c73189e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:07.840195 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-5057db50-0057-4c5b-bbce-c462c73189e2 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:07.842128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5057db50-0057-4c5b-bbce-c462c73189e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:07.966151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1225/2432] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:07.974301 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bee86-4fc2-44fd-9947-0e6c5048f9bd None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:07.974587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bee86-4fc2-44fd-9947-0e6c5048f9bd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:07.974865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bee86-4fc2-44fd-9947-0e6c5048f9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:07.995795 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ed6bee86-4fc2-44fd-9947-0e6c5048f9bd None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:07.997062 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ed6bee86-4fc2-44fd-9947-0e6c5048f9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:08.005943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1208/2433] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:08.010065 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057db50-0057-4c5b-bbce-c462c73189e2 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:08.020524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5057db50-0057-4c5b-bbce-c462c73189e2 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:08.025291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd515f09-1873-4ac6-941c-6f0b579adaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:08.025898 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd515f09-1873-4ac6-941c-6f0b579adaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:08.026179 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd515f09-1873-4ac6-941c-6f0b579adaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:08.026453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd515f09-1873-4ac6-941c-6f0b579adaf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:08.027171 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd515f09-1873-4ac6-941c-6f0b579adaf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:43:08.027562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd515f09-1873-4ac6-941c-6f0b579adaf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:08.029213 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd515f09-1873-4ac6-941c-6f0b579adaf3 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:08.041539 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1226/2434] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:43:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:43:08.045944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bee86-4fc2-44fd-9947-0e6c5048f9bd None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:08.056096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bee86-4fc2-44fd-9947-0e6c5048f9bd None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:08.061118 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530e71a-b290-4997-b5a1-72ac821d4c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:08.061736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530e71a-b290-4997-b5a1-72ac821d4c2d admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:08.062019 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530e71a-b290-4997-b5a1-72ac821d4c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:08.062293 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7530e71a-b290-4997-b5a1-72ac821d4c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:08.062943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530e71a-b290-4997-b5a1-72ac821d4c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:08.064899 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7530e71a-b290-4997-b5a1-72ac821d4c2d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:08.102951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1209/2435] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:43:08 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:43:08.107284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd515f09-1873-4ac6-941c-6f0b579adaf3 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:08.118154 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd515f09-1873-4ac6-941c-6f0b579adaf3 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:08.178269 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2cca8-7491-4e64-ad8f-f32873d0ae22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:08.178880 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2cca8-7491-4e64-ad8f-f32873d0ae22 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:08.179161 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2cca8-7491-4e64-ad8f-f32873d0ae22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:08.179432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f2cca8-7491-4e64-ad8f-f32873d0ae22 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:08.180072 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2cca8-7491-4e64-ad8f-f32873d0ae22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:08.182031 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f2cca8-7491-4e64-ad8f-f32873d0ae22 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:08.204526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1227/2436] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:43:08 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:43:08.209401 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530e71a-b290-4997-b5a1-72ac821d4c2d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:08.221176 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7530e71a-b290-4997-b5a1-72ac821d4c2d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:08.226955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eada008-4ff6-4808-bd67-331a0917e547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:08.227763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eada008-4ff6-4808-bd67-331a0917e547 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:08.228366 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eada008-4ff6-4808-bd67-331a0917e547 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:08.228838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eada008-4ff6-4808-bd67-331a0917e547 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:08.229705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eada008-4ff6-4808-bd67-331a0917e547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:08.231571 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eada008-4ff6-4808-bd67-331a0917e547 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:08.243868 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1210/2437] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:43:08.247753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2cca8-7491-4e64-ad8f-f32873d0ae22 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:08.259936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f2cca8-7491-4e64-ad8f-f32873d0ae22 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:08.264571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd8ad6-dd1e-4cc7-a7b3-b3865285a45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:08.265230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd8ad6-dd1e-4cc7-a7b3-b3865285a45f admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:08.265511 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd8ad6-dd1e-4cc7-a7b3-b3865285a45f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:08.265780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd8ad6-dd1e-4cc7-a7b3-b3865285a45f admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:08.266449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd8ad6-dd1e-4cc7-a7b3-b3865285a45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:08.268040 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd8ad6-dd1e-4cc7-a7b3-b3865285a45f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:08.273478 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:08.279634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1228/2438] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:43:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:43:08.282922 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eada008-4ff6-4808-bd67-331a0917e547 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:08.294012 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eada008-4ff6-4808-bd67-331a0917e547 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:08.298928 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e5a4d-346b-4854-94e9-bceaeb71f198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:08.299527 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e5a4d-346b-4854-94e9-bceaeb71f198 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:08.299810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e5a4d-346b-4854-94e9-bceaeb71f198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:08.300140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7e5a4d-346b-4854-94e9-bceaeb71f198 admin admin] PATH_INFO: `/v3/projects/6aa9ceb278524f1a9ab85583f1d741b9/users/98451efd61e44eec876701952375f788/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:08.316394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e5a4d-346b-4854-94e9-bceaeb71f198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa9ceb278524f1a9ab85583f1d741b9, user_id=98451efd61e44eec876701952375f788, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:08.319133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7e5a4d-346b-4854-94e9-bceaeb71f198 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:08.332130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1211/2439] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:43:08 2022] PUT /identity/v3/projects/6aa9ceb278524f1a9ab85583f1d741b9/users/98451efd61e44eec876701952375f788/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:08.337238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dffb8-19bb-42f4-9346-54ceacc91cab None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:08.337527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dffb8-19bb-42f4-9346-54ceacc91cab None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:08.337805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925dffb8-19bb-42f4-9346-54ceacc91cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:08.360510 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-925dffb8-19bb-42f4-9346-54ceacc91cab None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:08.361948 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-925dffb8-19bb-42f4-9346-54ceacc91cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:08.426451 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1229/2440] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:08.437076 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e5a4d-346b-4854-94e9-bceaeb71f198 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:08.438829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6c7e5a4d-346b-4854-94e9-bceaeb71f198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:08.496639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:08.508511 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7e5a4d-346b-4854-94e9-bceaeb71f198 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:08.516769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0949e-7c0e-4454-9d81-972e84ed2100 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:08.517746 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0949e-7c0e-4454-9d81-972e84ed2100 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:08.518235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0949e-7c0e-4454-9d81-972e84ed2100 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:08.518653 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a0949e-7c0e-4454-9d81-972e84ed2100 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:08.529494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0949e-7c0e-4454-9d81-972e84ed2100 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:08.531100 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a0949e-7c0e-4454-9d81-972e84ed2100 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:08.544716 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1212/2441] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:14.858736 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2e651-7294-45ff-a37a-45dae2c3dda6 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:14.859397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2e651-7294-45ff-a37a-45dae2c3dda6 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:14.859397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a2e651-7294-45ff-a37a-45dae2c3dda6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:14.888884 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e1a2e651-7294-45ff-a37a-45dae2c3dda6 None None] MFA Rules not processed for user `98451efd61e44eec876701952375f788`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:14.890107 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e1a2e651-7294-45ff-a37a-45dae2c3dda6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:14.965274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1230/2442] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:14.969843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0949e-7c0e-4454-9d81-972e84ed2100 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:14.980533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a0949e-7c0e-4454-9d81-972e84ed2100 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:14.985499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9497c-d466-4831-bdec-6c520312333f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:14.986098 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9497c-d466-4831-bdec-6c520312333f admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:14.986385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9497c-d466-4831-bdec-6c520312333f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:14.986658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd9497c-d466-4831-bdec-6c520312333f admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:14.987303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9497c-d466-4831-bdec-6c520312333f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:14.989262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd9497c-d466-4831-bdec-6c520312333f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:15.025587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1213/2443] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:43:14 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:43:15.030023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2e651-7294-45ff-a37a-45dae2c3dda6 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:15.052445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a2e651-7294-45ff-a37a-45dae2c3dda6 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:15.137133 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62159cb-edcd-4a11-ada1-270c11bd842e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:15.137759 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62159cb-edcd-4a11-ada1-270c11bd842e admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:15.138097 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62159cb-edcd-4a11-ada1-270c11bd842e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:15.138380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62159cb-edcd-4a11-ada1-270c11bd842e admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:15.139105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62159cb-edcd-4a11-ada1-270c11bd842e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:15.141230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62159cb-edcd-4a11-ada1-270c11bd842e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:15.180753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1231/2444] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:43:15 2022] POST /identity/v3/users => generated 299 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:43:15.185347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9497c-d466-4831-bdec-6c520312333f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:15.201033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd9497c-d466-4831-bdec-6c520312333f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:15.205888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf379372-64d6-46f0-a811-f895bb400f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:15.206541 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf379372-64d6-46f0-a811-f895bb400f81 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:15.206826 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf379372-64d6-46f0-a811-f895bb400f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:15.207103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf379372-64d6-46f0-a811-f895bb400f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:15.207748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf379372-64d6-46f0-a811-f895bb400f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:15.211602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf379372-64d6-46f0-a811-f895bb400f81 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:15.227166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1214/2445] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:43:15.231691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62159cb-edcd-4a11-ada1-270c11bd842e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:15.246864 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62159cb-edcd-4a11-ada1-270c11bd842e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:15.251685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770802b-26d0-4459-aaac-fe9578877704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:15.252469 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770802b-26d0-4459-aaac-fe9578877704 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:15.252791 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770802b-26d0-4459-aaac-fe9578877704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:15.253093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e770802b-26d0-4459-aaac-fe9578877704 admin admin] PATH_INFO: `/v3/projects/24966c1db0004b29bfc66dff08e73809/users/f8fdbda28a4d48f08f3632396e56ae13/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:15.277283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770802b-26d0-4459-aaac-fe9578877704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24966c1db0004b29bfc66dff08e73809, user_id=f8fdbda28a4d48f08f3632396e56ae13, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:15.280226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e770802b-26d0-4459-aaac-fe9578877704 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:15.284197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:15.297248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1232/2446] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:43:15 2022] PUT /identity/v3/projects/24966c1db0004b29bfc66dff08e73809/users/f8fdbda28a4d48f08f3632396e56ae13/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:15.302100 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf379372-64d6-46f0-a811-f895bb400f81 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:15.314196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf379372-64d6-46f0-a811-f895bb400f81 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:15.375504 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4ce623-4e53-443f-8b2b-ea3920a061cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:15.376141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ce623-4e53-443f-8b2b-ea3920a061cf admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:15.376406 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ce623-4e53-443f-8b2b-ea3920a061cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:15.376702 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4ce623-4e53-443f-8b2b-ea3920a061cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:15.377388 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ce623-4e53-443f-8b2b-ea3920a061cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:15.379135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4ce623-4e53-443f-8b2b-ea3920a061cf admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:15.399620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1215/2447] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:43:15.401599 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770802b-26d0-4459-aaac-fe9578877704 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:15.412913 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e770802b-26d0-4459-aaac-fe9578877704 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:15.417774 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05501432-2b7b-4fbc-b0d7-d60dd6cb47fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:15.418595 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501432-2b7b-4fbc-b0d7-d60dd6cb47fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:15.418936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501432-2b7b-4fbc-b0d7-d60dd6cb47fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:15.419967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05501432-2b7b-4fbc-b0d7-d60dd6cb47fe admin admin] PATH_INFO: `/v3/projects/24966c1db0004b29bfc66dff08e73809/users/f8fdbda28a4d48f08f3632396e56ae13/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:15.421329 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05501432-2b7b-4fbc-b0d7-d60dd6cb47fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=24966c1db0004b29bfc66dff08e73809, user_id=f8fdbda28a4d48f08f3632396e56ae13, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:15.424110 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05501432-2b7b-4fbc-b0d7-d60dd6cb47fe admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:15.436242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1233/2448] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:43:15 2022] PUT /identity/v3/projects/24966c1db0004b29bfc66dff08e73809/users/f8fdbda28a4d48f08f3632396e56ae13/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:21.091737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2995bb-06d1-495a-b539-0df8cfd5dfa5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:21.092766 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2995bb-06d1-495a-b539-0df8cfd5dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:21.093050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2995bb-06d1-495a-b539-0df8cfd5dfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:21.137495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2e2995bb-06d1-495a-b539-0df8cfd5dfa5 None None] MFA Rules not processed for user `f8fdbda28a4d48f08f3632396e56ae13`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:21.141080 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2e2995bb-06d1-495a-b539-0df8cfd5dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:21.310288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fe498-dce6-4ed4-bad7-1060b491aaf2 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:21.312399 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fe498-dce6-4ed4-bad7-1060b491aaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:21.312948 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24fe498-dce6-4ed4-bad7-1060b491aaf2 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:21.316209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1234/2449] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 13 06:43:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:43:21.323498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472cf7-d411-4feb-bf88-948c4706ae93 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:21.324108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472cf7-d411-4feb-bf88-948c4706ae93 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:21.324988 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df472cf7-d411-4feb-bf88-948c4706ae93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:21.329245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1216/2450] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:21 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:21.344272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2995bb-06d1-495a-b539-0df8cfd5dfa5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:21.347155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2e2995bb-06d1-495a-b539-0df8cfd5dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:21.377995 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-df472cf7-d411-4feb-bf88-948c4706ae93 None None] MFA Rules not processed for user `a5efc921a219444bb0b45e8b4d08dcc5`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:21.379265 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-df472cf7-d411-4feb-bf88-948c4706ae93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:21.450532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:21.483915 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2995bb-06d1-495a-b539-0df8cfd5dfa5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:21.497217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8b14e6-4a69-47d3-8089-6eb969e19a95 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc0c92f881e40c9abe067d3a6d4251b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:21.497782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b14e6-4a69-47d3-8089-6eb969e19a95 service glance] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:21.499802 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b14e6-4a69-47d3-8089-6eb969e19a95 service glance] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:21.500091 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b14e6-4a69-47d3-8089-6eb969e19a95 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:21.504232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1235/2451] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 13 06:43:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:21.530253 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472cf7-d411-4feb-bf88-948c4706ae93 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:21.552132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df472cf7-d411-4feb-bf88-948c4706ae93 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:21.566329 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b589bc-460d-421d-baab-bf271eaccb8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:21.566983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b589bc-460d-421d-baab-bf271eaccb8c service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:21.567248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b589bc-460d-421d-baab-bf271eaccb8c service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:21.567520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b589bc-460d-421d-baab-bf271eaccb8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:21.589563 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b589bc-460d-421d-baab-bf271eaccb8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:21.591282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b589bc-460d-421d-baab-bf271eaccb8c service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:21.602052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1236/2452] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:43:21.602883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b589bc-460d-421d-baab-bf271eaccb8c service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:21.610487 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a5b589bc-460d-421d-baab-bf271eaccb8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:21.646320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b14e6-4a69-47d3-8089-6eb969e19a95 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:21.651512 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8b14e6-4a69-47d3-8089-6eb969e19a95 service glance] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:21.663974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1217/2453] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:21.725150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf661c-a5d9-4607-8af0-a9f634c460ac None None] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:21.725437 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf661c-a5d9-4607-8af0-a9f634c460ac None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:21.725718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf661c-a5d9-4607-8af0-a9f634c460ac None None] PATH_INFO: `/` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:21.727490 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1218/2454] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 13 06:43:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:43:21.733914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f0a3c-2808-4e9d-9726-a8b0642dd4e4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:21.735519 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f0a3c-2808-4e9d-9726-a8b0642dd4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:21.739789 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f0a3c-2808-4e9d-9726-a8b0642dd4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:21.768159 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3e6f0a3c-2808-4e9d-9726-a8b0642dd4e4 None None] MFA Rules not processed for user `7fbb67072ba544e39073787eb25fcf1e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:21.771524 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3e6f0a3c-2808-4e9d-9726-a8b0642dd4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:21.790324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1219/2455] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 13 06:43:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:43:21.798166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f0a3c-2808-4e9d-9726-a8b0642dd4e4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:21.800853 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3e6f0a3c-2808-4e9d-9726-a8b0642dd4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:21.803626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b589bc-460d-421d-baab-bf271eaccb8c service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:21.814936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e97ca9-40df-4e07-9058-acd8cc15e20c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:21.815612 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e97ca9-40df-4e07-9058-acd8cc15e20c service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:21.815885 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e97ca9-40df-4e07-9058-acd8cc15e20c service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:21.816152 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e97ca9-40df-4e07-9058-acd8cc15e20c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:21.821155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f0a3c-2808-4e9d-9726-a8b0642dd4e4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:21.822779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-68e97ca9-40df-4e07-9058-acd8cc15e20c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:21.826724 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44ecf0-78b1-40a7-935c-d930959a631e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:21.827716 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44ecf0-78b1-40a7-935c-d930959a631e service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:21.828159 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44ecf0-78b1-40a7-935c-d930959a631e service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:21.828655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d44ecf0-78b1-40a7-935c-d930959a631e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:21.845246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44ecf0-78b1-40a7-935c-d930959a631e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:21.848037 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d44ecf0-78b1-40a7-935c-d930959a631e service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:21.856688 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e97ca9-40df-4e07-9058-acd8cc15e20c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:21.858500 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e97ca9-40df-4e07-9058-acd8cc15e20c service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:21.868584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1220/2456] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:21.870848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1237/2457] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:21.890732 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44ecf0-78b1-40a7-935c-d930959a631e service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:21.898002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1d44ecf0-78b1-40a7-935c-d930959a631e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:21.930388 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d44ecf0-78b1-40a7-935c-d930959a631e service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:21.947443 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e0fba-7589-4d7f-9f2d-2826acfffbdd None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:21.956431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e0fba-7589-4d7f-9f2d-2826acfffbdd None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:21.956431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e0fba-7589-4d7f-9f2d-2826acfffbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:21.970667 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab30ad0-472b-4ab6-b805-19997461e949 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:21.971386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab30ad0-472b-4ab6-b805-19997461e949 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:21.971809 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab30ad0-472b-4ab6-b805-19997461e949 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:21.972457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab30ad0-472b-4ab6-b805-19997461e949 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:22.002316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-dab30ad0-472b-4ab6-b805-19997461e949 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:22.008757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-7d2e0fba-7589-4d7f-9f2d-2826acfffbdd None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:22.008757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-7d2e0fba-7589-4d7f-9f2d-2826acfffbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:22.052167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab30ad0-472b-4ab6-b805-19997461e949 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:22.057540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab30ad0-472b-4ab6-b805-19997461e949 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:22.126425 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1221/2458] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:22.149361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1238/2459] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 13 06:43:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:22.165052 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab30ad0-472b-4ab6-b805-19997461e949 service nova] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:22.166757 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-dab30ad0-472b-4ab6-b805-19997461e949 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:22.414037 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab30ad0-472b-4ab6-b805-19997461e949 service nova] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:22.429588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c216f4a-ca66-42a2-ae68-764ede1270e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:22.430041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c216f4a-ca66-42a2-ae68-764ede1270e2 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:22.430324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c216f4a-ca66-42a2-ae68-764ede1270e2 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:22.430601 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c216f4a-ca66-42a2-ae68-764ede1270e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:22.449416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c216f4a-ca66-42a2-ae68-764ede1270e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:22.451113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c216f4a-ca66-42a2-ae68-764ede1270e2 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:22.501319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1222/2460] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:43:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 06:43:24.069149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73dc96-c790-42db-a6f7-baba9c0beb39 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:24.069719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73dc96-c790-42db-a6f7-baba9c0beb39 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:24.069719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73dc96-c790-42db-a6f7-baba9c0beb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:24.098473 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-da73dc96-c790-42db-a6f7-baba9c0beb39 None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:24.099893 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-da73dc96-c790-42db-a6f7-baba9c0beb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:24.108048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1239/2461] 10.222.0.42 () {58 vars in 967 bytes} [Tue Sep 13 06:43:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:24.129958 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c216f4a-ca66-42a2-ae68-764ede1270e2 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:24.145581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c216f4a-ca66-42a2-ae68-764ede1270e2 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:24.158533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b60ea2-7ade-4cc9-b0e7-398aeddc8e65 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:24.160642 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b60ea2-7ade-4cc9-b0e7-398aeddc8e65 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:24.161202 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b60ea2-7ade-4cc9-b0e7-398aeddc8e65 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:24.162359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b60ea2-7ade-4cc9-b0e7-398aeddc8e65 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:24.185960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b60ea2-7ade-4cc9-b0e7-398aeddc8e65 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:24.187916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b60ea2-7ade-4cc9-b0e7-398aeddc8e65 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:24.209051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1223/2462] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:43:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 06:43:24.490821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73dc96-c790-42db-a6f7-baba9c0beb39 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:24.510641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:24.528133 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73dc96-c790-42db-a6f7-baba9c0beb39 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:24.540566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87221fa6-3654-40a9-9fd8-9ac310ecf3e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:24.541218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87221fa6-3654-40a9-9fd8-9ac310ecf3e2 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:24.541499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87221fa6-3654-40a9-9fd8-9ac310ecf3e2 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:24.541769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87221fa6-3654-40a9-9fd8-9ac310ecf3e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:24.558317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-87221fa6-3654-40a9-9fd8-9ac310ecf3e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:24.651077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87221fa6-3654-40a9-9fd8-9ac310ecf3e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:24.652709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87221fa6-3654-40a9-9fd8-9ac310ecf3e2 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:24.667317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1240/2463] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:33.138967 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8cdf8-173d-4374-a81e-785340f7a950 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:33.139519 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8cdf8-173d-4374-a81e-785340f7a950 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:33.139519 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc8cdf8-173d-4374-a81e-785340f7a950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:33.160554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3bc8cdf8-173d-4374-a81e-785340f7a950 None None] MFA Rules not processed for user `98451efd61e44eec876701952375f788`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:33.161804 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3bc8cdf8-173d-4374-a81e-785340f7a950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:33.168631 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1224/2464] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:34.659738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=27 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:35.856737 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8e23f-df4f-4617-a581-8e857fd81b17 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:35.857309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8e23f-df4f-4617-a581-8e857fd81b17 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:35.857309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c8e23f-df4f-4617-a581-8e857fd81b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:35.881941 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-85c8e23f-df4f-4617-a581-8e857fd81b17 None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:35.884145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-85c8e23f-df4f-4617-a581-8e857fd81b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:35.892070 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1241/2465] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 13 06:43:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:35.905308 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8cdf8-173d-4374-a81e-785340f7a950 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:35.918366 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc8cdf8-173d-4374-a81e-785340f7a950 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:35.926309 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e4688-55e3-46c3-98f3-7b0f803726ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:35.926979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e4688-55e3-46c3-98f3-7b0f803726ea service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:35.927434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e4688-55e3-46c3-98f3-7b0f803726ea service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:35.927809 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e4688-55e3-46c3-98f3-7b0f803726ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:35.942758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e4688-55e3-46c3-98f3-7b0f803726ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:35.944473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5e4688-55e3-46c3-98f3-7b0f803726ea service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:35.957328 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1225/2466] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:43:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 06:43:45.874241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:45.913839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8e23f-df4f-4617-a581-8e857fd81b17 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:45.926777 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c8e23f-df4f-4617-a581-8e857fd81b17 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:45.932197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb556e4-b8ea-4ff3-9c01-7e0cd79e4521 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:45.932813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb556e4-b8ea-4ff3-9c01-7e0cd79e4521 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:45.933088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb556e4-b8ea-4ff3-9c01-7e0cd79e4521 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:45.933353 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb556e4-b8ea-4ff3-9c01-7e0cd79e4521 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:45.935103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fbb556e4-b8ea-4ff3-9c01-7e0cd79e4521 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:45.947731 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb556e4-b8ea-4ff3-9c01-7e0cd79e4521 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:45.949336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb556e4-b8ea-4ff3-9c01-7e0cd79e4521 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:45.952239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=93 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:45.960652 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1242/2467] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:45 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:54.582140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e4688-55e3-46c3-98f3-7b0f803726ea service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:54.591654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e4688-55e3-46c3-98f3-7b0f803726ea service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:54.595261 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8369e2e-d010-4899-8a2a-23333c697240 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:54.595856 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8369e2e-d010-4899-8a2a-23333c697240 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:54.596240 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8369e2e-d010-4899-8a2a-23333c697240 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:54.596400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8369e2e-d010-4899-8a2a-23333c697240 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:54.598183 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e8369e2e-d010-4899-8a2a-23333c697240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:54.665565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8369e2e-d010-4899-8a2a-23333c697240 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:54.667001 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8369e2e-d010-4899-8a2a-23333c697240 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:54.676986 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1226/2468] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:55.956272 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=6 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:57.723813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb556e4-b8ea-4ff3-9c01-7e0cd79e4521 service nova] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:57.725251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fbb556e4-b8ea-4ff3-9c01-7e0cd79e4521 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:57.792963 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8369e2e-d010-4899-8a2a-23333c697240 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:57.796005 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e8369e2e-d010-4899-8a2a-23333c697240 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:57.818956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8369e2e-d010-4899-8a2a-23333c697240 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:57.823679 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190cecd1-cf11-4da0-86f8-dc1af32922c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:57.824540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cecd1-cf11-4da0-86f8-dc1af32922c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:57.824927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb556e4-b8ea-4ff3-9c01-7e0cd79e4521 service nova] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:57.825060 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cecd1-cf11-4da0-86f8-dc1af32922c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:57.825301 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190cecd1-cf11-4da0-86f8-dc1af32922c1 admin admin] PATH_INFO: `/v3/users/a05d9cf1223b44589ab5586ec50a5b2f` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:57.826612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cecd1-cf11-4da0-86f8-dc1af32922c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05d9cf1223b44589ab5586ec50a5b2f)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:57.828818 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190cecd1-cf11-4da0-86f8-dc1af32922c1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:57.831135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf79a3c-3f41-4056-a955-3cd9268e738c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84a23931b60457e865f056352a396d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:57.831815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf79a3c-3f41-4056-a955-3cd9268e738c service placement] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:57.832316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf79a3c-3f41-4056-a955-3cd9268e738c service placement] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:57.832603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf79a3c-3f41-4056-a955-3cd9268e738c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:57.834378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-dcf79a3c-3f41-4056-a955-3cd9268e738c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:57.849316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf79a3c-3f41-4056-a955-3cd9268e738c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:57.851926 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf79a3c-3f41-4056-a955-3cd9268e738c service placement] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:57.863418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1243/2469] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:57.883219 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-190cecd1-cf11-4da0-86f8-dc1af32922c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05d9cf1223b44589ab5586ec50a5b2f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:57.891493 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-190cecd1-cf11-4da0-86f8-dc1af32922c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05d9cf1223b44589ab5586ec50a5b2f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:57.908985 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-190cecd1-cf11-4da0-86f8-dc1af32922c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05d9cf1223b44589ab5586ec50a5b2f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:57.917554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-190cecd1-cf11-4da0-86f8-dc1af32922c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05d9cf1223b44589ab5586ec50a5b2f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:57.918162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-190cecd1-cf11-4da0-86f8-dc1af32922c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05d9cf1223b44589ab5586ec50a5b2f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:57.924294 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1227/2470] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:43:57 2022] DELETE /identity/v3/users/a05d9cf1223b44589ab5586ec50a5b2f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:43:58.097305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf79a3c-3f41-4056-a955-3cd9268e738c service placement] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:58.110088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf79a3c-3f41-4056-a955-3cd9268e738c service placement] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:58.168135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fbf67-2cee-49f9-85d9-d70489664f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:58.168782 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fbf67-2cee-49f9-85d9-d70489664f12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:58.169059 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fbf67-2cee-49f9-85d9-d70489664f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:58.169328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fbf67-2cee-49f9-85d9-d70489664f12 admin admin] PATH_INFO: `/v3/projects/767bb45617ea47928f265a77f6a6f8dd` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:58.170415 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fbf67-2cee-49f9-85d9-d70489664f12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=767bb45617ea47928f265a77f6a6f8dd)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:58.172320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fbf67-2cee-49f9-85d9-d70489664f12 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:58.221160 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b69fbf67-2cee-49f9-85d9-d70489664f12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '767bb45617ea47928f265a77f6a6f8dd', 'request_id': 'req-b69fbf67-2cee-49f9-85d9-d70489664f12'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:58.229998 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b69fbf67-2cee-49f9-85d9-d70489664f12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '767bb45617ea47928f265a77f6a6f8dd', 'request_id': 'req-b69fbf67-2cee-49f9-85d9-d70489664f12'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:58.235863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b69fbf67-2cee-49f9-85d9-d70489664f12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '767bb45617ea47928f265a77f6a6f8dd', 'request_id': 'req-b69fbf67-2cee-49f9-85d9-d70489664f12'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:58.247592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b69fbf67-2cee-49f9-85d9-d70489664f12 admin admin] The token cache is being invalidate because project 767bb45617ea47928f265a77f6a6f8dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:43:58.247882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b69fbf67-2cee-49f9-85d9-d70489664f12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:58.248531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b69fbf67-2cee-49f9-85d9-d70489664f12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:58.250039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1244/2471] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:43:58 2022] DELETE /identity/v3/projects/767bb45617ea47928f265a77f6a6f8dd => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:58.255099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a94f1b-e940-4685-a720-17f96f30b092 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:58.255460 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a94f1b-e940-4685-a720-17f96f30b092 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:58.255806 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a94f1b-e940-4685-a720-17f96f30b092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:58.275691 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-33a94f1b-e940-4685-a720-17f96f30b092 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:58.276938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-33a94f1b-e940-4685-a720-17f96f30b092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:58.337595 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1228/2472] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:43:58.345420 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ed765-334f-4789-93c2-41bb34b68c8a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:58.345781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ed765-334f-4789-93c2-41bb34b68c8a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:58.346058 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ed765-334f-4789-93c2-41bb34b68c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:58.366637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-045ed765-334f-4789-93c2-41bb34b68c8a None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:58.368102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-045ed765-334f-4789-93c2-41bb34b68c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:58.375959 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1245/2473] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:58.380162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a94f1b-e940-4685-a720-17f96f30b092 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:58.389599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a94f1b-e940-4685-a720-17f96f30b092 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:58.394180 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afed991-0f72-4dff-b35c-2692d066e365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:58.394773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afed991-0f72-4dff-b35c-2692d066e365 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:58.395054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afed991-0f72-4dff-b35c-2692d066e365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:58.395326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afed991-0f72-4dff-b35c-2692d066e365 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:58.395971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afed991-0f72-4dff-b35c-2692d066e365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:43:58.396273 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afed991-0f72-4dff-b35c-2692d066e365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:58.397881 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afed991-0f72-4dff-b35c-2692d066e365 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:58.399309 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:58.411354 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1229/2474] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:43:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:43:58.415334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ed765-334f-4789-93c2-41bb34b68c8a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:58.424345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ed765-334f-4789-93c2-41bb34b68c8a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:58.429543 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859d260-5ed0-4e18-b5bf-b82aabd41963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:58.430125 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859d260-5ed0-4e18-b5bf-b82aabd41963 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:58.430402 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859d260-5ed0-4e18-b5bf-b82aabd41963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:58.430672 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859d260-5ed0-4e18-b5bf-b82aabd41963 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:58.431309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859d260-5ed0-4e18-b5bf-b82aabd41963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:58.433221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859d260-5ed0-4e18-b5bf-b82aabd41963 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:58.444979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:58.461446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1246/2475] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:43:58 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:43:58.465566 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afed991-0f72-4dff-b35c-2692d066e365 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:58.475887 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afed991-0f72-4dff-b35c-2692d066e365 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:58.530171 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a91952-38d3-4d8d-94c3-62d22511260e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:58.530775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a91952-38d3-4d8d-94c3-62d22511260e admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:58.531051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a91952-38d3-4d8d-94c3-62d22511260e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:58.531319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a91952-38d3-4d8d-94c3-62d22511260e admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:58.531951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a91952-38d3-4d8d-94c3-62d22511260e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:58.533872 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a91952-38d3-4d8d-94c3-62d22511260e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:58.555556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1230/2476] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:43:58 2022] POST /identity/v3/users => generated 303 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:43:58.559678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859d260-5ed0-4e18-b5bf-b82aabd41963 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:58.569892 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859d260-5ed0-4e18-b5bf-b82aabd41963 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:58.574585 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179db3ee-9b34-4557-bdf9-79950970319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:58.575177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179db3ee-9b34-4557-bdf9-79950970319b admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:58.575453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179db3ee-9b34-4557-bdf9-79950970319b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:58.575720 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179db3ee-9b34-4557-bdf9-79950970319b admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:58.576357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179db3ee-9b34-4557-bdf9-79950970319b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:58.577962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179db3ee-9b34-4557-bdf9-79950970319b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:58.588163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1247/2477] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:43:58.592125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a91952-38d3-4d8d-94c3-62d22511260e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:58.602464 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a91952-38d3-4d8d-94c3-62d22511260e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:58.607000 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6e675a-7539-4aff-bc65-86824791c912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:58.607579 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e675a-7539-4aff-bc65-86824791c912 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:58.607886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e675a-7539-4aff-bc65-86824791c912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:58.608155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6e675a-7539-4aff-bc65-86824791c912 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:58.608818 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e675a-7539-4aff-bc65-86824791c912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:58.610395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6e675a-7539-4aff-bc65-86824791c912 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:58.621348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1231/2478] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:43:58.625519 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179db3ee-9b34-4557-bdf9-79950970319b admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:58.635519 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179db3ee-9b34-4557-bdf9-79950970319b admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:58.640072 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02d0a7-21fb-45a8-a293-18f06462d9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:58.640752 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02d0a7-21fb-45a8-a293-18f06462d9d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:58.641036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02d0a7-21fb-45a8-a293-18f06462d9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:58.641308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d02d0a7-21fb-45a8-a293-18f06462d9d2 admin admin] PATH_INFO: `/v3/projects/83631faaa74c4865aac39223267f25a6/users/3ecc864d994045a7a088a0efc34ed810/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:58.656156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02d0a7-21fb-45a8-a293-18f06462d9d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83631faaa74c4865aac39223267f25a6, user_id=3ecc864d994045a7a088a0efc34ed810, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:58.658779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d02d0a7-21fb-45a8-a293-18f06462d9d2 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:58.671979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1248/2479] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:43:58 2022] PUT /identity/v3/projects/83631faaa74c4865aac39223267f25a6/users/3ecc864d994045a7a088a0efc34ed810/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:58.683140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561b630-973d-4f3b-a6a1-03b8bbdcb39b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:58.683417 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561b630-973d-4f3b-a6a1-03b8bbdcb39b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:58.683718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561b630-973d-4f3b-a6a1-03b8bbdcb39b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:58.711432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f561b630-973d-4f3b-a6a1-03b8bbdcb39b None None] MFA Rules not processed for user `3ecc864d994045a7a088a0efc34ed810`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:58.712598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f561b630-973d-4f3b-a6a1-03b8bbdcb39b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:58.778627 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1232/2480] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:58 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:58.782974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02d0a7-21fb-45a8-a293-18f06462d9d2 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:58.855445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d02d0a7-21fb-45a8-a293-18f06462d9d2 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:58.860930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca87ee-ad99-481c-99b2-eb86e9a14438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:58.861534 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca87ee-ad99-481c-99b2-eb86e9a14438 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:58.861816 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca87ee-ad99-481c-99b2-eb86e9a14438 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:58.862120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca87ee-ad99-481c-99b2-eb86e9a14438 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:58.862834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca87ee-ad99-481c-99b2-eb86e9a14438 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:58.864740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca87ee-ad99-481c-99b2-eb86e9a14438 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:58.895437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1249/2481] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:43:58 2022] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:43:58.896536 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561b630-973d-4f3b-a6a1-03b8bbdcb39b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:58.907459 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561b630-973d-4f3b-a6a1-03b8bbdcb39b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:58.965882 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7695875-2121-4d4f-9211-acb16b317890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:58.966404 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7695875-2121-4d4f-9211-acb16b317890 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:58.966684 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7695875-2121-4d4f-9211-acb16b317890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:58.966954 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7695875-2121-4d4f-9211-acb16b317890 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:58.967596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7695875-2121-4d4f-9211-acb16b317890 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:58.969565 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7695875-2121-4d4f-9211-acb16b317890 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:58.978655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:58.996111 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1233/2482] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:43:58 2022] POST /identity/v3/users => generated 308 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:43:58.997308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca87ee-ad99-481c-99b2-eb86e9a14438 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:59.009326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca87ee-ad99-481c-99b2-eb86e9a14438 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:59.013967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682c80a-1f8b-4a84-a493-34d2ab403c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:59.014564 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682c80a-1f8b-4a84-a493-34d2ab403c65 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:59.014844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682c80a-1f8b-4a84-a493-34d2ab403c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:59.015115 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0682c80a-1f8b-4a84-a493-34d2ab403c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:59.015760 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682c80a-1f8b-4a84-a493-34d2ab403c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:59.017390 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0682c80a-1f8b-4a84-a493-34d2ab403c65 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:59.029466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1250/2483] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:43:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:43:59.033756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7695875-2121-4d4f-9211-acb16b317890 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:59.044109 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7695875-2121-4d4f-9211-acb16b317890 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:59.049217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5e476-460f-4d8f-a19f-4dc518762cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:59.049865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5e476-460f-4d8f-a19f-4dc518762cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:59.050127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5e476-460f-4d8f-a19f-4dc518762cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:59.050405 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5e476-460f-4d8f-a19f-4dc518762cbe admin admin] PATH_INFO: `/v3/projects/46181837cae9439d85ec341fd679a8a6/users/33bdb2f693b84439b1f0ee98e7006269/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:59.066292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5e476-460f-4d8f-a19f-4dc518762cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=46181837cae9439d85ec341fd679a8a6, user_id=33bdb2f693b84439b1f0ee98e7006269, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:59.068976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5e476-460f-4d8f-a19f-4dc518762cbe admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:59.084117 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1234/2484] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:43:59 2022] PUT /identity/v3/projects/46181837cae9439d85ec341fd679a8a6/users/33bdb2f693b84439b1f0ee98e7006269/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:59.087959 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682c80a-1f8b-4a84-a493-34d2ab403c65 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:59.088904 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5e476-460f-4d8f-a19f-4dc518762cbe admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:59.090519 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-85c5e476-460f-4d8f-a19f-4dc518762cbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:59.098952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0682c80a-1f8b-4a84-a493-34d2ab403c65 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:59.147901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5e476-460f-4d8f-a19f-4dc518762cbe admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:59.151563 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1d5e1-823f-4e35-b235-ee48db12e266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:59.152197 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1d5e1-823f-4e35-b235-ee48db12e266 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:59.152474 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1d5e1-823f-4e35-b235-ee48db12e266 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:59.152776 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1d5e1-823f-4e35-b235-ee48db12e266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:59.154856 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-87b1d5e1-823f-4e35-b235-ee48db12e266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:59.164849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821d92f-0131-4db7-bf67-ff26d6f7d025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:59.165450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821d92f-0131-4db7-bf67-ff26d6f7d025 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:59.165725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821d92f-0131-4db7-bf67-ff26d6f7d025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:59.165999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821d92f-0131-4db7-bf67-ff26d6f7d025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:59.166637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821d92f-0131-4db7-bf67-ff26d6f7d025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:59.168214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821d92f-0131-4db7-bf67-ff26d6f7d025 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:59.178075 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1251/2485] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:43:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:43:59.182442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821d92f-0131-4db7-bf67-ff26d6f7d025 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:59.192860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821d92f-0131-4db7-bf67-ff26d6f7d025 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:59.197772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85608829-2b43-47de-8962-0ac6167194ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:59.198437 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85608829-2b43-47de-8962-0ac6167194ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:59.198715 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85608829-2b43-47de-8962-0ac6167194ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:59.198993 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85608829-2b43-47de-8962-0ac6167194ab admin admin] PATH_INFO: `/v3/projects/46181837cae9439d85ec341fd679a8a6/users/33bdb2f693b84439b1f0ee98e7006269/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:59.200954 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85608829-2b43-47de-8962-0ac6167194ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=46181837cae9439d85ec341fd679a8a6, user_id=33bdb2f693b84439b1f0ee98e7006269, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:59.203585 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85608829-2b43-47de-8962-0ac6167194ab admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:59.214277 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1252/2486] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:43:59 2022] PUT /identity/v3/projects/46181837cae9439d85ec341fd679a8a6/users/33bdb2f693b84439b1f0ee98e7006269/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:43:59.218471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1d5e1-823f-4e35-b235-ee48db12e266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:59.219834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1d5e1-823f-4e35-b235-ee48db12e266 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:59.224383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b18eb6-d568-471a-9c4c-0cec49813e83 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:59.224705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b18eb6-d568-471a-9c4c-0cec49813e83 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:59.225008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b18eb6-d568-471a-9c4c-0cec49813e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:59.229478 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1235/2487] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:59.254187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:59.257282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-71b18eb6-d568-471a-9c4c-0cec49813e83 None None] MFA Rules not processed for user `33bdb2f693b84439b1f0ee98e7006269`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:59.259092 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-71b18eb6-d568-471a-9c4c-0cec49813e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:59.329025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1253/2488] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:59 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:43:59.339912 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1d5e1-823f-4e35-b235-ee48db12e266 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:59.341530 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-87b1d5e1-823f-4e35-b235-ee48db12e266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:59.402299 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1d5e1-823f-4e35-b235-ee48db12e266 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:59.437156 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:59.459699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69fe17e-f794-4b45-81cc-17862f46f060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:59.460345 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fe17e-f794-4b45-81cc-17862f46f060 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:59.460642 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fe17e-f794-4b45-81cc-17862f46f060 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:59.460944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69fe17e-f794-4b45-81cc-17862f46f060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:59.470457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fe17e-f794-4b45-81cc-17862f46f060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:59.471893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69fe17e-f794-4b45-81cc-17862f46f060 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:59.481529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1236/2489] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:59 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:43:59.625366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b18eb6-d568-471a-9c4c-0cec49813e83 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:59.697041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b18eb6-d568-471a-9c4c-0cec49813e83 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:59.702291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735d369-aeb0-4cf2-bef4-f420b24da13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:59.702928 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735d369-aeb0-4cf2-bef4-f420b24da13d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:59.703211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735d369-aeb0-4cf2-bef4-f420b24da13d admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:59.703484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735d369-aeb0-4cf2-bef4-f420b24da13d admin admin] PATH_INFO: `/v3/users/3ecc864d994045a7a088a0efc34ed810` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:59.704608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735d369-aeb0-4cf2-bef4-f420b24da13d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ecc864d994045a7a088a0efc34ed810)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:59.706624 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735d369-aeb0-4cf2-bef4-f420b24da13d admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:59.763103 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c735d369-aeb0-4cf2-bef4-f420b24da13d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ecc864d994045a7a088a0efc34ed810'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:59.770301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c735d369-aeb0-4cf2-bef4-f420b24da13d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ecc864d994045a7a088a0efc34ed810'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:59.781972 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c735d369-aeb0-4cf2-bef4-f420b24da13d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ecc864d994045a7a088a0efc34ed810'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:59.782691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c735d369-aeb0-4cf2-bef4-f420b24da13d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ecc864d994045a7a088a0efc34ed810'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:59.791402 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c735d369-aeb0-4cf2-bef4-f420b24da13d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ecc864d994045a7a088a0efc34ed810'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:43:59.798356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1254/2490] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:43:59 2022] DELETE /identity/v3/users/3ecc864d994045a7a088a0efc34ed810 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:43:59.803184 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f06f10-2df7-47e9-98c6-e7bb42d500d2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:59.803465 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f06f10-2df7-47e9-98c6-e7bb42d500d2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:59.803735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f06f10-2df7-47e9-98c6-e7bb42d500d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:59.823136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-76f06f10-2df7-47e9-98c6-e7bb42d500d2 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:43:59.824359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-76f06f10-2df7-47e9-98c6-e7bb42d500d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:59.884986 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1237/2491] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:43:59.894749 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735d369-aeb0-4cf2-bef4-f420b24da13d admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:43:59.896153 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c735d369-aeb0-4cf2-bef4-f420b24da13d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:43:59.922845 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:43:59.965798 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735d369-aeb0-4cf2-bef4-f420b24da13d admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:43:59.969409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f531bfb-e3e4-44fe-b488-9c8bbdc693fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:43:59.970080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f531bfb-e3e4-44fe-b488-9c8bbdc693fd service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:43:59.970352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f531bfb-e3e4-44fe-b488-9c8bbdc693fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:43:59.970622 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f531bfb-e3e4-44fe-b488-9c8bbdc693fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:43:59.980629 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f531bfb-e3e4-44fe-b488-9c8bbdc693fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:43:59.982038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f531bfb-e3e4-44fe-b488-9c8bbdc693fd service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:43:59.992143 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1255/2492] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:43:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:44:00.273623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f06f10-2df7-47e9-98c6-e7bb42d500d2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:00.275283 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-76f06f10-2df7-47e9-98c6-e7bb42d500d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:00.287850 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f06f10-2df7-47e9-98c6-e7bb42d500d2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:00.292496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:00.293225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:00.293500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:00.293770 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66 admin admin] PATH_INFO: `/v3/projects/83631faaa74c4865aac39223267f25a6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:00.294959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83631faaa74c4865aac39223267f25a6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:00.296876 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:00.346980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83631faaa74c4865aac39223267f25a6', 'request_id': 'req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:00.352773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83631faaa74c4865aac39223267f25a6', 'request_id': 'req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:00.359024 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83631faaa74c4865aac39223267f25a6', 'request_id': 'req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:00.372987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66 admin admin] The token cache is being invalidate because project 83631faaa74c4865aac39223267f25a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:00.373279 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:00.373903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:00.375523 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1238/2493] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:00 2022] DELETE /identity/v3/projects/83631faaa74c4865aac39223267f25a6 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:00.380097 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f531bfb-e3e4-44fe-b488-9c8bbdc693fd service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:00.389537 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f531bfb-e3e4-44fe-b488-9c8bbdc693fd service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:00.451007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e7b21-fe49-4a5d-9477-2c552bbecf6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:00.451944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7b21-fe49-4a5d-9477-2c552bbecf6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:00.452224 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7b21-fe49-4a5d-9477-2c552bbecf6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:00.452499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e7b21-fe49-4a5d-9477-2c552bbecf6b admin admin] PATH_INFO: `/v3/users/33bdb2f693b84439b1f0ee98e7006269` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:00.453658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e7b21-fe49-4a5d-9477-2c552bbecf6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=33bdb2f693b84439b1f0ee98e7006269)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:00.455565 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e7b21-fe49-4a5d-9477-2c552bbecf6b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:00.505858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8e0e7b21-fe49-4a5d-9477-2c552bbecf6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33bdb2f693b84439b1f0ee98e7006269'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:00.513059 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8e0e7b21-fe49-4a5d-9477-2c552bbecf6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33bdb2f693b84439b1f0ee98e7006269'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:00.525848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8e0e7b21-fe49-4a5d-9477-2c552bbecf6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33bdb2f693b84439b1f0ee98e7006269'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:00.526554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8e0e7b21-fe49-4a5d-9477-2c552bbecf6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33bdb2f693b84439b1f0ee98e7006269'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:00.535334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-8e0e7b21-fe49-4a5d-9477-2c552bbecf6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33bdb2f693b84439b1f0ee98e7006269'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:00.542030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1256/2494] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:00 2022] DELETE /identity/v3/users/33bdb2f693b84439b1f0ee98e7006269 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:00.823669 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:00.825398 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:00.841271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaf27c-a1a3-4404-8cae-dbaab15b2f66 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:00.901633 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11982aca-d1b2-4b62-97ff-f68207cb353d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:00.902267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11982aca-d1b2-4b62-97ff-f68207cb353d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:00.902547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11982aca-d1b2-4b62-97ff-f68207cb353d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:00.902816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11982aca-d1b2-4b62-97ff-f68207cb353d admin admin] PATH_INFO: `/v3/projects/46181837cae9439d85ec341fd679a8a6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:00.903938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11982aca-d1b2-4b62-97ff-f68207cb353d admin admin] RBAC: Authorizing `identity:delete_project(project_id=46181837cae9439d85ec341fd679a8a6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:00.905888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11982aca-d1b2-4b62-97ff-f68207cb353d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:00.907394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:00.958314 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-11982aca-d1b2-4b62-97ff-f68207cb353d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46181837cae9439d85ec341fd679a8a6', 'request_id': 'req-11982aca-d1b2-4b62-97ff-f68207cb353d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:00.963745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-11982aca-d1b2-4b62-97ff-f68207cb353d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46181837cae9439d85ec341fd679a8a6', 'request_id': 'req-11982aca-d1b2-4b62-97ff-f68207cb353d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:00.969850 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-11982aca-d1b2-4b62-97ff-f68207cb353d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46181837cae9439d85ec341fd679a8a6', 'request_id': 'req-11982aca-d1b2-4b62-97ff-f68207cb353d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:00.983632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-11982aca-d1b2-4b62-97ff-f68207cb353d admin admin] The token cache is being invalidate because project 46181837cae9439d85ec341fd679a8a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:00.983926 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-11982aca-d1b2-4b62-97ff-f68207cb353d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:00.984547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-11982aca-d1b2-4b62-97ff-f68207cb353d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:00.986135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1239/2495] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:00 2022] DELETE /identity/v3/projects/46181837cae9439d85ec341fd679a8a6 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:00.991579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e920b-9a88-436b-a5eb-15d9f9a82686 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:00.992075 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e920b-9a88-436b-a5eb-15d9f9a82686 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:00.992182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e920b-9a88-436b-a5eb-15d9f9a82686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:01.012527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-799e920b-9a88-436b-a5eb-15d9f9a82686 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:01.013759 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-799e920b-9a88-436b-a5eb-15d9f9a82686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:01.047859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:01.097564 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1257/2496] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:01.105508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1ce8b-17b6-4176-833b-cb336171547f None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:01.105801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1ce8b-17b6-4176-833b-cb336171547f None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:01.106080 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1ce8b-17b6-4176-833b-cb336171547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:01.127765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-7bf1ce8b-17b6-4176-833b-cb336171547f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:01.130047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7bf1ce8b-17b6-4176-833b-cb336171547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:01.139551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1240/2497] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:01.144420 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e920b-9a88-436b-a5eb-15d9f9a82686 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:01.155498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e920b-9a88-436b-a5eb-15d9f9a82686 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:01.165850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b57b49-cd16-4104-b10f-68f621c269d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:01.166920 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b57b49-cd16-4104-b10f-68f621c269d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:01.167499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b57b49-cd16-4104-b10f-68f621c269d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:01.168033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b57b49-cd16-4104-b10f-68f621c269d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:01.168978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b57b49-cd16-4104-b10f-68f621c269d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:44:01.169515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b57b49-cd16-4104-b10f-68f621c269d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:01.171508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b57b49-cd16-4104-b10f-68f621c269d6 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:01.191685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1ce8b-17b6-4176-833b-cb336171547f None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:01.198317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1258/2498] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:44:01.204165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1ce8b-17b6-4176-833b-cb336171547f None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:01.209800 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1006e-c9d1-4c64-8262-7f1e1f57d688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:01.210687 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1006e-c9d1-4c64-8262-7f1e1f57d688 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:01.211071 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1006e-c9d1-4c64-8262-7f1e1f57d688 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:01.211452 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be1006e-c9d1-4c64-8262-7f1e1f57d688 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:01.212380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1006e-c9d1-4c64-8262-7f1e1f57d688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:01.214736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be1006e-c9d1-4c64-8262-7f1e1f57d688 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:01.259345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b57b49-cd16-4104-b10f-68f621c269d6 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:01.265007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1241/2499] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:01 2022] POST /identity/v3/projects => generated 361 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:01.272167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b57b49-cd16-4104-b10f-68f621c269d6 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:01.353585 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e43f3-b83e-49ca-a80f-d4baa3033f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:01.354321 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e43f3-b83e-49ca-a80f-d4baa3033f7b admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:01.354613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e43f3-b83e-49ca-a80f-d4baa3033f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:01.354891 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0e43f3-b83e-49ca-a80f-d4baa3033f7b admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:01.355598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e43f3-b83e-49ca-a80f-d4baa3033f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:01.358984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0e43f3-b83e-49ca-a80f-d4baa3033f7b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:01.402509 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1259/2500] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:01 2022] POST /identity/v3/users => generated 281 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:01.403756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1006e-c9d1-4c64-8262-7f1e1f57d688 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:01.415195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be1006e-c9d1-4c64-8262-7f1e1f57d688 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:01.421675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccc21d-3e2f-42c4-bc19-5fde07a2c3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:01.422460 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccc21d-3e2f-42c4-bc19-5fde07a2c3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:01.422816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccc21d-3e2f-42c4-bc19-5fde07a2c3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:01.423159 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecccc21d-3e2f-42c4-bc19-5fde07a2c3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:01.423914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecccc21d-3e2f-42c4-bc19-5fde07a2c3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:01.425702 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecccc21d-3e2f-42c4-bc19-5fde07a2c3f5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:01.450255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1242/2501] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:01.451453 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e43f3-b83e-49ca-a80f-d4baa3033f7b admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:01.462529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0e43f3-b83e-49ca-a80f-d4baa3033f7b admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:01.468958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419900f2-ab83-425a-8b23-07cb1224dbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:01.469571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419900f2-ab83-425a-8b23-07cb1224dbb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:01.469849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419900f2-ab83-425a-8b23-07cb1224dbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:01.470116 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419900f2-ab83-425a-8b23-07cb1224dbb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:01.470769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419900f2-ab83-425a-8b23-07cb1224dbb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:01.472725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419900f2-ab83-425a-8b23-07cb1224dbb8 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:01.485688 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1260/2502] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:01.489960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccc21d-3e2f-42c4-bc19-5fde07a2c3f5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:01.506668 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecccc21d-3e2f-42c4-bc19-5fde07a2c3f5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:01.520395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0ed99-f5b5-4ab8-844b-842f9e63a2d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:01.521302 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0ed99-f5b5-4ab8-844b-842f9e63a2d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:01.521747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0ed99-f5b5-4ab8-844b-842f9e63a2d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:01.522677 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0ed99-f5b5-4ab8-844b-842f9e63a2d5 admin admin] PATH_INFO: `/v3/projects/01183ca4c85d4f2494bb45302683b306/users/fa71b29794c94e539d0dfd662c144852/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:01.551298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0ed99-f5b5-4ab8-844b-842f9e63a2d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01183ca4c85d4f2494bb45302683b306, user_id=fa71b29794c94e539d0dfd662c144852, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:01.555069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c0ed99-f5b5-4ab8-844b-842f9e63a2d5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:01.573624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1243/2503] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:01 2022] PUT /identity/v3/projects/01183ca4c85d4f2494bb45302683b306/users/fa71b29794c94e539d0dfd662c144852/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:01.585598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cb9ad-4971-45f6-8f0a-610761bc052d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:01.587099 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cb9ad-4971-45f6-8f0a-610761bc052d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:01.587099 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75cb9ad-4971-45f6-8f0a-610761bc052d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:01.618302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e75cb9ad-4971-45f6-8f0a-610761bc052d None None] MFA Rules not processed for user `fa71b29794c94e539d0dfd662c144852`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:01.620506 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e75cb9ad-4971-45f6-8f0a-610761bc052d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:01.724820 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1261/2504] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:01.727235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0ed99-f5b5-4ab8-844b-842f9e63a2d5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:01.813095 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0ed99-f5b5-4ab8-844b-842f9e63a2d5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:01.823682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de946a-d81c-4461-a26f-a6b09c89ad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:01.824524 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de946a-d81c-4461-a26f-a6b09c89ad03 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:01.825016 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de946a-d81c-4461-a26f-a6b09c89ad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:01.825607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de946a-d81c-4461-a26f-a6b09c89ad03 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:01.826432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de946a-d81c-4461-a26f-a6b09c89ad03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:01.829294 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7de946a-d81c-4461-a26f-a6b09c89ad03 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:01.864990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1244/2505] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:01 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:01.869012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cb9ad-4971-45f6-8f0a-610761bc052d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:01.883055 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75cb9ad-4971-45f6-8f0a-610761bc052d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:01.928385 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:01.957483 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4184b-cbcd-4f5b-abc6-35e60a721bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:01.958175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4184b-cbcd-4f5b-abc6-35e60a721bbb admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:01.958583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4184b-cbcd-4f5b-abc6-35e60a721bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:01.958926 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4184b-cbcd-4f5b-abc6-35e60a721bbb admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:01.960537 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4184b-cbcd-4f5b-abc6-35e60a721bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:01.961792 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4184b-cbcd-4f5b-abc6-35e60a721bbb admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:01.985904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1262/2506] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:01 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:01.990405 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de946a-d81c-4461-a26f-a6b09c89ad03 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:02.002422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de946a-d81c-4461-a26f-a6b09c89ad03 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:02.008697 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226f9c0-e8fc-448d-8fd0-b1128f0482f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:02.009509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226f9c0-e8fc-448d-8fd0-b1128f0482f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:02.010018 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226f9c0-e8fc-448d-8fd0-b1128f0482f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:02.010701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e226f9c0-e8fc-448d-8fd0-b1128f0482f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:02.011363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226f9c0-e8fc-448d-8fd0-b1128f0482f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:02.014165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e226f9c0-e8fc-448d-8fd0-b1128f0482f7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:02.022135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:02.033570 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1245/2507] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:02.035393 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4184b-cbcd-4f5b-abc6-35e60a721bbb admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:02.046286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4184b-cbcd-4f5b-abc6-35e60a721bbb admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:02.063221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaddf4c-468e-4d6a-8da1-7129df0e573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:02.065025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaddf4c-468e-4d6a-8da1-7129df0e573c admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:02.065408 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaddf4c-468e-4d6a-8da1-7129df0e573c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:02.065931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaddf4c-468e-4d6a-8da1-7129df0e573c admin admin] PATH_INFO: `/v3/projects/f910ab3d70da482faffdbe71d5cbe88c/users/67e50b019c6242c4964c26866d94fb36/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:02.083012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaddf4c-468e-4d6a-8da1-7129df0e573c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f910ab3d70da482faffdbe71d5cbe88c, user_id=67e50b019c6242c4964c26866d94fb36, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:02.085835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccaddf4c-468e-4d6a-8da1-7129df0e573c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:02.103122 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1263/2508] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:02 2022] PUT /identity/v3/projects/f910ab3d70da482faffdbe71d5cbe88c/users/67e50b019c6242c4964c26866d94fb36/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:02.108194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226f9c0-e8fc-448d-8fd0-b1128f0482f7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:02.121854 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e226f9c0-e8fc-448d-8fd0-b1128f0482f7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:02.188521 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310b5a10-2f09-4800-a01d-7d22a42c615d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:02.189372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b5a10-2f09-4800-a01d-7d22a42c615d admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:02.189717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b5a10-2f09-4800-a01d-7d22a42c615d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:02.190130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310b5a10-2f09-4800-a01d-7d22a42c615d admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:02.190933 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b5a10-2f09-4800-a01d-7d22a42c615d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:02.192619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310b5a10-2f09-4800-a01d-7d22a42c615d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:02.204468 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1246/2509] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:02 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:02.208983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaddf4c-468e-4d6a-8da1-7129df0e573c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:02.222974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaddf4c-468e-4d6a-8da1-7129df0e573c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:02.229303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11138786-8751-425f-8f12-c00073b691f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:02.229978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11138786-8751-425f-8f12-c00073b691f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:02.230256 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11138786-8751-425f-8f12-c00073b691f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:02.230527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11138786-8751-425f-8f12-c00073b691f2 admin admin] PATH_INFO: `/v3/projects/f910ab3d70da482faffdbe71d5cbe88c/users/67e50b019c6242c4964c26866d94fb36/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:02.232532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11138786-8751-425f-8f12-c00073b691f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f910ab3d70da482faffdbe71d5cbe88c, user_id=67e50b019c6242c4964c26866d94fb36, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:02.235258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11138786-8751-425f-8f12-c00073b691f2 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:02.248162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1264/2510] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:02 2022] PUT /identity/v3/projects/f910ab3d70da482faffdbe71d5cbe88c/users/67e50b019c6242c4964c26866d94fb36/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:02.258782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c0855-1de2-4dc6-996f-5f48c9ed43df None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:02.259062 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c0855-1de2-4dc6-996f-5f48c9ed43df None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:02.259333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195c0855-1de2-4dc6-996f-5f48c9ed43df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:02.290102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-195c0855-1de2-4dc6-996f-5f48c9ed43df None None] MFA Rules not processed for user `67e50b019c6242c4964c26866d94fb36`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:02.291626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-195c0855-1de2-4dc6-996f-5f48c9ed43df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:02.378597 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1247/2511] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:02 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:02.391080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11138786-8751-425f-8f12-c00073b691f2 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:02.393374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-11138786-8751-425f-8f12-c00073b691f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:02.483595 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11138786-8751-425f-8f12-c00073b691f2 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:02.487580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d5052-632c-4f2a-8d0f-11fc3fade830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:02.488185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d5052-632c-4f2a-8d0f-11fc3fade830 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:02.488460 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d5052-632c-4f2a-8d0f-11fc3fade830 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:02.488765 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d5052-632c-4f2a-8d0f-11fc3fade830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:02.499997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d5052-632c-4f2a-8d0f-11fc3fade830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:02.503053 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254d5052-632c-4f2a-8d0f-11fc3fade830 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:02.511330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1265/2512] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:02 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:02.980847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c0855-1de2-4dc6-996f-5f48c9ed43df None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:03.054690 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195c0855-1de2-4dc6-996f-5f48c9ed43df None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:03.059836 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf945796-a002-4c85-a577-7ad29c84c2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:03.060555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf945796-a002-4c85-a577-7ad29c84c2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:03.060924 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf945796-a002-4c85-a577-7ad29c84c2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:03.061200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf945796-a002-4c85-a577-7ad29c84c2fc admin admin] PATH_INFO: `/v3/users/fa71b29794c94e539d0dfd662c144852` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:03.062554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf945796-a002-4c85-a577-7ad29c84c2fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa71b29794c94e539d0dfd662c144852)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:03.065010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf945796-a002-4c85-a577-7ad29c84c2fc admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:03.089170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:03.113600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cf945796-a002-4c85-a577-7ad29c84c2fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa71b29794c94e539d0dfd662c144852'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:03.121101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cf945796-a002-4c85-a577-7ad29c84c2fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa71b29794c94e539d0dfd662c144852'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:03.133889 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cf945796-a002-4c85-a577-7ad29c84c2fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa71b29794c94e539d0dfd662c144852'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:03.140938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cf945796-a002-4c85-a577-7ad29c84c2fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa71b29794c94e539d0dfd662c144852'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:03.141555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cf945796-a002-4c85-a577-7ad29c84c2fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa71b29794c94e539d0dfd662c144852'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:03.147666 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1248/2513] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:02 2022] DELETE /identity/v3/users/fa71b29794c94e539d0dfd662c144852 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:03.152510 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e57e8-ceaf-43c7-9c4f-2a0c269a0d00 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:03.152510 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e57e8-ceaf-43c7-9c4f-2a0c269a0d00 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:03.153131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506e57e8-ceaf-43c7-9c4f-2a0c269a0d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:03.171847 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-506e57e8-ceaf-43c7-9c4f-2a0c269a0d00 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:03.173095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-506e57e8-ceaf-43c7-9c4f-2a0c269a0d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:03.241470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1266/2514] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:03.251834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf945796-a002-4c85-a577-7ad29c84c2fc admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:03.254613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cf945796-a002-4c85-a577-7ad29c84c2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:03.329182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf945796-a002-4c85-a577-7ad29c84c2fc admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:03.333471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc8db4-7584-42ea-892a-bbd232e981be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:03.334141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc8db4-7584-42ea-892a-bbd232e981be service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:03.334366 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc8db4-7584-42ea-892a-bbd232e981be service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:03.335008 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adc8db4-7584-42ea-892a-bbd232e981be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:03.346366 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc8db4-7584-42ea-892a-bbd232e981be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:03.347986 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adc8db4-7584-42ea-892a-bbd232e981be service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:03.364401 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1249/2515] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:03.542803 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e57e8-ceaf-43c7-9c4f-2a0c269a0d00 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:03.544212 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-506e57e8-ceaf-43c7-9c4f-2a0c269a0d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:03.579005 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:03.620604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506e57e8-ceaf-43c7-9c4f-2a0c269a0d00 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:03.626157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ef12f-0252-494f-8551-d816a532f109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:03.626768 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ef12f-0252-494f-8551-d816a532f109 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:03.627157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ef12f-0252-494f-8551-d816a532f109 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:03.627552 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ef12f-0252-494f-8551-d816a532f109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:03.629851 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-187ef12f-0252-494f-8551-d816a532f109 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:03.689234 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ef12f-0252-494f-8551-d816a532f109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:03.691395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ef12f-0252-494f-8551-d816a532f109 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:03.700689 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1267/2516] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:03.811787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc8db4-7584-42ea-892a-bbd232e981be service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:03.813608 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4adc8db4-7584-42ea-892a-bbd232e981be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:03.828270 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adc8db4-7584-42ea-892a-bbd232e981be service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:03.835260 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7457da3-bcb0-4c16-9acc-0df764396b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:03.836139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7457da3-bcb0-4c16-9acc-0df764396b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:03.836410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7457da3-bcb0-4c16-9acc-0df764396b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:03.836719 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7457da3-bcb0-4c16-9acc-0df764396b8b admin admin] PATH_INFO: `/v3/projects/01183ca4c85d4f2494bb45302683b306` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:03.838148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7457da3-bcb0-4c16-9acc-0df764396b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=01183ca4c85d4f2494bb45302683b306)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:03.841747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7457da3-bcb0-4c16-9acc-0df764396b8b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:03.898129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a7457da3-bcb0-4c16-9acc-0df764396b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01183ca4c85d4f2494bb45302683b306', 'request_id': 'req-a7457da3-bcb0-4c16-9acc-0df764396b8b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:03.903721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a7457da3-bcb0-4c16-9acc-0df764396b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01183ca4c85d4f2494bb45302683b306', 'request_id': 'req-a7457da3-bcb0-4c16-9acc-0df764396b8b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:03.911776 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a7457da3-bcb0-4c16-9acc-0df764396b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01183ca4c85d4f2494bb45302683b306', 'request_id': 'req-a7457da3-bcb0-4c16-9acc-0df764396b8b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:03.929580 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a7457da3-bcb0-4c16-9acc-0df764396b8b admin admin] The token cache is being invalidate because project 01183ca4c85d4f2494bb45302683b306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:03.929976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a7457da3-bcb0-4c16-9acc-0df764396b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:03.930673 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a7457da3-bcb0-4c16-9acc-0df764396b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:03.932253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1250/2517] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:03 2022] DELETE /identity/v3/projects/01183ca4c85d4f2494bb45302683b306 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:03.936603 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ef12f-0252-494f-8551-d816a532f109 service nova] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:03.948215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ef12f-0252-494f-8551-d816a532f109 service nova] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:04.028438 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c716ac9-23ed-46fd-96dc-9f7eb01efd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:04.029115 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c716ac9-23ed-46fd-96dc-9f7eb01efd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:04.029491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c716ac9-23ed-46fd-96dc-9f7eb01efd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:04.029767 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c716ac9-23ed-46fd-96dc-9f7eb01efd40 admin admin] PATH_INFO: `/v3/users/67e50b019c6242c4964c26866d94fb36` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:04.030895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c716ac9-23ed-46fd-96dc-9f7eb01efd40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67e50b019c6242c4964c26866d94fb36)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:04.032836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c716ac9-23ed-46fd-96dc-9f7eb01efd40 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:04.080851 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9c716ac9-23ed-46fd-96dc-9f7eb01efd40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67e50b019c6242c4964c26866d94fb36'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:04.088260 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9c716ac9-23ed-46fd-96dc-9f7eb01efd40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67e50b019c6242c4964c26866d94fb36'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:04.099047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:04.101641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9c716ac9-23ed-46fd-96dc-9f7eb01efd40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67e50b019c6242c4964c26866d94fb36'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:04.102610 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9c716ac9-23ed-46fd-96dc-9f7eb01efd40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67e50b019c6242c4964c26866d94fb36'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:04.110305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9c716ac9-23ed-46fd-96dc-9f7eb01efd40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67e50b019c6242c4964c26866d94fb36'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:04.116292 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1268/2518] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:03 2022] DELETE /identity/v3/users/67e50b019c6242c4964c26866d94fb36 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:04.380131 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7457da3-bcb0-4c16-9acc-0df764396b8b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:04.381657 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a7457da3-bcb0-4c16-9acc-0df764396b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:04.395179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7457da3-bcb0-4c16-9acc-0df764396b8b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:04.421500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:04.457963 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dce795-c7c7-4e2d-a3f1-88f93abfdb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:04.458589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dce795-c7c7-4e2d-a3f1-88f93abfdb05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:04.458866 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dce795-c7c7-4e2d-a3f1-88f93abfdb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:04.459136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dce795-c7c7-4e2d-a3f1-88f93abfdb05 admin admin] PATH_INFO: `/v3/projects/f910ab3d70da482faffdbe71d5cbe88c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:04.462684 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dce795-c7c7-4e2d-a3f1-88f93abfdb05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f910ab3d70da482faffdbe71d5cbe88c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:04.464529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dce795-c7c7-4e2d-a3f1-88f93abfdb05 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:04.510048 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-90dce795-c7c7-4e2d-a3f1-88f93abfdb05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f910ab3d70da482faffdbe71d5cbe88c', 'request_id': 'req-90dce795-c7c7-4e2d-a3f1-88f93abfdb05'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:04.515520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-90dce795-c7c7-4e2d-a3f1-88f93abfdb05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f910ab3d70da482faffdbe71d5cbe88c', 'request_id': 'req-90dce795-c7c7-4e2d-a3f1-88f93abfdb05'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:04.522158 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-90dce795-c7c7-4e2d-a3f1-88f93abfdb05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f910ab3d70da482faffdbe71d5cbe88c', 'request_id': 'req-90dce795-c7c7-4e2d-a3f1-88f93abfdb05'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:04.534670 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-90dce795-c7c7-4e2d-a3f1-88f93abfdb05 admin admin] The token cache is being invalidate because project f910ab3d70da482faffdbe71d5cbe88c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:04.534953 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-90dce795-c7c7-4e2d-a3f1-88f93abfdb05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:04.535561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-90dce795-c7c7-4e2d-a3f1-88f93abfdb05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:04.537067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1251/2519] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:04 2022] DELETE /identity/v3/projects/f910ab3d70da482faffdbe71d5cbe88c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:04.541882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aa775-fa0a-4c56-864a-d8dcaf862bea None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:04.542362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aa775-fa0a-4c56-864a-d8dcaf862bea None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:04.542471 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9aa775-fa0a-4c56-864a-d8dcaf862bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:04.561901 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2d9aa775-fa0a-4c56-864a-d8dcaf862bea None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:04.563076 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2d9aa775-fa0a-4c56-864a-d8dcaf862bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:04.620140 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1269/2520] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:04.627718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3273c-a548-4180-8b26-9047c5f1b6e7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:04.628599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3273c-a548-4180-8b26-9047c5f1b6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:04.628907 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d3273c-a548-4180-8b26-9047c5f1b6e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:04.648657 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-40d3273c-a548-4180-8b26-9047c5f1b6e7 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:04.649907 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-40d3273c-a548-4180-8b26-9047c5f1b6e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:04.657842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1252/2521] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:04.662099 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9aa775-fa0a-4c56-864a-d8dcaf862bea None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:04.671770 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9aa775-fa0a-4c56-864a-d8dcaf862bea None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:04.676781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2f8de-3d0e-4d6b-a858-5be17f0c746d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:04.677368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2f8de-3d0e-4d6b-a858-5be17f0c746d admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:04.677647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2f8de-3d0e-4d6b-a858-5be17f0c746d admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:04.677914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2f8de-3d0e-4d6b-a858-5be17f0c746d admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:04.678553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2f8de-3d0e-4d6b-a858-5be17f0c746d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:44:04.678851 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2f8de-3d0e-4d6b-a858-5be17f0c746d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:04.680457 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2f8de-3d0e-4d6b-a858-5be17f0c746d admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:04.692286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1270/2522] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:44:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:44:04.696360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3273c-a548-4180-8b26-9047c5f1b6e7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:04.705590 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d3273c-a548-4180-8b26-9047c5f1b6e7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:04.710298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe2443-c4d6-432f-ad4a-2c86ba63796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:04.710910 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe2443-c4d6-432f-ad4a-2c86ba63796a admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:04.711190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe2443-c4d6-432f-ad4a-2c86ba63796a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:04.711462 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe2443-c4d6-432f-ad4a-2c86ba63796a admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:04.712085 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe2443-c4d6-432f-ad4a-2c86ba63796a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:04.714059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbe2443-c4d6-432f-ad4a-2c86ba63796a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:04.740602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1253/2523] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:04 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:04.744916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2f8de-3d0e-4d6b-a858-5be17f0c746d admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:04.755336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2f8de-3d0e-4d6b-a858-5be17f0c746d admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:04.812348 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d38b1-840a-4db0-8a74-491d81dc3ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:04.813058 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d38b1-840a-4db0-8a74-491d81dc3ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:04.813342 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d38b1-840a-4db0-8a74-491d81dc3ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:04.813617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49d38b1-840a-4db0-8a74-491d81dc3ab0 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:04.814358 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d38b1-840a-4db0-8a74-491d81dc3ab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:04.816997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49d38b1-840a-4db0-8a74-491d81dc3ab0 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:04.837565 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1271/2524] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:04 2022] POST /identity/v3/users => generated 278 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:04.841697 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe2443-c4d6-432f-ad4a-2c86ba63796a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:04.851809 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbe2443-c4d6-432f-ad4a-2c86ba63796a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:04.856606 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a2d2a-a6b1-4088-bca6-38083d32f41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:04.857222 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a2d2a-a6b1-4088-bca6-38083d32f41e admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:04.857503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a2d2a-a6b1-4088-bca6-38083d32f41e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:04.857779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a2d2a-a6b1-4088-bca6-38083d32f41e admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:04.858417 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a2d2a-a6b1-4088-bca6-38083d32f41e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:04.860002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a2d2a-a6b1-4088-bca6-38083d32f41e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:04.870487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1254/2525] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:04.874146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d38b1-840a-4db0-8a74-491d81dc3ab0 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:04.884354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49d38b1-840a-4db0-8a74-491d81dc3ab0 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:04.888872 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53431e6-9b03-44cf-a64d-10d161a95b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:04.889452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53431e6-9b03-44cf-a64d-10d161a95b17 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:04.889728 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53431e6-9b03-44cf-a64d-10d161a95b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:04.889995 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53431e6-9b03-44cf-a64d-10d161a95b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:04.890624 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53431e6-9b03-44cf-a64d-10d161a95b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:04.892194 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53431e6-9b03-44cf-a64d-10d161a95b17 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:04.902501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1272/2526] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:04.906586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a2d2a-a6b1-4088-bca6-38083d32f41e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:04.917050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a2d2a-a6b1-4088-bca6-38083d32f41e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:04.921652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579c405-38e2-4657-97b8-674b88db3ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:04.922293 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579c405-38e2-4657-97b8-674b88db3ca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:04.922572 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579c405-38e2-4657-97b8-674b88db3ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:04.922846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5579c405-38e2-4657-97b8-674b88db3ca4 admin admin] PATH_INFO: `/v3/projects/d3a9972086e641709c6d36e4e0e0c2c6/users/6ab7e56df16c4e919ad18a82fc7062e0/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:04.937689 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579c405-38e2-4657-97b8-674b88db3ca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3a9972086e641709c6d36e4e0e0c2c6, user_id=6ab7e56df16c4e919ad18a82fc7062e0, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:04.940308 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5579c405-38e2-4657-97b8-674b88db3ca4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:04.952412 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1255/2527] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:04 2022] PUT /identity/v3/projects/d3a9972086e641709c6d36e4e0e0c2c6/users/6ab7e56df16c4e919ad18a82fc7062e0/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:04.963863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11313752-e809-49d9-a3dd-c2358a51a8e9 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:04.964221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11313752-e809-49d9-a3dd-c2358a51a8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:04.964413 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11313752-e809-49d9-a3dd-c2358a51a8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:04.992167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-11313752-e809-49d9-a3dd-c2358a51a8e9 None None] MFA Rules not processed for user `6ab7e56df16c4e919ad18a82fc7062e0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:04.993653 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-11313752-e809-49d9-a3dd-c2358a51a8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:05.035352 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:05.060430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1273/2528] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:05.065114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579c405-38e2-4657-97b8-674b88db3ca4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:05.124104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:05.136054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5579c405-38e2-4657-97b8-674b88db3ca4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:05.141182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aefa70-341e-4e92-8be6-cff91d38647b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:05.141786 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aefa70-341e-4e92-8be6-cff91d38647b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:05.142066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aefa70-341e-4e92-8be6-cff91d38647b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:05.142334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aefa70-341e-4e92-8be6-cff91d38647b admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:05.142961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aefa70-341e-4e92-8be6-cff91d38647b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:05.144919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aefa70-341e-4e92-8be6-cff91d38647b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:05.172592 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1256/2529] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:05 2022] POST /identity/v3/projects => generated 355 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:05.177067 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11313752-e809-49d9-a3dd-c2358a51a8e9 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:05.187794 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11313752-e809-49d9-a3dd-c2358a51a8e9 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:05.246364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183a077-5e7e-402b-a163-b4ca7b7830e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:05.246969 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183a077-5e7e-402b-a163-b4ca7b7830e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:05.247249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183a077-5e7e-402b-a163-b4ca7b7830e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:05.247515 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c183a077-5e7e-402b-a163-b4ca7b7830e8 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:05.248150 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183a077-5e7e-402b-a163-b4ca7b7830e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:05.250078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c183a077-5e7e-402b-a163-b4ca7b7830e8 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:05.275357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1274/2530] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:05 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:05.277043 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aefa70-341e-4e92-8be6-cff91d38647b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:05.289009 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aefa70-341e-4e92-8be6-cff91d38647b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:05.294229 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8055d-5a7a-4251-8f02-2f7f7388741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:05.294960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8055d-5a7a-4251-8f02-2f7f7388741c admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:05.295375 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8055d-5a7a-4251-8f02-2f7f7388741c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:05.295733 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb8055d-5a7a-4251-8f02-2f7f7388741c admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:05.296445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8055d-5a7a-4251-8f02-2f7f7388741c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:05.298158 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb8055d-5a7a-4251-8f02-2f7f7388741c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:05.309240 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1257/2531] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:05.313760 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183a077-5e7e-402b-a163-b4ca7b7830e8 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:05.324176 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c183a077-5e7e-402b-a163-b4ca7b7830e8 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:05.329007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77703ace-149d-4d68-adb7-40ca47697b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:05.329659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77703ace-149d-4d68-adb7-40ca47697b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:05.329932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77703ace-149d-4d68-adb7-40ca47697b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:05.330203 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77703ace-149d-4d68-adb7-40ca47697b5b admin admin] PATH_INFO: `/v3/projects/be0812a77e754b839eb7ff3ddbda2dc3/users/230769dfdb6445449d478d3a50edb8af/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:05.347905 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77703ace-149d-4d68-adb7-40ca47697b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0812a77e754b839eb7ff3ddbda2dc3, user_id=230769dfdb6445449d478d3a50edb8af, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:05.350908 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77703ace-149d-4d68-adb7-40ca47697b5b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:05.365463 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1275/2532] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:05 2022] PUT /identity/v3/projects/be0812a77e754b839eb7ff3ddbda2dc3/users/230769dfdb6445449d478d3a50edb8af/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:05.369686 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8055d-5a7a-4251-8f02-2f7f7388741c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:05.380554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb8055d-5a7a-4251-8f02-2f7f7388741c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:05.449173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23b7f06-6160-4be7-aae8-bf53ec2ed80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:05.449778 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b7f06-6160-4be7-aae8-bf53ec2ed80b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:05.450055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b7f06-6160-4be7-aae8-bf53ec2ed80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:05.450324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b7f06-6160-4be7-aae8-bf53ec2ed80b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:05.450964 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b7f06-6160-4be7-aae8-bf53ec2ed80b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:05.452627 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23b7f06-6160-4be7-aae8-bf53ec2ed80b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:05.464208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1258/2533] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:05.467717 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77703ace-149d-4d68-adb7-40ca47697b5b admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:05.478818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77703ace-149d-4d68-adb7-40ca47697b5b admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:05.484257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c8b7-05f6-4928-a68a-dae96fed2a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:05.484811 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c8b7-05f6-4928-a68a-dae96fed2a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:05.485087 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c8b7-05f6-4928-a68a-dae96fed2a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:05.485356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d3c8b7-05f6-4928-a68a-dae96fed2a7f admin admin] PATH_INFO: `/v3/projects/be0812a77e754b839eb7ff3ddbda2dc3/users/230769dfdb6445449d478d3a50edb8af/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:05.487288 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3c8b7-05f6-4928-a68a-dae96fed2a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0812a77e754b839eb7ff3ddbda2dc3, user_id=230769dfdb6445449d478d3a50edb8af, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:05.489930 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d3c8b7-05f6-4928-a68a-dae96fed2a7f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:05.500505 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1276/2534] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:05 2022] PUT /identity/v3/projects/be0812a77e754b839eb7ff3ddbda2dc3/users/230769dfdb6445449d478d3a50edb8af/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:05.510671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210e53f-d0f5-4a38-8394-b224bde1416b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:05.510958 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210e53f-d0f5-4a38-8394-b224bde1416b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:05.511233 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210e53f-d0f5-4a38-8394-b224bde1416b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:05.540057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b210e53f-d0f5-4a38-8394-b224bde1416b None None] MFA Rules not processed for user `230769dfdb6445449d478d3a50edb8af`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:05.541326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b210e53f-d0f5-4a38-8394-b224bde1416b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:05.611217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1259/2535] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:05 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:05.623010 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c8b7-05f6-4928-a68a-dae96fed2a7f admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:05.624807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-12d3c8b7-05f6-4928-a68a-dae96fed2a7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:05.683812 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d3c8b7-05f6-4928-a68a-dae96fed2a7f admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:05.687472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279f34f-58c4-43a1-92b4-fbfca7661916 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:05.688407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279f34f-58c4-43a1-92b4-fbfca7661916 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:05.688706 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279f34f-58c4-43a1-92b4-fbfca7661916 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:05.688983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279f34f-58c4-43a1-92b4-fbfca7661916 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:05.698285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279f34f-58c4-43a1-92b4-fbfca7661916 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:05.699693 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279f34f-58c4-43a1-92b4-fbfca7661916 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:05.709429 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1277/2536] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:05 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:05.783472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210e53f-d0f5-4a38-8394-b224bde1416b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:05.793028 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210e53f-d0f5-4a38-8394-b224bde1416b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:05.796907 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e3c11-76f3-483e-a001-874dc1364ba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:05.797581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e3c11-76f3-483e-a001-874dc1364ba0 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:05.797999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e3c11-76f3-483e-a001-874dc1364ba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:05.798312 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e3c11-76f3-483e-a001-874dc1364ba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:05.844446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:05.856798 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e3c11-76f3-483e-a001-874dc1364ba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:05.858225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e3c11-76f3-483e-a001-874dc1364ba0 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:05.867043 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1260/2537] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:05 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:15.227158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279f34f-58c4-43a1-92b4-fbfca7661916 service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:15.228586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2279f34f-58c4-43a1-92b4-fbfca7661916 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:15.272369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:15.288716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279f34f-58c4-43a1-92b4-fbfca7661916 service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:15.292283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5647fb-4c25-4d4d-acf9-54086b382781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:15.292926 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5647fb-4c25-4d4d-acf9-54086b382781 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:15.293201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5647fb-4c25-4d4d-acf9-54086b382781 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:15.293470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5647fb-4c25-4d4d-acf9-54086b382781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:15.295222 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5d5647fb-4c25-4d4d-acf9-54086b382781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:15.360063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5647fb-4c25-4d4d-acf9-54086b382781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:15.360892 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5647fb-4c25-4d4d-acf9-54086b382781 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:15.370944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1278/2538] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:15.865179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=6 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:18.551302 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e3c11-76f3-483e-a001-874dc1364ba0 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:18.552919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ab7e3c11-76f3-483e-a001-874dc1364ba0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:18.573562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e3c11-76f3-483e-a001-874dc1364ba0 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:18.579668 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988814bf-c48a-459f-aa81-877b3508596b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:18.580600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988814bf-c48a-459f-aa81-877b3508596b service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:18.581404 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988814bf-c48a-459f-aa81-877b3508596b service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:18.581894 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988814bf-c48a-459f-aa81-877b3508596b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:18.584062 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-988814bf-c48a-459f-aa81-877b3508596b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:18.604848 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988814bf-c48a-459f-aa81-877b3508596b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:18.606399 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988814bf-c48a-459f-aa81-877b3508596b service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:18.630259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1261/2539] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:18.678285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f73e7b-1eb3-4750-b72f-0866cab72667 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:18.679165 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f73e7b-1eb3-4750-b72f-0866cab72667 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:18.679501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f73e7b-1eb3-4750-b72f-0866cab72667 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:18.681402 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1279/2540] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 13 06:44:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 06:44:18.716340 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7d34-0038-48a5-b61f-acdf2cd92a8b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:18.716631 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7d34-0038-48a5-b61f-acdf2cd92a8b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:18.716941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3f7d34-0038-48a5-b61f-acdf2cd92a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:18.739480 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8a3f7d34-0038-48a5-b61f-acdf2cd92a8b None None] MFA Rules not processed for user `b84a23931b60457e865f056352a396d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:18.743582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8a3f7d34-0038-48a5-b61f-acdf2cd92a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:18.769499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f73e7b-1eb3-4750-b72f-0866cab72667 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:18.772502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e0f73e7b-1eb3-4750-b72f-0866cab72667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:18.797139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f73e7b-1eb3-4750-b72f-0866cab72667 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:18.809266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cf87c2-e0be-4905-853c-871948010cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:18.809495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1262/2541] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 13 06:44:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:18.810281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf87c2-e0be-4905-853c-871948010cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:18.810563 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf87c2-e0be-4905-853c-871948010cec admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:18.810838 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cf87c2-e0be-4905-853c-871948010cec admin admin] PATH_INFO: `/v3/users/cfdd9d86fbce4b0881a94ab730500ae6` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:18.812001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf87c2-e0be-4905-853c-871948010cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfdd9d86fbce4b0881a94ab730500ae6)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:18.813942 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cf87c2-e0be-4905-853c-871948010cec admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:18.821356 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f7d34-0038-48a5-b61f-acdf2cd92a8b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:18.822823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8a3f7d34-0038-48a5-b61f-acdf2cd92a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:18.837089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3f7d34-0038-48a5-b61f-acdf2cd92a8b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:18.845258 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c22fb7-fdd1-4db0-b8fe-983f8c4a632a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84a23931b60457e865f056352a396d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:18.845998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c22fb7-fdd1-4db0-b8fe-983f8c4a632a service placement] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:18.846348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c22fb7-fdd1-4db0-b8fe-983f8c4a632a service placement] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:18.846694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c22fb7-fdd1-4db0-b8fe-983f8c4a632a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:18.858870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c22fb7-fdd1-4db0-b8fe-983f8c4a632a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:18.860951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c22fb7-fdd1-4db0-b8fe-983f8c4a632a service placement] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:18.868081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-11cf87c2-e0be-4905-853c-871948010cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfdd9d86fbce4b0881a94ab730500ae6'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:18.874358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1263/2542] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:44:18.875851 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-11cf87c2-e0be-4905-853c-871948010cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfdd9d86fbce4b0881a94ab730500ae6'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:18.892947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-11cf87c2-e0be-4905-853c-871948010cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfdd9d86fbce4b0881a94ab730500ae6'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:18.894111 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-11cf87c2-e0be-4905-853c-871948010cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfdd9d86fbce4b0881a94ab730500ae6'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:18.902972 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-11cf87c2-e0be-4905-853c-871948010cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfdd9d86fbce4b0881a94ab730500ae6'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:18.909571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1280/2543] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:18 2022] DELETE /identity/v3/users/cfdd9d86fbce4b0881a94ab730500ae6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:19.082627 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c22fb7-fdd1-4db0-b8fe-983f8c4a632a service placement] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:19.095314 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c22fb7-fdd1-4db0-b8fe-983f8c4a632a service placement] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:19.155062 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f336569-1f3c-4234-b6af-09c389735669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:19.155613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f336569-1f3c-4234-b6af-09c389735669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:19.155897 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f336569-1f3c-4234-b6af-09c389735669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:19.156176 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f336569-1f3c-4234-b6af-09c389735669 admin admin] PATH_INFO: `/v3/projects/d05bb7aaa40549468266ef2bf868b0e5` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:19.157350 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f336569-1f3c-4234-b6af-09c389735669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d05bb7aaa40549468266ef2bf868b0e5)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:19.159258 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f336569-1f3c-4234-b6af-09c389735669 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:19.208996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f336569-1f3c-4234-b6af-09c389735669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd05bb7aaa40549468266ef2bf868b0e5', 'request_id': 'req-6f336569-1f3c-4234-b6af-09c389735669'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:19.214784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f336569-1f3c-4234-b6af-09c389735669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd05bb7aaa40549468266ef2bf868b0e5', 'request_id': 'req-6f336569-1f3c-4234-b6af-09c389735669'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:19.221119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f336569-1f3c-4234-b6af-09c389735669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd05bb7aaa40549468266ef2bf868b0e5', 'request_id': 'req-6f336569-1f3c-4234-b6af-09c389735669'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:19.231039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:19.236450 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f336569-1f3c-4234-b6af-09c389735669 admin admin] The token cache is being invalidate because project d05bb7aaa40549468266ef2bf868b0e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:19.236865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f336569-1f3c-4234-b6af-09c389735669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:19.237920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f336569-1f3c-4234-b6af-09c389735669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:19.240723 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1264/2544] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:19 2022] DELETE /identity/v3/projects/d05bb7aaa40549468266ef2bf868b0e5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:19.245796 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa786342-b75f-4bc4-89cb-b1f51014dbeb None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:19.246129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa786342-b75f-4bc4-89cb-b1f51014dbeb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:19.246406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa786342-b75f-4bc4-89cb-b1f51014dbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:19.266524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-fa786342-b75f-4bc4-89cb-b1f51014dbeb None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:19.267750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fa786342-b75f-4bc4-89cb-b1f51014dbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:19.319756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:19.332821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1281/2545] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:19.339025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7509-5729-4e25-83bb-0d1e871fbb2d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:19.339317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7509-5729-4e25-83bb-0d1e871fbb2d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:19.339599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7509-5729-4e25-83bb-0d1e871fbb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:19.359746 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-160f7509-5729-4e25-83bb-0d1e871fbb2d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:19.361007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-160f7509-5729-4e25-83bb-0d1e871fbb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:19.369835 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1265/2546] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:19.381842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa786342-b75f-4bc4-89cb-b1f51014dbeb None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:19.391726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa786342-b75f-4bc4-89cb-b1f51014dbeb None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:19.396305 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877b633-4665-4ca6-a84a-e68758d70b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:19.396938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877b633-4665-4ca6-a84a-e68758d70b41 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:19.397224 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877b633-4665-4ca6-a84a-e68758d70b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:19.397502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877b633-4665-4ca6-a84a-e68758d70b41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:19.398150 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877b633-4665-4ca6-a84a-e68758d70b41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:44:19.398456 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877b633-4665-4ca6-a84a-e68758d70b41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:19.400048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877b633-4665-4ca6-a84a-e68758d70b41 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:19.412598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1282/2547] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:44:19.417058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f7509-5729-4e25-83bb-0d1e871fbb2d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:19.426823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f7509-5729-4e25-83bb-0d1e871fbb2d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:19.431561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d471344-285e-4114-8dae-973f27ffa066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:19.432164 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d471344-285e-4114-8dae-973f27ffa066 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:19.432448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d471344-285e-4114-8dae-973f27ffa066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:19.432750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d471344-285e-4114-8dae-973f27ffa066 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:19.433384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d471344-285e-4114-8dae-973f27ffa066 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:19.435274 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d471344-285e-4114-8dae-973f27ffa066 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:19.464230 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1266/2548] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:19 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:19.468504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877b633-4665-4ca6-a84a-e68758d70b41 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:19.479918 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877b633-4665-4ca6-a84a-e68758d70b41 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:19.546709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b0b38-cf10-401f-b6f2-52bab92f9dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:19.547490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b0b38-cf10-401f-b6f2-52bab92f9dce admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:19.547840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b0b38-cf10-401f-b6f2-52bab92f9dce admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:19.548182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b0b38-cf10-401f-b6f2-52bab92f9dce admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:19.548964 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b0b38-cf10-401f-b6f2-52bab92f9dce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:19.551110 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b0b38-cf10-401f-b6f2-52bab92f9dce admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:19.574306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1283/2549] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:19 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:19.578367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d471344-285e-4114-8dae-973f27ffa066 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:19.590177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d471344-285e-4114-8dae-973f27ffa066 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:19.595362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7488c0e-a48b-49c8-9da9-e3ad2b40336c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:19.596142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7488c0e-a48b-49c8-9da9-e3ad2b40336c admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:19.596540 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7488c0e-a48b-49c8-9da9-e3ad2b40336c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:19.596938 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7488c0e-a48b-49c8-9da9-e3ad2b40336c admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:19.598598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7488c0e-a48b-49c8-9da9-e3ad2b40336c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:19.600494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7488c0e-a48b-49c8-9da9-e3ad2b40336c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:19.612402 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1267/2550] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:19.616086 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b0b38-cf10-401f-b6f2-52bab92f9dce admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:19.633570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b0b38-cf10-401f-b6f2-52bab92f9dce admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:19.650320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10031bd-f0d3-4235-a96b-d25145dc5450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:19.651022 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10031bd-f0d3-4235-a96b-d25145dc5450 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:19.651371 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10031bd-f0d3-4235-a96b-d25145dc5450 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:19.651708 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10031bd-f0d3-4235-a96b-d25145dc5450 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:19.652433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10031bd-f0d3-4235-a96b-d25145dc5450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:19.654330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10031bd-f0d3-4235-a96b-d25145dc5450 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:19.669251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1284/2551] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:19.673049 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7488c0e-a48b-49c8-9da9-e3ad2b40336c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:19.685324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7488c0e-a48b-49c8-9da9-e3ad2b40336c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:19.690982 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3859e-5f10-48ca-a78b-d4d346f496c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:19.691823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3859e-5f10-48ca-a78b-d4d346f496c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:19.692290 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3859e-5f10-48ca-a78b-d4d346f496c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:19.692661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a3859e-5f10-48ca-a78b-d4d346f496c8 admin admin] PATH_INFO: `/v3/projects/d9cc5e69a0e04695baa5ac8ef021ba55/users/69f83b575ee942d694d65579a06a8c15/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:19.712499 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3859e-5f10-48ca-a78b-d4d346f496c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9cc5e69a0e04695baa5ac8ef021ba55, user_id=69f83b575ee942d694d65579a06a8c15, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:19.715259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a3859e-5f10-48ca-a78b-d4d346f496c8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:19.731214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1268/2552] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:19 2022] PUT /identity/v3/projects/d9cc5e69a0e04695baa5ac8ef021ba55/users/69f83b575ee942d694d65579a06a8c15/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:19.741262 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e63d24-bfd4-423d-84f4-e7abf1163d1f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:19.741783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e63d24-bfd4-423d-84f4-e7abf1163d1f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:19.741783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e63d24-bfd4-423d-84f4-e7abf1163d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:19.773826 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-40e63d24-bfd4-423d-84f4-e7abf1163d1f None None] MFA Rules not processed for user `69f83b575ee942d694d65579a06a8c15`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:19.774994 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-40e63d24-bfd4-423d-84f4-e7abf1163d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:19.857598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1285/2553] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:19.871429 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3859e-5f10-48ca-a78b-d4d346f496c8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:19.873353 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-59a3859e-5f10-48ca-a78b-d4d346f496c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:19.976894 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a3859e-5f10-48ca-a78b-d4d346f496c8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:19.984167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2914b0a5-1666-4f14-a362-8e5238fc5dba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:19.984922 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b0a5-1666-4f14-a362-8e5238fc5dba service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:19.985738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b0a5-1666-4f14-a362-8e5238fc5dba service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:19.986200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2914b0a5-1666-4f14-a362-8e5238fc5dba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:20.002081 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914b0a5-1666-4f14-a362-8e5238fc5dba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:20.003671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2914b0a5-1666-4f14-a362-8e5238fc5dba service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:20.021569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1269/2554] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:20.312747 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e63d24-bfd4-423d-84f4-e7abf1163d1f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:20.382758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:20.390814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e63d24-bfd4-423d-84f4-e7abf1163d1f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:20.398452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4905933-361f-492a-abe0-ce07c233af0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:20.399310 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4905933-361f-492a-abe0-ce07c233af0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:20.399498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4905933-361f-492a-abe0-ce07c233af0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:20.399743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4905933-361f-492a-abe0-ce07c233af0a admin admin] PATH_INFO: `/v3/users/69f83b575ee942d694d65579a06a8c15` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:20.401027 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4905933-361f-492a-abe0-ce07c233af0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=69f83b575ee942d694d65579a06a8c15)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:20.403120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4905933-361f-492a-abe0-ce07c233af0a admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:20.462963 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b4905933-361f-492a-abe0-ce07c233af0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69f83b575ee942d694d65579a06a8c15'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:20.472013 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b4905933-361f-492a-abe0-ce07c233af0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69f83b575ee942d694d65579a06a8c15'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:20.492622 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b4905933-361f-492a-abe0-ce07c233af0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69f83b575ee942d694d65579a06a8c15'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:20.493557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b4905933-361f-492a-abe0-ce07c233af0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69f83b575ee942d694d65579a06a8c15'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:20.503328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-b4905933-361f-492a-abe0-ce07c233af0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69f83b575ee942d694d65579a06a8c15'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:20.512535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1286/2555] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:20 2022] DELETE /identity/v3/users/69f83b575ee942d694d65579a06a8c15 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:20.516920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95f495-1898-4b8a-ab8b-37274d2ada1a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:20.517211 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95f495-1898-4b8a-ab8b-37274d2ada1a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:20.517492 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95f495-1898-4b8a-ab8b-37274d2ada1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:20.541682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4c95f495-1898-4b8a-ab8b-37274d2ada1a None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:20.541985 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4c95f495-1898-4b8a-ab8b-37274d2ada1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:20.611802 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1270/2556] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:20.623223 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4905933-361f-492a-abe0-ce07c233af0a admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:20.624654 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b4905933-361f-492a-abe0-ce07c233af0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:20.692813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4905933-361f-492a-abe0-ce07c233af0a admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:20.696697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fff2516-a11b-4ebc-8c82-404a59baf5a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:20.697435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff2516-a11b-4ebc-8c82-404a59baf5a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:20.697945 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff2516-a11b-4ebc-8c82-404a59baf5a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:20.698359 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fff2516-a11b-4ebc-8c82-404a59baf5a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:20.708994 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff2516-a11b-4ebc-8c82-404a59baf5a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:20.710636 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fff2516-a11b-4ebc-8c82-404a59baf5a5 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:20.721941 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1287/2557] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:21.145029 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95f495-1898-4b8a-ab8b-37274d2ada1a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:21.146527 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4c95f495-1898-4b8a-ab8b-37274d2ada1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:21.158636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95f495-1898-4b8a-ab8b-37274d2ada1a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:21.163484 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9326d9-9b39-4e7e-882e-22d6d22e05bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:21.164115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9326d9-9b39-4e7e-882e-22d6d22e05bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:21.164397 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9326d9-9b39-4e7e-882e-22d6d22e05bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:21.164689 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9326d9-9b39-4e7e-882e-22d6d22e05bb admin admin] PATH_INFO: `/v3/projects/d9cc5e69a0e04695baa5ac8ef021ba55` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:21.166430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9326d9-9b39-4e7e-882e-22d6d22e05bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9cc5e69a0e04695baa5ac8ef021ba55)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:21.168354 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9326d9-9b39-4e7e-882e-22d6d22e05bb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:21.195744 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:21.231851 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f9326d9-9b39-4e7e-882e-22d6d22e05bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9cc5e69a0e04695baa5ac8ef021ba55', 'request_id': 'req-6f9326d9-9b39-4e7e-882e-22d6d22e05bb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:21.239998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f9326d9-9b39-4e7e-882e-22d6d22e05bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9cc5e69a0e04695baa5ac8ef021ba55', 'request_id': 'req-6f9326d9-9b39-4e7e-882e-22d6d22e05bb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:21.246701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f9326d9-9b39-4e7e-882e-22d6d22e05bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9cc5e69a0e04695baa5ac8ef021ba55', 'request_id': 'req-6f9326d9-9b39-4e7e-882e-22d6d22e05bb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:21.266147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f9326d9-9b39-4e7e-882e-22d6d22e05bb admin admin] The token cache is being invalidate because project d9cc5e69a0e04695baa5ac8ef021ba55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:21.266553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f9326d9-9b39-4e7e-882e-22d6d22e05bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:21.267396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6f9326d9-9b39-4e7e-882e-22d6d22e05bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:21.269592 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1271/2558] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:21 2022] DELETE /identity/v3/projects/d9cc5e69a0e04695baa5ac8ef021ba55 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:21.274342 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e01c4-c89a-4317-937c-2b6991523226 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:21.274762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e01c4-c89a-4317-937c-2b6991523226 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:21.274923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e01c4-c89a-4317-937c-2b6991523226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:21.299762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-862e01c4-c89a-4317-937c-2b6991523226 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:21.301609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-862e01c4-c89a-4317-937c-2b6991523226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:21.395452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1288/2559] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:21.396698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4a6fc-7037-4cb8-98b7-08fd0d64565e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:21.397263 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4a6fc-7037-4cb8-98b7-08fd0d64565e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:21.397568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4a6fc-7037-4cb8-98b7-08fd0d64565e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:21.420306 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e0c4a6fc-7037-4cb8-98b7-08fd0d64565e None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:21.421756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e0c4a6fc-7037-4cb8-98b7-08fd0d64565e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:21.434110 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1272/2560] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:21.439941 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e01c4-c89a-4317-937c-2b6991523226 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:21.454537 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e01c4-c89a-4317-937c-2b6991523226 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:21.465888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14503a8e-572a-4e51-96d4-4033baa0082e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:21.467396 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14503a8e-572a-4e51-96d4-4033baa0082e admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:21.467803 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14503a8e-572a-4e51-96d4-4033baa0082e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:21.468181 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14503a8e-572a-4e51-96d4-4033baa0082e admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:21.468966 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14503a8e-572a-4e51-96d4-4033baa0082e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:44:21.469300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14503a8e-572a-4e51-96d4-4033baa0082e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:21.471302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14503a8e-572a-4e51-96d4-4033baa0082e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:21.488151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1289/2561] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:44:21.490002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4a6fc-7037-4cb8-98b7-08fd0d64565e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:21.501666 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4a6fc-7037-4cb8-98b7-08fd0d64565e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:21.507147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f63c1-111c-4213-b0d9-278e16b34acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:21.507792 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f63c1-111c-4213-b0d9-278e16b34acf admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:21.508030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f63c1-111c-4213-b0d9-278e16b34acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:21.508346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19f63c1-111c-4213-b0d9-278e16b34acf admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:21.508968 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f63c1-111c-4213-b0d9-278e16b34acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:21.510863 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19f63c1-111c-4213-b0d9-278e16b34acf admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:21.545358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1273/2562] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:21 2022] POST /identity/v3/projects => generated 363 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:21.549476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14503a8e-572a-4e51-96d4-4033baa0082e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:21.557274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:21.574037 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14503a8e-572a-4e51-96d4-4033baa0082e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:21.593801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f63c1-111c-4213-b0d9-278e16b34acf admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:21.595868 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a19f63c1-111c-4213-b0d9-278e16b34acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:21.661949 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846b70c-cb33-41cb-9817-f0ded0062cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:21.662679 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846b70c-cb33-41cb-9817-f0ded0062cc2 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:21.663017 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846b70c-cb33-41cb-9817-f0ded0062cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:21.663377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2846b70c-cb33-41cb-9817-f0ded0062cc2 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:21.664102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846b70c-cb33-41cb-9817-f0ded0062cc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:21.666224 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2846b70c-cb33-41cb-9817-f0ded0062cc2 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:21.695778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1290/2563] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:21 2022] POST /identity/v3/users => generated 282 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:21.699750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846b70c-cb33-41cb-9817-f0ded0062cc2 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:21.713919 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2846b70c-cb33-41cb-9817-f0ded0062cc2 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:21.714136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19f63c1-111c-4213-b0d9-278e16b34acf admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:21.719213 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae4f5b7-981d-4630-8439-a6611090cbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:21.719856 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4f5b7-981d-4630-8439-a6611090cbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:21.720138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4f5b7-981d-4630-8439-a6611090cbda admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:21.720422 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae4f5b7-981d-4630-8439-a6611090cbda admin admin] PATH_INFO: `/v3/users/6ab7e56df16c4e919ad18a82fc7062e0` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:21.721986 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4f5b7-981d-4630-8439-a6611090cbda admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab7e56df16c4e919ad18a82fc7062e0)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:21.723879 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56999661-b3d1-44d3-a48b-0e8f786438e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:21.724765 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56999661-b3d1-44d3-a48b-0e8f786438e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:21.724885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae4f5b7-981d-4630-8439-a6611090cbda admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:21.725179 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56999661-b3d1-44d3-a48b-0e8f786438e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:21.725525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56999661-b3d1-44d3-a48b-0e8f786438e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:21.726266 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56999661-b3d1-44d3-a48b-0e8f786438e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:21.730282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56999661-b3d1-44d3-a48b-0e8f786438e7 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:21.747609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1291/2564] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:21.748740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56999661-b3d1-44d3-a48b-0e8f786438e7 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:21.765361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56999661-b3d1-44d3-a48b-0e8f786438e7 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:21.771162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f776f08-3650-42d5-a665-e933d41fe696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:21.771886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f776f08-3650-42d5-a665-e933d41fe696 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:21.772199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f776f08-3650-42d5-a665-e933d41fe696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:21.772755 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f776f08-3650-42d5-a665-e933d41fe696 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:21.773419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f776f08-3650-42d5-a665-e933d41fe696 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:21.774748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f776f08-3650-42d5-a665-e933d41fe696 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:21.785611 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4ae4f5b7-981d-4630-8439-a6611090cbda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab7e56df16c4e919ad18a82fc7062e0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:21.786700 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1292/2565] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:21.790645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f776f08-3650-42d5-a665-e933d41fe696 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:21.800810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f776f08-3650-42d5-a665-e933d41fe696 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:21.802075 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4ae4f5b7-981d-4630-8439-a6611090cbda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab7e56df16c4e919ad18a82fc7062e0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:21.808630 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0057a-159f-49c1-9b03-050e77cb76ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:21.809340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0057a-159f-49c1-9b03-050e77cb76ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:21.810238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0057a-159f-49c1-9b03-050e77cb76ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:21.810238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0057a-159f-49c1-9b03-050e77cb76ab admin admin] PATH_INFO: `/v3/projects/18a256d5c15d4f40a5cba3d04345ad7d/users/94b52bdc0d3143478768278f0bb133a3/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:21.826599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4ae4f5b7-981d-4630-8439-a6611090cbda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab7e56df16c4e919ad18a82fc7062e0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:21.827167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0057a-159f-49c1-9b03-050e77cb76ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=18a256d5c15d4f40a5cba3d04345ad7d, user_id=94b52bdc0d3143478768278f0bb133a3, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:21.829870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0057a-159f-49c1-9b03-050e77cb76ab admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:21.831249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:21.837810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4ae4f5b7-981d-4630-8439-a6611090cbda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab7e56df16c4e919ad18a82fc7062e0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:21.839942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4ae4f5b7-981d-4630-8439-a6611090cbda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab7e56df16c4e919ad18a82fc7062e0'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:21.849528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1293/2566] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:21 2022] PUT /identity/v3/projects/18a256d5c15d4f40a5cba3d04345ad7d/users/94b52bdc0d3143478768278f0bb133a3/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:21.851910 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1274/2567] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:21 2022] DELETE /identity/v3/users/6ab7e56df16c4e919ad18a82fc7062e0 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:21.861746 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593223-d180-477b-8e3d-8bedfdc99ea9 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:21.862468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593223-d180-477b-8e3d-8bedfdc99ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:21.863166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76593223-d180-477b-8e3d-8bedfdc99ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:21.864199 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a6436-11e7-4d1e-90d1-ff3827af45a5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:21.864602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a6436-11e7-4d1e-90d1-ff3827af45a5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:21.865097 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563a6436-11e7-4d1e-90d1-ff3827af45a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:21.887289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-563a6436-11e7-4d1e-90d1-ff3827af45a5 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:21.888740 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-563a6436-11e7-4d1e-90d1-ff3827af45a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:21.903244 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-76593223-d180-477b-8e3d-8bedfdc99ea9 None None] MFA Rules not processed for user `94b52bdc0d3143478768278f0bb133a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:21.905297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-76593223-d180-477b-8e3d-8bedfdc99ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:21.969550 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1275/2568] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:21.981814 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a6436-11e7-4d1e-90d1-ff3827af45a5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:21.983615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-563a6436-11e7-4d1e-90d1-ff3827af45a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:22.002109 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1294/2569] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:22.007561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76593223-d180-477b-8e3d-8bedfdc99ea9 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:22.009232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-76593223-d180-477b-8e3d-8bedfdc99ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:22.023596 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76593223-d180-477b-8e3d-8bedfdc99ea9 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:22.028330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b082351-1d9d-4459-903b-a583408e89ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:22.028969 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b082351-1d9d-4459-903b-a583408e89ac admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:22.029256 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b082351-1d9d-4459-903b-a583408e89ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:22.029532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b082351-1d9d-4459-903b-a583408e89ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:22.030220 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b082351-1d9d-4459-903b-a583408e89ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:22.032121 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b082351-1d9d-4459-903b-a583408e89ac admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:22.051948 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563a6436-11e7-4d1e-90d1-ff3827af45a5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:22.055990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6907266-3df5-468c-a80b-8929e810c8ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:22.056914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6907266-3df5-468c-a80b-8929e810c8ea service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:22.057637 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6907266-3df5-468c-a80b-8929e810c8ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:22.057976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6907266-3df5-468c-a80b-8929e810c8ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:22.070836 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6907266-3df5-468c-a80b-8929e810c8ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:22.072123 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6907266-3df5-468c-a80b-8929e810c8ea service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:22.072598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1295/2570] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:22 2022] POST /identity/v3/projects => generated 361 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:22.076734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b082351-1d9d-4459-903b-a583408e89ac admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:22.083041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1276/2571] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:44:22.112652 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:22.197744 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b082351-1d9d-4459-903b-a583408e89ac admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:22.214055 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49c8ab-41d0-45aa-b149-ab755c3e2d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:22.216536 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49c8ab-41d0-45aa-b149-ab755c3e2d17 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:22.221183 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49c8ab-41d0-45aa-b149-ab755c3e2d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:22.225067 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49c8ab-41d0-45aa-b149-ab755c3e2d17 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:22.227497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49c8ab-41d0-45aa-b149-ab755c3e2d17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:22.231473 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49c8ab-41d0-45aa-b149-ab755c3e2d17 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:22.268983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1296/2572] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:22 2022] POST /identity/v3/users => generated 287 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:22.273150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6907266-3df5-468c-a80b-8929e810c8ea service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:22.284108 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6907266-3df5-468c-a80b-8929e810c8ea service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:22.293122 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dadbae-c4fa-4664-af34-145eca08cf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:22.294413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dadbae-c4fa-4664-af34-145eca08cf76 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:22.294703 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dadbae-c4fa-4664-af34-145eca08cf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:22.294984 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dadbae-c4fa-4664-af34-145eca08cf76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:22.295709 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dadbae-c4fa-4664-af34-145eca08cf76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:22.297956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dadbae-c4fa-4664-af34-145eca08cf76 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:22.315509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1277/2573] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:22.316840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49c8ab-41d0-45aa-b149-ab755c3e2d17 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:22.335079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49c8ab-41d0-45aa-b149-ab755c3e2d17 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:22.346107 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7b583-1a96-4aca-9c4b-dca4f8a23b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:22.346793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7b583-1a96-4aca-9c4b-dca4f8a23b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:22.347156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7b583-1a96-4aca-9c4b-dca4f8a23b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:22.347327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba7b583-1a96-4aca-9c4b-dca4f8a23b11 admin admin] PATH_INFO: `/v3/projects/d8e0fefb24e443e7a3d056dfd408079b/users/8542d623972d4969b2bdf89599440508/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:22.365377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7b583-1a96-4aca-9c4b-dca4f8a23b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e0fefb24e443e7a3d056dfd408079b, user_id=8542d623972d4969b2bdf89599440508, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:22.368334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba7b583-1a96-4aca-9c4b-dca4f8a23b11 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:22.385672 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1297/2574] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:22 2022] PUT /identity/v3/projects/d8e0fefb24e443e7a3d056dfd408079b/users/8542d623972d4969b2bdf89599440508/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:22.390227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dadbae-c4fa-4664-af34-145eca08cf76 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:22.411954 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dadbae-c4fa-4664-af34-145eca08cf76 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:22.521784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8993e8c-7c0b-4d7a-8150-bdc270709a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:22.523199 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8993e8c-7c0b-4d7a-8150-bdc270709a05 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:22.523526 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8993e8c-7c0b-4d7a-8150-bdc270709a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:22.523997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8993e8c-7c0b-4d7a-8150-bdc270709a05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:22.525136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8993e8c-7c0b-4d7a-8150-bdc270709a05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:22.526906 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8993e8c-7c0b-4d7a-8150-bdc270709a05 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:22.528459 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7b583-1a96-4aca-9c4b-dca4f8a23b11 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:22.531822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-aba7b583-1a96-4aca-9c4b-dca4f8a23b11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:22.549099 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba7b583-1a96-4aca-9c4b-dca4f8a23b11 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:22.550591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1278/2575] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:22 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:22.551471 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8993e8c-7c0b-4d7a-8150-bdc270709a05 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:22.556538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41c2e5-ac55-48fa-9ce8-18253ec28cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:22.557586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41c2e5-ac55-48fa-9ce8-18253ec28cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:22.557716 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41c2e5-ac55-48fa-9ce8-18253ec28cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:22.557980 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d41c2e5-ac55-48fa-9ce8-18253ec28cc8 admin admin] PATH_INFO: `/v3/users/8505dee31512437ba7b6de3512dcc76a` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:22.559704 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41c2e5-ac55-48fa-9ce8-18253ec28cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8505dee31512437ba7b6de3512dcc76a)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:22.561771 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c8993e8c-7c0b-4d7a-8150-bdc270709a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:22.562100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d41c2e5-ac55-48fa-9ce8-18253ec28cc8 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:22.575169 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8993e8c-7c0b-4d7a-8150-bdc270709a05 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:22.579901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e916f6-587a-4313-8226-fe06ac5abd27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:22.580523 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e916f6-587a-4313-8226-fe06ac5abd27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:22.580860 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e916f6-587a-4313-8226-fe06ac5abd27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:22.581137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e916f6-587a-4313-8226-fe06ac5abd27 admin admin] PATH_INFO: `/v3/projects/d3a9972086e641709c6d36e4e0e0c2c6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:22.582795 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e916f6-587a-4313-8226-fe06ac5abd27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3a9972086e641709c6d36e4e0e0c2c6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:22.584691 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e916f6-587a-4313-8226-fe06ac5abd27 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:22.607921 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:22.618479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1d41c2e5-ac55-48fa-9ce8-18253ec28cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8505dee31512437ba7b6de3512dcc76a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:22.627844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1d41c2e5-ac55-48fa-9ce8-18253ec28cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8505dee31512437ba7b6de3512dcc76a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:22.640623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c3e916f6-587a-4313-8226-fe06ac5abd27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3a9972086e641709c6d36e4e0e0c2c6', 'request_id': 'req-c3e916f6-587a-4313-8226-fe06ac5abd27'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:22.641180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1d41c2e5-ac55-48fa-9ce8-18253ec28cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8505dee31512437ba7b6de3512dcc76a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:22.642071 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1d41c2e5-ac55-48fa-9ce8-18253ec28cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8505dee31512437ba7b6de3512dcc76a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:22.649297 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c3e916f6-587a-4313-8226-fe06ac5abd27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3a9972086e641709c6d36e4e0e0c2c6', 'request_id': 'req-c3e916f6-587a-4313-8226-fe06ac5abd27'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:22.651416 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1d41c2e5-ac55-48fa-9ce8-18253ec28cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8505dee31512437ba7b6de3512dcc76a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:22.656512 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c3e916f6-587a-4313-8226-fe06ac5abd27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3a9972086e641709c6d36e4e0e0c2c6', 'request_id': 'req-c3e916f6-587a-4313-8226-fe06ac5abd27'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:22.657997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1298/2576] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:22 2022] DELETE /identity/v3/users/8505dee31512437ba7b6de3512dcc76a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:22.658941 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41c2e5-ac55-48fa-9ce8-18253ec28cc8 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:22.663036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1d41c2e5-ac55-48fa-9ce8-18253ec28cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:22.671264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c3e916f6-587a-4313-8226-fe06ac5abd27 admin admin] The token cache is being invalidate because project d3a9972086e641709c6d36e4e0e0c2c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:22.671646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c3e916f6-587a-4313-8226-fe06ac5abd27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:22.672393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c3e916f6-587a-4313-8226-fe06ac5abd27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:22.674197 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1279/2577] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:22 2022] DELETE /identity/v3/projects/d3a9972086e641709c6d36e4e0e0c2c6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:22.678126 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e916f6-587a-4313-8226-fe06ac5abd27 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:22.679384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c3e916f6-587a-4313-8226-fe06ac5abd27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:22.726246 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:22.744609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d41c2e5-ac55-48fa-9ce8-18253ec28cc8 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:22.750562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19330b-3ea6-42d7-9c13-e607b42dfd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:22.751227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19330b-3ea6-42d7-9c13-e607b42dfd49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:22.751508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19330b-3ea6-42d7-9c13-e607b42dfd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:22.751787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19330b-3ea6-42d7-9c13-e607b42dfd49 admin admin] PATH_INFO: `/v3/projects/d8e0fefb24e443e7a3d056dfd408079b/users/8542d623972d4969b2bdf89599440508/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:22.752165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e916f6-587a-4313-8226-fe06ac5abd27 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:22.754207 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19330b-3ea6-42d7-9c13-e607b42dfd49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8e0fefb24e443e7a3d056dfd408079b, user_id=8542d623972d4969b2bdf89599440508, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:22.757077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc19330b-3ea6-42d7-9c13-e607b42dfd49 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:22.757218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eef72f-8e4e-4224-86a7-35bfb13a0a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:22.757768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eef72f-8e4e-4224-86a7-35bfb13a0a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:22.758179 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eef72f-8e4e-4224-86a7-35bfb13a0a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:22.758344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eef72f-8e4e-4224-86a7-35bfb13a0a2b admin admin] PATH_INFO: `/v3/users/230769dfdb6445449d478d3a50edb8af` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:22.760225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eef72f-8e4e-4224-86a7-35bfb13a0a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=230769dfdb6445449d478d3a50edb8af)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:22.761442 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eef72f-8e4e-4224-86a7-35bfb13a0a2b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:22.770576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1299/2578] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:22 2022] PUT /identity/v3/projects/d8e0fefb24e443e7a3d056dfd408079b/users/8542d623972d4969b2bdf89599440508/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:22.780789 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45041892-a4b2-477e-91e8-4cabf8ee2f5d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:22.781078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45041892-a4b2-477e-91e8-4cabf8ee2f5d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:22.781356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45041892-a4b2-477e-91e8-4cabf8ee2f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:22.811518 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-45041892-a4b2-477e-91e8-4cabf8ee2f5d None None] MFA Rules not processed for user `8542d623972d4969b2bdf89599440508`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:22.812780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-45041892-a4b2-477e-91e8-4cabf8ee2f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:22.816000 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-95eef72f-8e4e-4224-86a7-35bfb13a0a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230769dfdb6445449d478d3a50edb8af'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:22.824654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-95eef72f-8e4e-4224-86a7-35bfb13a0a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230769dfdb6445449d478d3a50edb8af'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:22.844273 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-95eef72f-8e4e-4224-86a7-35bfb13a0a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230769dfdb6445449d478d3a50edb8af'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:22.862392 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-95eef72f-8e4e-4224-86a7-35bfb13a0a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230769dfdb6445449d478d3a50edb8af'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:22.864067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-95eef72f-8e4e-4224-86a7-35bfb13a0a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230769dfdb6445449d478d3a50edb8af'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:22.871220 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1280/2579] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:22 2022] DELETE /identity/v3/users/230769dfdb6445449d478d3a50edb8af => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:22.873692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eef72f-8e4e-4224-86a7-35bfb13a0a2b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:22.877727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-95eef72f-8e4e-4224-86a7-35bfb13a0a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:22.894218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1300/2580] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:22 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:22.907078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45041892-a4b2-477e-91e8-4cabf8ee2f5d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:22.908479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-45041892-a4b2-477e-91e8-4cabf8ee2f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:22.918390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:22.963170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eef72f-8e4e-4224-86a7-35bfb13a0a2b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:22.969449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba5239-bf6f-4402-90dc-64b32c3eb05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:22.970567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba5239-bf6f-4402-90dc-64b32c3eb05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:22.970775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba5239-bf6f-4402-90dc-64b32c3eb05f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:22.971627 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba5239-bf6f-4402-90dc-64b32c3eb05f admin admin] PATH_INFO: `/v3/projects/3dd82efdd388400590ff71c83386431c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:22.973489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba5239-bf6f-4402-90dc-64b32c3eb05f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd82efdd388400590ff71c83386431c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:22.975406 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba5239-bf6f-4402-90dc-64b32c3eb05f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:22.984233 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45041892-a4b2-477e-91e8-4cabf8ee2f5d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:23.034480 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-20ba5239-bf6f-4402-90dc-64b32c3eb05f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd82efdd388400590ff71c83386431c', 'request_id': 'req-20ba5239-bf6f-4402-90dc-64b32c3eb05f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:23.039738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43afcdbe-00ff-4f64-b4c5-6e650cd719a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:23.040226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afcdbe-00ff-4f64-b4c5-6e650cd719a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.040549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afcdbe-00ff-4f64-b4c5-6e650cd719a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.040863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43afcdbe-00ff-4f64-b4c5-6e650cd719a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.042974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-20ba5239-bf6f-4402-90dc-64b32c3eb05f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd82efdd388400590ff71c83386431c', 'request_id': 'req-20ba5239-bf6f-4402-90dc-64b32c3eb05f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:23.053150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-20ba5239-bf6f-4402-90dc-64b32c3eb05f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd82efdd388400590ff71c83386431c', 'request_id': 'req-20ba5239-bf6f-4402-90dc-64b32c3eb05f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:23.071223 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-20ba5239-bf6f-4402-90dc-64b32c3eb05f admin admin] The token cache is being invalidate because project 3dd82efdd388400590ff71c83386431c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:23.072263 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-20ba5239-bf6f-4402-90dc-64b32c3eb05f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:23.073521 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-20ba5239-bf6f-4402-90dc-64b32c3eb05f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:23.075895 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1281/2581] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:22 2022] DELETE /identity/v3/projects/3dd82efdd388400590ff71c83386431c => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:23.080441 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef76614-baa1-4ff2-a602-7b76be2b8a2d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.080790 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef76614-baa1-4ff2-a602-7b76be2b8a2d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.081073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef76614-baa1-4ff2-a602-7b76be2b8a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.093498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:23.102753 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8ef76614-baa1-4ff2-a602-7b76be2b8a2d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:23.104122 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8ef76614-baa1-4ff2-a602-7b76be2b8a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:23.118320 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afcdbe-00ff-4f64-b4c5-6e650cd719a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:23.119841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43afcdbe-00ff-4f64-b4c5-6e650cd719a1 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:23.132338 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1301/2582] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:22 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:44:23.182567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1282/2583] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:23.190641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556cce2-a6e8-4378-ba55-3b6e2d660a53 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.190927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556cce2-a6e8-4378-ba55-3b6e2d660a53 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.191238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556cce2-a6e8-4378-ba55-3b6e2d660a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.198328 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef76614-baa1-4ff2-a602-7b76be2b8a2d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:23.199981 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8ef76614-baa1-4ff2-a602-7b76be2b8a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:23.224646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-5556cce2-a6e8-4378-ba55-3b6e2d660a53 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:23.225315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef76614-baa1-4ff2-a602-7b76be2b8a2d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:23.225991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5556cce2-a6e8-4378-ba55-3b6e2d660a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:23.230496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:23.231219 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.231635 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.232120 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f admin admin] PATH_INFO: `/v3/projects/be0812a77e754b839eb7ff3ddbda2dc3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.233300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f admin admin] RBAC: Authorizing `identity:delete_project(project_id=be0812a77e754b839eb7ff3ddbda2dc3)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:23.235248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:23.235494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1302/2584] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:23.236430 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556cce2-a6e8-4378-ba55-3b6e2d660a53 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:23.237741 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5556cce2-a6e8-4378-ba55-3b6e2d660a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:23.291239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be0812a77e754b839eb7ff3ddbda2dc3', 'request_id': 'req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:23.293247 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:23.297711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be0812a77e754b839eb7ff3ddbda2dc3', 'request_id': 'req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:23.304521 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556cce2-a6e8-4378-ba55-3b6e2d660a53 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:23.305651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be0812a77e754b839eb7ff3ddbda2dc3', 'request_id': 'req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:23.318296 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f admin admin] The token cache is being invalidate because project be0812a77e754b839eb7ff3ddbda2dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:23.318589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:23.319249 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:23.320794 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1283/2585] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:23 2022] DELETE /identity/v3/projects/be0812a77e754b839eb7ff3ddbda2dc3 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:23.324167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:23.324167 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:23.358840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7a3a7-ec3f-4f6a-b1f1-10e97394e7c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:23.359452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7a3a7-ec3f-4f6a-b1f1-10e97394e7c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.359757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7a3a7-ec3f-4f6a-b1f1-10e97394e7c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.360028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a7a3a7-ec3f-4f6a-b1f1-10e97394e7c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.361843 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-94a7a3a7-ec3f-4f6a-b1f1-10e97394e7c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:23.390967 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a6eab-54a0-48d1-b1c1-d584494fe07f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:23.396153 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1296092-6432-4e82-b53e-d1a0d1689079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:23.396783 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1296092-6432-4e82-b53e-d1a0d1689079 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.397064 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1296092-6432-4e82-b53e-d1a0d1689079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.397337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1296092-6432-4e82-b53e-d1a0d1689079 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.397978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1296092-6432-4e82-b53e-d1a0d1689079 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:44:23.398278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1296092-6432-4e82-b53e-d1a0d1689079 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:23.399870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1296092-6432-4e82-b53e-d1a0d1689079 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:23.412263 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1284/2586] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:44:23.413624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecb499-355f-4dbf-8f49-f1cebc43a9ef None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.414129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecb499-355f-4dbf-8f49-f1cebc43a9ef None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.414248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ecb499-355f-4dbf-8f49-f1cebc43a9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.424197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7a3a7-ec3f-4f6a-b1f1-10e97394e7c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:23.426209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a7a3a7-ec3f-4f6a-b1f1-10e97394e7c5 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:23.433741 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-50ecb499-355f-4dbf-8f49-f1cebc43a9ef None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:23.434926 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-50ecb499-355f-4dbf-8f49-f1cebc43a9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:23.435204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1303/2587] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:23.437129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7a3a7-ec3f-4f6a-b1f1-10e97394e7c5 service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:23.444768 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1285/2588] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:23.453529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a7a3a7-ec3f-4f6a-b1f1-10e97394e7c5 service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:23.454165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23303aac-01f9-43c8-b722-a96e395feb91 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.455112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23303aac-01f9-43c8-b722-a96e395feb91 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.455501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23303aac-01f9-43c8-b722-a96e395feb91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.458883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3aef0-71bb-4c51-8dc6-43dc3162e37c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:23.459487 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3aef0-71bb-4c51-8dc6-43dc3162e37c admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.459765 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3aef0-71bb-4c51-8dc6-43dc3162e37c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.460095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3aef0-71bb-4c51-8dc6-43dc3162e37c admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.460680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3aef0-71bb-4c51-8dc6-43dc3162e37c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:23.462563 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3aef0-71bb-4c51-8dc6-43dc3162e37c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:23.478007 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-23303aac-01f9-43c8-b722-a96e395feb91 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:23.479243 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-23303aac-01f9-43c8-b722-a96e395feb91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:23.491515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1286/2589] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:23.492956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23303aac-01f9-43c8-b722-a96e395feb91 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:23.493124 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1304/2590] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:23 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:23.497511 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3aef0-71bb-4c51-8dc6-43dc3162e37c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:23.502921 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23303aac-01f9-43c8-b722-a96e395feb91 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:23.523694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:23.573960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3aef0-71bb-4c51-8dc6-43dc3162e37c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:23.586639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60993b1-85ff-4151-912e-33464409bb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:23.587346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60993b1-85ff-4151-912e-33464409bb35 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.587598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60993b1-85ff-4151-912e-33464409bb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.588516 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60993b1-85ff-4151-912e-33464409bb35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.589726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60993b1-85ff-4151-912e-33464409bb35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:44:23.589726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60993b1-85ff-4151-912e-33464409bb35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:23.591834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60993b1-85ff-4151-912e-33464409bb35 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:23.594073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649925b-522b-4c6a-92a1-89b3ad5110c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:23.596692 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649925b-522b-4c6a-92a1-89b3ad5110c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.596889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649925b-522b-4c6a-92a1-89b3ad5110c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.597138 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b649925b-522b-4c6a-92a1-89b3ad5110c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.600968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649925b-522b-4c6a-92a1-89b3ad5110c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:23.604013 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b649925b-522b-4c6a-92a1-89b3ad5110c9 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:23.606591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1287/2591] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:44:23.610626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60993b1-85ff-4151-912e-33464409bb35 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:23.623693 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60993b1-85ff-4151-912e-33464409bb35 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:23.629599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0169f9f-1864-4213-a914-0666d0794851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:23.630229 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0169f9f-1864-4213-a914-0666d0794851 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.630504 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0169f9f-1864-4213-a914-0666d0794851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.630773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0169f9f-1864-4213-a914-0666d0794851 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.631407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0169f9f-1864-4213-a914-0666d0794851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:23.632014 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1305/2592] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:23 2022] POST /identity/v3/users => generated 284 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:23.633333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0169f9f-1864-4213-a914-0666d0794851 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:23.636477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649925b-522b-4c6a-92a1-89b3ad5110c9 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:23.649681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b649925b-522b-4c6a-92a1-89b3ad5110c9 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:23.656329 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8e1ed-6e42-48c1-8358-b3a1d81bd089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:23.657073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8e1ed-6e42-48c1-8358-b3a1d81bd089 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.657354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8e1ed-6e42-48c1-8358-b3a1d81bd089 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.657628 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd8e1ed-6e42-48c1-8358-b3a1d81bd089 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.658347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8e1ed-6e42-48c1-8358-b3a1d81bd089 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:23.660583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd8e1ed-6e42-48c1-8358-b3a1d81bd089 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:23.665260 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1288/2593] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:23 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:23.669487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0169f9f-1864-4213-a914-0666d0794851 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:23.676198 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1306/2594] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:23.677209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8e1ed-6e42-48c1-8358-b3a1d81bd089 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:23.686952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd8e1ed-6e42-48c1-8358-b3a1d81bd089 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:23.706208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:23.737032 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0169f9f-1864-4213-a914-0666d0794851 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:23.742718 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc15aa-012f-4015-a047-54275875e98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:23.743315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc15aa-012f-4015-a047-54275875e98c admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.743590 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc15aa-012f-4015-a047-54275875e98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.743862 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc15aa-012f-4015-a047-54275875e98c admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.744484 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc15aa-012f-4015-a047-54275875e98c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:23.745275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f039f5-f7a5-4875-9bbf-646d43528504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:23.745892 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f039f5-f7a5-4875-9bbf-646d43528504 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.746174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f039f5-f7a5-4875-9bbf-646d43528504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.746439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc15aa-012f-4015-a047-54275875e98c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:23.746572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f039f5-f7a5-4875-9bbf-646d43528504 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.747077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f039f5-f7a5-4875-9bbf-646d43528504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:23.748649 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f039f5-f7a5-4875-9bbf-646d43528504 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:23.764095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1307/2595] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:23.765190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f039f5-f7a5-4875-9bbf-646d43528504 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:23.770259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1289/2596] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:23 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:23.771198 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc15aa-012f-4015-a047-54275875e98c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:23.775194 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f039f5-f7a5-4875-9bbf-646d43528504 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:23.779831 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5dabe-b3af-44d5-ac7d-a9bc83ec62b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:23.780464 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5dabe-b3af-44d5-ac7d-a9bc83ec62b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.780686 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc15aa-012f-4015-a047-54275875e98c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:23.780788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5dabe-b3af-44d5-ac7d-a9bc83ec62b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.781052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5dabe-b3af-44d5-ac7d-a9bc83ec62b2 admin admin] PATH_INFO: `/v3/projects/ad70465e11a14e14af1a0dbb55aa33b7/users/295bd1e7d93e4936afffe93091602e1c/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.787262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f4149-1257-4fa4-852d-ece97d5c8eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:23.787896 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f4149-1257-4fa4-852d-ece97d5c8eef admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.788177 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f4149-1257-4fa4-852d-ece97d5c8eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.788468 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859f4149-1257-4fa4-852d-ece97d5c8eef admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.789127 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f4149-1257-4fa4-852d-ece97d5c8eef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:23.791204 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859f4149-1257-4fa4-852d-ece97d5c8eef admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:23.796368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5dabe-b3af-44d5-ac7d-a9bc83ec62b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad70465e11a14e14af1a0dbb55aa33b7, user_id=295bd1e7d93e4936afffe93091602e1c, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:23.799602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5dabe-b3af-44d5-ac7d-a9bc83ec62b2 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:23.802554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1290/2597] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:23.807877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f4149-1257-4fa4-852d-ece97d5c8eef admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:23.814124 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1308/2598] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:23 2022] PUT /identity/v3/projects/ad70465e11a14e14af1a0dbb55aa33b7/users/295bd1e7d93e4936afffe93091602e1c/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:23.817867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859f4149-1257-4fa4-852d-ece97d5c8eef admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:23.824506 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd4650-14b5-42f4-9427-73ee80b24433 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.824641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd4650-14b5-42f4-9427-73ee80b24433 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.824894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccd4650-14b5-42f4-9427-73ee80b24433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.853368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-1ccd4650-14b5-42f4-9427-73ee80b24433 None None] MFA Rules not processed for user `295bd1e7d93e4936afffe93091602e1c`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:23.854613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1ccd4650-14b5-42f4-9427-73ee80b24433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:23.877232 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431e6f0-33f5-4667-a4e9-7e695173d5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:23.877844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431e6f0-33f5-4667-a4e9-7e695173d5cb admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.878126 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431e6f0-33f5-4667-a4e9-7e695173d5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.878399 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6431e6f0-33f5-4667-a4e9-7e695173d5cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.879106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431e6f0-33f5-4667-a4e9-7e695173d5cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:23.880702 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6431e6f0-33f5-4667-a4e9-7e695173d5cb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:23.890445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1291/2599] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:23.894344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431e6f0-33f5-4667-a4e9-7e695173d5cb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:23.903898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6431e6f0-33f5-4667-a4e9-7e695173d5cb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:23.908763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102d5a1-6a5a-4c66-94d8-4c874f01b424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:23.909407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102d5a1-6a5a-4c66-94d8-4c874f01b424 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.909687 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102d5a1-6a5a-4c66-94d8-4c874f01b424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.910459 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102d5a1-6a5a-4c66-94d8-4c874f01b424 admin admin] PATH_INFO: `/v3/projects/49fa8c8d889c4b8eb4f8c59f9fd43200/users/aa79546df651495abf850a92f20b92e2/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.919056 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:23.923757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1309/2600] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:23.930661 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102d5a1-6a5a-4c66-94d8-4c874f01b424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49fa8c8d889c4b8eb4f8c59f9fd43200, user_id=aa79546df651495abf850a92f20b92e2, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:23.933373 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102d5a1-6a5a-4c66-94d8-4c874f01b424 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:23.935102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd4650-14b5-42f4-9427-73ee80b24433 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:23.936473 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1ccd4650-14b5-42f4-9427-73ee80b24433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:23.947288 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1292/2601] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:23 2022] PUT /identity/v3/projects/49fa8c8d889c4b8eb4f8c59f9fd43200/users/aa79546df651495abf850a92f20b92e2/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:23.952370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d57ff-c06e-4305-b21e-0a3ed639e401 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:23.952680 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d57ff-c06e-4305-b21e-0a3ed639e401 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:23.952976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2d57ff-c06e-4305-b21e-0a3ed639e401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:23.971161 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ca2d57ff-c06e-4305-b21e-0a3ed639e401 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:23.972890 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ca2d57ff-c06e-4305-b21e-0a3ed639e401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:23.995366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccd4650-14b5-42f4-9427-73ee80b24433 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:24.031253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1293/2602] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:24.041760 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d57ff-c06e-4305-b21e-0a3ed639e401 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:24.043099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ca2d57ff-c06e-4305-b21e-0a3ed639e401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:24.044607 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb84db-cf37-4bf5-b99d-2021160c6ab0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:24.045250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb84db-cf37-4bf5-b99d-2021160c6ab0 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:24.045531 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb84db-cf37-4bf5-b99d-2021160c6ab0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:24.045803 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb84db-cf37-4bf5-b99d-2021160c6ab0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:24.072579 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:24.104362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb84db-cf37-4bf5-b99d-2021160c6ab0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:24.105342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2d57ff-c06e-4305-b21e-0a3ed639e401 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:24.105870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb84db-cf37-4bf5-b99d-2021160c6ab0 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:24.109034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c2349-bdbf-4429-a172-c5ab9e54e9b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:24.109639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2349-bdbf-4429-a172-c5ab9e54e9b8 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:24.109920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2349-bdbf-4429-a172-c5ab9e54e9b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:24.110195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c2349-bdbf-4429-a172-c5ab9e54e9b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:24.115597 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1310/2603] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:44:24.120155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c2349-bdbf-4429-a172-c5ab9e54e9b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:24.121607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c2349-bdbf-4429-a172-c5ab9e54e9b8 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:24.132367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1294/2604] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:44:24.784067 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ac419-514d-426b-9cac-b35e12c19db6 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:24.784553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ac419-514d-426b-9cac-b35e12c19db6 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:24.785072 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0ac419-514d-426b-9cac-b35e12c19db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:24.821257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9d0ac419-514d-426b-9cac-b35e12c19db6 None None] MFA Rules not processed for user `aa79546df651495abf850a92f20b92e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:24.822490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9d0ac419-514d-426b-9cac-b35e12c19db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:24.897206 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:24.905627 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1311/2605] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:24.906416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c2349-bdbf-4429-a172-c5ab9e54e9b8 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:24.917103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c2349-bdbf-4429-a172-c5ab9e54e9b8 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:24.921918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e50e1-8621-49a5-8af2-dd861407fcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:24.922534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e50e1-8621-49a5-8af2-dd861407fcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:24.922820 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e50e1-8621-49a5-8af2-dd861407fcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:24.923529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5e50e1-8621-49a5-8af2-dd861407fcb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:24.923726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e50e1-8621-49a5-8af2-dd861407fcb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:24.925729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5e50e1-8621-49a5-8af2-dd861407fcb1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:24.956431 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1295/2606] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:24 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:24.960808 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ac419-514d-426b-9cac-b35e12c19db6 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:24.972283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0ac419-514d-426b-9cac-b35e12c19db6 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:25.041633 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39013fc-9c18-4c84-b5be-1cdc5c052b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:25.042411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39013fc-9c18-4c84-b5be-1cdc5c052b16 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:25.042728 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39013fc-9c18-4c84-b5be-1cdc5c052b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:25.043025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39013fc-9c18-4c84-b5be-1cdc5c052b16 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:25.043727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39013fc-9c18-4c84-b5be-1cdc5c052b16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:25.046063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39013fc-9c18-4c84-b5be-1cdc5c052b16 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:25.072702 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1312/2607] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:24 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:25.075040 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e50e1-8621-49a5-8af2-dd861407fcb1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:25.087238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5e50e1-8621-49a5-8af2-dd861407fcb1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:25.096163 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2361f4b-281d-4b49-aa64-b75254273d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:25.096819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2361f4b-281d-4b49-aa64-b75254273d18 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:25.097231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2361f4b-281d-4b49-aa64-b75254273d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:25.097438 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2361f4b-281d-4b49-aa64-b75254273d18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:25.098054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2361f4b-281d-4b49-aa64-b75254273d18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:25.099675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2361f4b-281d-4b49-aa64-b75254273d18 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:25.111031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1296/2608] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:25.115793 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39013fc-9c18-4c84-b5be-1cdc5c052b16 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:25.126052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39013fc-9c18-4c84-b5be-1cdc5c052b16 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:25.131241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7488c5-e83e-43ac-a3ac-56e76f460f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:25.131879 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7488c5-e83e-43ac-a3ac-56e76f460f3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:25.132158 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7488c5-e83e-43ac-a3ac-56e76f460f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:25.132432 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7488c5-e83e-43ac-a3ac-56e76f460f3b admin admin] PATH_INFO: `/v3/projects/1fb4e25e933149d98daa31dcdecc6895/users/ca8af2d653f24ff0810f936006611b13/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:25.146878 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7488c5-e83e-43ac-a3ac-56e76f460f3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb4e25e933149d98daa31dcdecc6895, user_id=ca8af2d653f24ff0810f936006611b13, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:25.149827 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7488c5-e83e-43ac-a3ac-56e76f460f3b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:25.162280 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1313/2609] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:25 2022] PUT /identity/v3/projects/1fb4e25e933149d98daa31dcdecc6895/users/ca8af2d653f24ff0810f936006611b13/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:25.166212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2361f4b-281d-4b49-aa64-b75254273d18 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:25.176793 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2361f4b-281d-4b49-aa64-b75254273d18 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:25.232341 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ce535-f9bf-4b34-8261-88a2d1b5d5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:25.233043 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ce535-f9bf-4b34-8261-88a2d1b5d5e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:25.233329 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ce535-f9bf-4b34-8261-88a2d1b5d5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:25.233607 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ce535-f9bf-4b34-8261-88a2d1b5d5e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:25.234254 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ce535-f9bf-4b34-8261-88a2d1b5d5e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:25.235970 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ce535-f9bf-4b34-8261-88a2d1b5d5e5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:25.248217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1297/2610] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:25 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:25.255422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7488c5-e83e-43ac-a3ac-56e76f460f3b admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:25.266054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7488c5-e83e-43ac-a3ac-56e76f460f3b admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:25.271472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b02a063-f3b5-4367-88cb-18b174edb4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:25.272141 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02a063-f3b5-4367-88cb-18b174edb4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:25.272420 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02a063-f3b5-4367-88cb-18b174edb4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:25.272844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b02a063-f3b5-4367-88cb-18b174edb4bc admin admin] PATH_INFO: `/v3/projects/1fb4e25e933149d98daa31dcdecc6895/users/ca8af2d653f24ff0810f936006611b13/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:25.274815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02a063-f3b5-4367-88cb-18b174edb4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb4e25e933149d98daa31dcdecc6895, user_id=ca8af2d653f24ff0810f936006611b13, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:25.277488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b02a063-f3b5-4367-88cb-18b174edb4bc admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:25.288450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1314/2611] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:25 2022] PUT /identity/v3/projects/1fb4e25e933149d98daa31dcdecc6895/users/ca8af2d653f24ff0810f936006611b13/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:26.181616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaf565-23fb-4b8d-9996-ff7732c70eb5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:26.182119 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaf565-23fb-4b8d-9996-ff7732c70eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:26.182242 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deaf565-23fb-4b8d-9996-ff7732c70eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:26.215401 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5deaf565-23fb-4b8d-9996-ff7732c70eb5 None None] MFA Rules not processed for user `ca8af2d653f24ff0810f936006611b13`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:26.216712 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5deaf565-23fb-4b8d-9996-ff7732c70eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:26.299849 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1298/2612] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:26.310913 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84ae15-3914-4ab6-81ff-2bd7217f96bb None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:26.311465 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84ae15-3914-4ab6-81ff-2bd7217f96bb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:26.311565 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84ae15-3914-4ab6-81ff-2bd7217f96bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:26.335056 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-4b84ae15-3914-4ab6-81ff-2bd7217f96bb None None] MFA Rules not processed for user `aa79546df651495abf850a92f20b92e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:26.336863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4b84ae15-3914-4ab6-81ff-2bd7217f96bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:26.409117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1315/2613] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:26.418056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deaf565-23fb-4b8d-9996-ff7732c70eb5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:26.419761 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5deaf565-23fb-4b8d-9996-ff7732c70eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:26.439480 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:26.504955 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deaf565-23fb-4b8d-9996-ff7732c70eb5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:26.511482 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629b2476-1bda-400b-bd86-929eda526998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7fbb67072ba544e39073787eb25fcf1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:26.512241 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b2476-1bda-400b-bd86-929eda526998 service nova] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:26.512592 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b2476-1bda-400b-bd86-929eda526998 service nova] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:26.512945 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629b2476-1bda-400b-bd86-929eda526998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:26.522617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b2476-1bda-400b-bd86-929eda526998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:26.524218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629b2476-1bda-400b-bd86-929eda526998 service nova] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:26.533641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1299/2614] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:29.771788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84ae15-3914-4ab6-81ff-2bd7217f96bb None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:29.773287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4b84ae15-3914-4ab6-81ff-2bd7217f96bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:29.842574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:29.847829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b84ae15-3914-4ab6-81ff-2bd7217f96bb None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:29.853377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a97f7-12c1-4356-8a02-539275ee1dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:29.854012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a97f7-12c1-4356-8a02-539275ee1dec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:29.854294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a97f7-12c1-4356-8a02-539275ee1dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:29.854583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a97f7-12c1-4356-8a02-539275ee1dec admin admin] PATH_INFO: `/v3/users/94b52bdc0d3143478768278f0bb133a3` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:29.855677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a97f7-12c1-4356-8a02-539275ee1dec admin admin] RBAC: Authorizing `identity:delete_user(user_id=94b52bdc0d3143478768278f0bb133a3)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:29.857707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a97f7-12c1-4356-8a02-539275ee1dec admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:29.907757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ee7a97f7-12c1-4356-8a02-539275ee1dec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94b52bdc0d3143478768278f0bb133a3'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:29.914828 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ee7a97f7-12c1-4356-8a02-539275ee1dec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94b52bdc0d3143478768278f0bb133a3'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:29.929163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ee7a97f7-12c1-4356-8a02-539275ee1dec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94b52bdc0d3143478768278f0bb133a3'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:29.929911 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ee7a97f7-12c1-4356-8a02-539275ee1dec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94b52bdc0d3143478768278f0bb133a3'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:29.937543 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ee7a97f7-12c1-4356-8a02-539275ee1dec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94b52bdc0d3143478768278f0bb133a3'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:29.944390 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1316/2615] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:29 2022] DELETE /identity/v3/users/94b52bdc0d3143478768278f0bb133a3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:29.948889 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339fac4-d15e-4133-881d-58ba5158bd12 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:29.949395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339fac4-d15e-4133-881d-58ba5158bd12 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:29.949600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339fac4-d15e-4133-881d-58ba5158bd12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:29.968339 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-4339fac4-d15e-4133-881d-58ba5158bd12 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:29.969569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4339fac4-d15e-4133-881d-58ba5158bd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:30.028503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1300/2616] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:30.038815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a97f7-12c1-4356-8a02-539275ee1dec admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:30.040210 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ee7a97f7-12c1-4356-8a02-539275ee1dec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:30.099645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a97f7-12c1-4356-8a02-539275ee1dec admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:30.103926 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e505c-00a8-428a-b306-9704b12a1e91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:30.104540 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e505c-00a8-428a-b306-9704b12a1e91 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:30.104925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e505c-00a8-428a-b306-9704b12a1e91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:30.105312 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579e505c-00a8-428a-b306-9704b12a1e91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:30.115019 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e505c-00a8-428a-b306-9704b12a1e91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:30.116512 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579e505c-00a8-428a-b306-9704b12a1e91 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:30.126617 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1317/2617] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:30.393491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339fac4-d15e-4133-881d-58ba5158bd12 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:30.397103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4339fac4-d15e-4133-881d-58ba5158bd12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:30.413681 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339fac4-d15e-4133-881d-58ba5158bd12 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:30.418328 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918830f-61bd-42a7-a561-d61bbeded0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:30.418970 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918830f-61bd-42a7-a561-d61bbeded0b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:30.419270 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918830f-61bd-42a7-a561-d61bbeded0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:30.419525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918830f-61bd-42a7-a561-d61bbeded0b4 admin admin] PATH_INFO: `/v3/projects/18a256d5c15d4f40a5cba3d04345ad7d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:30.420779 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918830f-61bd-42a7-a561-d61bbeded0b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18a256d5c15d4f40a5cba3d04345ad7d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:30.422623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918830f-61bd-42a7-a561-d61bbeded0b4 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:30.469787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3918830f-61bd-42a7-a561-d61bbeded0b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18a256d5c15d4f40a5cba3d04345ad7d', 'request_id': 'req-3918830f-61bd-42a7-a561-d61bbeded0b4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:30.475824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3918830f-61bd-42a7-a561-d61bbeded0b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18a256d5c15d4f40a5cba3d04345ad7d', 'request_id': 'req-3918830f-61bd-42a7-a561-d61bbeded0b4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:30.481878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3918830f-61bd-42a7-a561-d61bbeded0b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18a256d5c15d4f40a5cba3d04345ad7d', 'request_id': 'req-3918830f-61bd-42a7-a561-d61bbeded0b4'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:30.494740 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3918830f-61bd-42a7-a561-d61bbeded0b4 admin admin] The token cache is being invalidate because project 18a256d5c15d4f40a5cba3d04345ad7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:30.495060 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3918830f-61bd-42a7-a561-d61bbeded0b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:30.495671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3918830f-61bd-42a7-a561-d61bbeded0b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:30.497402 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1301/2618] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:30 2022] DELETE /identity/v3/projects/18a256d5c15d4f40a5cba3d04345ad7d => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:30.501193 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e505c-00a8-428a-b306-9704b12a1e91 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:30.510880 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579e505c-00a8-428a-b306-9704b12a1e91 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:30.573813 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8155d3-d778-4adc-8e54-944ac066d708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:30.574503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8155d3-d778-4adc-8e54-944ac066d708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:30.574847 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8155d3-d778-4adc-8e54-944ac066d708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:30.575159 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8155d3-d778-4adc-8e54-944ac066d708 admin admin] PATH_INFO: `/v3/users/8542d623972d4969b2bdf89599440508` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:30.576493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8155d3-d778-4adc-8e54-944ac066d708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8542d623972d4969b2bdf89599440508)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:30.578637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8155d3-d778-4adc-8e54-944ac066d708 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:30.616119 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:30.655788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-cb8155d3-d778-4adc-8e54-944ac066d708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8542d623972d4969b2bdf89599440508'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:30.672211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-cb8155d3-d778-4adc-8e54-944ac066d708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8542d623972d4969b2bdf89599440508'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:30.685732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-cb8155d3-d778-4adc-8e54-944ac066d708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8542d623972d4969b2bdf89599440508'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:30.686507 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-cb8155d3-d778-4adc-8e54-944ac066d708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8542d623972d4969b2bdf89599440508'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:30.695630 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-cb8155d3-d778-4adc-8e54-944ac066d708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8542d623972d4969b2bdf89599440508'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:30.702196 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1318/2619] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:30 2022] DELETE /identity/v3/users/8542d623972d4969b2bdf89599440508 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:30.979844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918830f-61bd-42a7-a561-d61bbeded0b4 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:30.981509 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3918830f-61bd-42a7-a561-d61bbeded0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:31.005689 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918830f-61bd-42a7-a561-d61bbeded0b4 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:31.027099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:31.066534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1846f34-f24b-40bb-97e3-a5f24a305662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:31.067198 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1846f34-f24b-40bb-97e3-a5f24a305662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:31.067473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1846f34-f24b-40bb-97e3-a5f24a305662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:31.067742 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1846f34-f24b-40bb-97e3-a5f24a305662 admin admin] PATH_INFO: `/v3/projects/d8e0fefb24e443e7a3d056dfd408079b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:31.068911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1846f34-f24b-40bb-97e3-a5f24a305662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8e0fefb24e443e7a3d056dfd408079b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:31.070838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1846f34-f24b-40bb-97e3-a5f24a305662 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:31.119025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a1846f34-f24b-40bb-97e3-a5f24a305662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e0fefb24e443e7a3d056dfd408079b', 'request_id': 'req-a1846f34-f24b-40bb-97e3-a5f24a305662'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:31.124676 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a1846f34-f24b-40bb-97e3-a5f24a305662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e0fefb24e443e7a3d056dfd408079b', 'request_id': 'req-a1846f34-f24b-40bb-97e3-a5f24a305662'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:31.131949 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a1846f34-f24b-40bb-97e3-a5f24a305662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e0fefb24e443e7a3d056dfd408079b', 'request_id': 'req-a1846f34-f24b-40bb-97e3-a5f24a305662'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:31.145041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a1846f34-f24b-40bb-97e3-a5f24a305662 admin admin] The token cache is being invalidate because project d8e0fefb24e443e7a3d056dfd408079b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:31.145330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a1846f34-f24b-40bb-97e3-a5f24a305662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:31.145944 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a1846f34-f24b-40bb-97e3-a5f24a305662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:31.147655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1302/2620] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:30 2022] DELETE /identity/v3/projects/d8e0fefb24e443e7a3d056dfd408079b => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:31.153294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2ad3c-3b4a-48fd-b231-7a40b238688f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:31.153834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2ad3c-3b4a-48fd-b231-7a40b238688f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:31.153834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e2ad3c-3b4a-48fd-b231-7a40b238688f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:31.174142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-04e2ad3c-3b4a-48fd-b231-7a40b238688f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:31.175425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-04e2ad3c-3b4a-48fd-b231-7a40b238688f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:31.237649 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1319/2621] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:31.247008 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc9dc4-fe37-4146-8a35-c02e54203aa7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:31.247320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc9dc4-fe37-4146-8a35-c02e54203aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:31.247705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fc9dc4-fe37-4146-8a35-c02e54203aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:31.268653 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b6fc9dc4-fe37-4146-8a35-c02e54203aa7 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:31.270671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b6fc9dc4-fe37-4146-8a35-c02e54203aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:31.279032 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1303/2622] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:31.283310 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2ad3c-3b4a-48fd-b231-7a40b238688f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:31.293903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e2ad3c-3b4a-48fd-b231-7a40b238688f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:31.298587 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5da9a3-66c2-4235-be84-f61df26b8f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:31.299186 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5da9a3-66c2-4235-be84-f61df26b8f6b admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:31.299465 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5da9a3-66c2-4235-be84-f61df26b8f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:31.299737 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5da9a3-66c2-4235-be84-f61df26b8f6b admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:31.301038 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5da9a3-66c2-4235-be84-f61df26b8f6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:44:31.301347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5da9a3-66c2-4235-be84-f61df26b8f6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:31.302938 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5da9a3-66c2-4235-be84-f61df26b8f6b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:31.314732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1320/2623] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:44:31.319364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc9dc4-fe37-4146-8a35-c02e54203aa7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:31.328797 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fc9dc4-fe37-4146-8a35-c02e54203aa7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:31.333599 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775d16d-5c3d-41d5-91f9-ce8d52ac41cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:31.334205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775d16d-5c3d-41d5-91f9-ce8d52ac41cf admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:31.334487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775d16d-5c3d-41d5-91f9-ce8d52ac41cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:31.334764 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0775d16d-5c3d-41d5-91f9-ce8d52ac41cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:31.335395 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775d16d-5c3d-41d5-91f9-ce8d52ac41cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:31.337330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0775d16d-5c3d-41d5-91f9-ce8d52ac41cf admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:31.370182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1304/2624] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:31 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:31.371311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5da9a3-66c2-4235-be84-f61df26b8f6b admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:31.382977 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5da9a3-66c2-4235-be84-f61df26b8f6b admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:31.437294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e124b5-1ee8-45c6-997a-664b056b1028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:31.437899 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e124b5-1ee8-45c6-997a-664b056b1028 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:31.438234 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e124b5-1ee8-45c6-997a-664b056b1028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:31.438446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e124b5-1ee8-45c6-997a-664b056b1028 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:31.439072 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e124b5-1ee8-45c6-997a-664b056b1028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:31.441522 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e124b5-1ee8-45c6-997a-664b056b1028 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:31.465709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1321/2625] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:31 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:31.466868 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775d16d-5c3d-41d5-91f9-ce8d52ac41cf admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:31.477134 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0775d16d-5c3d-41d5-91f9-ce8d52ac41cf admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:31.481712 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087d32d-bab8-4a1b-962a-8b58793d8461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:31.482304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087d32d-bab8-4a1b-962a-8b58793d8461 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:31.482584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087d32d-bab8-4a1b-962a-8b58793d8461 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:31.482857 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b087d32d-bab8-4a1b-962a-8b58793d8461 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:31.483524 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087d32d-bab8-4a1b-962a-8b58793d8461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:31.485137 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b087d32d-bab8-4a1b-962a-8b58793d8461 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:31.495611 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1305/2626] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:31.499479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e124b5-1ee8-45c6-997a-664b056b1028 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:31.510106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e124b5-1ee8-45c6-997a-664b056b1028 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:31.516127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e877bd8c-a045-4994-b5ef-588c800d04d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:31.516751 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877bd8c-a045-4994-b5ef-588c800d04d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:31.517030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877bd8c-a045-4994-b5ef-588c800d04d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:31.517297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e877bd8c-a045-4994-b5ef-588c800d04d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:31.517960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877bd8c-a045-4994-b5ef-588c800d04d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:31.520381 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e877bd8c-a045-4994-b5ef-588c800d04d7 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:31.531669 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1322/2627] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:31.536400 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087d32d-bab8-4a1b-962a-8b58793d8461 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:31.546444 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b087d32d-bab8-4a1b-962a-8b58793d8461 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:31.551092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daeea12-966c-4ec9-9c87-562021630d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:31.551731 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daeea12-966c-4ec9-9c87-562021630d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:31.552015 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daeea12-966c-4ec9-9c87-562021630d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:31.552290 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daeea12-966c-4ec9-9c87-562021630d06 admin admin] PATH_INFO: `/v3/projects/8514dc4d2dab4bb9b80bfed05d21a418/users/d0c682383daf492caba988685bf602e7/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:31.566524 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daeea12-966c-4ec9-9c87-562021630d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8514dc4d2dab4bb9b80bfed05d21a418, user_id=d0c682383daf492caba988685bf602e7, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:31.569196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daeea12-966c-4ec9-9c87-562021630d06 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:31.582911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1306/2628] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:31 2022] PUT /identity/v3/projects/8514dc4d2dab4bb9b80bfed05d21a418/users/d0c682383daf492caba988685bf602e7/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:31.593084 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb5286-8ecf-4221-9041-80a30e1da859 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:31.593436 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb5286-8ecf-4221-9041-80a30e1da859 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:31.593713 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fb5286-8ecf-4221-9041-80a30e1da859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:31.603336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:31.624957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-65fb5286-8ecf-4221-9041-80a30e1da859 None None] MFA Rules not processed for user `d0c682383daf492caba988685bf602e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:31.626195 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-65fb5286-8ecf-4221-9041-80a30e1da859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:31.693691 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1323/2629] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:31.697932 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daeea12-966c-4ec9-9c87-562021630d06 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:31.757370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:31.773063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daeea12-966c-4ec9-9c87-562021630d06 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:31.781376 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6293f-42f3-40c6-856f-8b4c2ede4f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:31.782087 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6293f-42f3-40c6-856f-8b4c2ede4f6e admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:31.782703 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6293f-42f3-40c6-856f-8b4c2ede4f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:31.783311 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab6293f-42f3-40c6-856f-8b4c2ede4f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:31.784155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6293f-42f3-40c6-856f-8b4c2ede4f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:31.789145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab6293f-42f3-40c6-856f-8b4c2ede4f6e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:31.836923 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1307/2630] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:31 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:31.840613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb5286-8ecf-4221-9041-80a30e1da859 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:31.855117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fb5286-8ecf-4221-9041-80a30e1da859 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:31.931448 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf812609-4d47-4263-8bcc-f3fa49349631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:31.931905 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf812609-4d47-4263-8bcc-f3fa49349631 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:31.932154 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf812609-4d47-4263-8bcc-f3fa49349631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:31.932425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf812609-4d47-4263-8bcc-f3fa49349631 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:31.933122 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf812609-4d47-4263-8bcc-f3fa49349631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:31.935185 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf812609-4d47-4263-8bcc-f3fa49349631 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:31.961870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1324/2631] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:31 2022] POST /identity/v3/users => generated 297 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:31.965765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6293f-42f3-40c6-856f-8b4c2ede4f6e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:31.978621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab6293f-42f3-40c6-856f-8b4c2ede4f6e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:31.983512 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfe842-948d-4639-bd00-24f812bdb7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:31.984189 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfe842-948d-4639-bd00-24f812bdb7fb admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:31.984534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfe842-948d-4639-bd00-24f812bdb7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:31.985002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbfe842-948d-4639-bd00-24f812bdb7fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:31.985721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbfe842-948d-4639-bd00-24f812bdb7fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:31.987416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbfe842-948d-4639-bd00-24f812bdb7fb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:32.000302 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1308/2632] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:32.005646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf812609-4d47-4263-8bcc-f3fa49349631 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:32.016025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf812609-4d47-4263-8bcc-f3fa49349631 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:32.021323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db93835-f87d-4ae0-a6f4-24a331d86794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:32.021982 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db93835-f87d-4ae0-a6f4-24a331d86794 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:32.022258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db93835-f87d-4ae0-a6f4-24a331d86794 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:32.022526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db93835-f87d-4ae0-a6f4-24a331d86794 admin admin] PATH_INFO: `/v3/projects/033e490050a3407cbce2a93c9b8cb83f/users/d5719a43d1644bdbb436116b9231a875/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:32.038503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db93835-f87d-4ae0-a6f4-24a331d86794 admin admin] RBAC: Authorizing `identity:create_grant(project_id=033e490050a3407cbce2a93c9b8cb83f, user_id=d5719a43d1644bdbb436116b9231a875, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:32.041202 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db93835-f87d-4ae0-a6f4-24a331d86794 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:32.054791 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1325/2633] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:32 2022] PUT /identity/v3/projects/033e490050a3407cbce2a93c9b8cb83f/users/d5719a43d1644bdbb436116b9231a875/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:32.058663 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfe842-948d-4639-bd00-24f812bdb7fb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:32.069457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbfe842-948d-4639-bd00-24f812bdb7fb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:32.128884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351f4ee-c109-434b-a108-33f25e5c080e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:32.129491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351f4ee-c109-434b-a108-33f25e5c080e admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:32.129773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351f4ee-c109-434b-a108-33f25e5c080e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:32.130054 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351f4ee-c109-434b-a108-33f25e5c080e admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:32.130698 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351f4ee-c109-434b-a108-33f25e5c080e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:32.132251 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351f4ee-c109-434b-a108-33f25e5c080e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:32.142059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1309/2634] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:32.146853 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db93835-f87d-4ae0-a6f4-24a331d86794 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:32.157287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db93835-f87d-4ae0-a6f4-24a331d86794 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:32.162528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4280c-e547-4c06-820c-fed41d04e3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:32.163171 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4280c-e547-4c06-820c-fed41d04e3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:32.163449 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4280c-e547-4c06-820c-fed41d04e3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:32.163724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae4280c-e547-4c06-820c-fed41d04e3fd admin admin] PATH_INFO: `/v3/projects/033e490050a3407cbce2a93c9b8cb83f/users/d5719a43d1644bdbb436116b9231a875/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:32.165666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4280c-e547-4c06-820c-fed41d04e3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=033e490050a3407cbce2a93c9b8cb83f, user_id=d5719a43d1644bdbb436116b9231a875, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:32.168279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae4280c-e547-4c06-820c-fed41d04e3fd admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:32.178857 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1326/2635] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:32 2022] PUT /identity/v3/projects/033e490050a3407cbce2a93c9b8cb83f/users/d5719a43d1644bdbb436116b9231a875/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:32.188910 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807cbf6-1fa2-4b07-b70f-c867bc8f8271 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:32.189192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807cbf6-1fa2-4b07-b70f-c867bc8f8271 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:32.189461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2807cbf6-1fa2-4b07-b70f-c867bc8f8271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:32.218555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2807cbf6-1fa2-4b07-b70f-c867bc8f8271 None None] MFA Rules not processed for user `d5719a43d1644bdbb436116b9231a875`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:32.219811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2807cbf6-1fa2-4b07-b70f-c867bc8f8271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:32.295743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1310/2636] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:32.309322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4280c-e547-4c06-820c-fed41d04e3fd admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:32.311208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fae4280c-e547-4c06-820c-fed41d04e3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:32.365414 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:32.372378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae4280c-e547-4c06-820c-fed41d04e3fd admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:32.376047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40e1f6-802e-44f6-9c39-4c0a8cb69447 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:32.376644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40e1f6-802e-44f6-9c39-4c0a8cb69447 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:32.376974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40e1f6-802e-44f6-9c39-4c0a8cb69447 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:32.377240 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e40e1f6-802e-44f6-9c39-4c0a8cb69447 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:32.386292 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40e1f6-802e-44f6-9c39-4c0a8cb69447 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:32.387703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e40e1f6-802e-44f6-9c39-4c0a8cb69447 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:32.397461 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1327/2637] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:32 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:32.710934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807cbf6-1fa2-4b07-b70f-c867bc8f8271 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:32.719960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2807cbf6-1fa2-4b07-b70f-c867bc8f8271 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:32.728753 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884c9e9-ff7d-4076-aa4f-9845065e331a tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5719a43d1644bdbb436116b9231a875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033e490050a3407cbce2a93c9b8cb83f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:32.730588 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884c9e9-ff7d-4076-aa4f-9845065e331a tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:32.731057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884c9e9-ff7d-4076-aa4f-9845065e331a tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:32.732309 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0884c9e9-ff7d-4076-aa4f-9845065e331a tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:32.733382 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884c9e9-ff7d-4076-aa4f-9845065e331a tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:44:32.734692 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884c9e9-ff7d-4076-aa4f-9845065e331a tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:32.738272 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0884c9e9-ff7d-4076-aa4f-9845065e331a tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:32.755460 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1311/2638] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:44:32.759586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40e1f6-802e-44f6-9c39-4c0a8cb69447 service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:32.768733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e40e1f6-802e-44f6-9c39-4c0a8cb69447 service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:32.773876 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5939c-426b-46c9-b95b-b82b7be2103c tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5719a43d1644bdbb436116b9231a875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033e490050a3407cbce2a93c9b8cb83f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:32.774456 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5939c-426b-46c9-b95b-b82b7be2103c tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:32.774738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5939c-426b-46c9-b95b-b82b7be2103c tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:32.775012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde5939c-426b-46c9-b95b-b82b7be2103c tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:32.775663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5939c-426b-46c9-b95b-b82b7be2103c tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:32.777594 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde5939c-426b-46c9-b95b-b82b7be2103c tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:32.804150 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1328/2639] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:32 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:32.808159 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884c9e9-ff7d-4076-aa4f-9845065e331a tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:32.818539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0884c9e9-ff7d-4076-aa4f-9845065e331a tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:32.849494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:32.855184 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5939c-426b-46c9-b95b-b82b7be2103c tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:32.857316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-dde5939c-426b-46c9-b95b-b82b7be2103c tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:32.884454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483c89d-9e65-4e8f-9012-faca265b9f41 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5719a43d1644bdbb436116b9231a875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033e490050a3407cbce2a93c9b8cb83f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:32.884992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483c89d-9e65-4e8f-9012-faca265b9f41 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:32.885270 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483c89d-9e65-4e8f-9012-faca265b9f41 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:32.885550 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483c89d-9e65-4e8f-9012-faca265b9f41 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:32.886190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483c89d-9e65-4e8f-9012-faca265b9f41 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:44:32.886496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483c89d-9e65-4e8f-9012-faca265b9f41 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:32.888197 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2483c89d-9e65-4e8f-9012-faca265b9f41 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:32.921421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1312/2640] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:44:32.937290 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde5939c-426b-46c9-b95b-b82b7be2103c tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:32.942433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c191ac8-432f-4a18-b70a-26eb0e3ce293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:32.943117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c191ac8-432f-4a18-b70a-26eb0e3ce293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:32.943399 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c191ac8-432f-4a18-b70a-26eb0e3ce293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:32.943704 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c191ac8-432f-4a18-b70a-26eb0e3ce293 admin admin] PATH_INFO: `/v3/users/295bd1e7d93e4936afffe93091602e1c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:32.944902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c191ac8-432f-4a18-b70a-26eb0e3ce293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=295bd1e7d93e4936afffe93091602e1c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:32.946800 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c191ac8-432f-4a18-b70a-26eb0e3ce293 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:32.957541 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483c89d-9e65-4e8f-9012-faca265b9f41 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:32.967634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483c89d-9e65-4e8f-9012-faca265b9f41 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:32.972552 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f3a4d-53ed-4714-a085-8ac02130c031 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd5719a43d1644bdbb436116b9231a875', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '033e490050a3407cbce2a93c9b8cb83f', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:32.972976 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f3a4d-53ed-4714-a085-8ac02130c031 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:32.973276 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f3a4d-53ed-4714-a085-8ac02130c031 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:32.973594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62f3a4d-53ed-4714-a085-8ac02130c031 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] PATH_INFO: `/v3/projects/fee1e0a6017e41fd9687bc17a31b51bc` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:32.974727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f3a4d-53ed-4714-a085-8ac02130c031 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] RBAC: Authorizing `identity:delete_project(project_id=fee1e0a6017e41fd9687bc17a31b51bc)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:32.976775 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62f3a4d-53ed-4714-a085-8ac02130c031 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:33.003739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9c191ac8-432f-4a18-b70a-26eb0e3ce293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '295bd1e7d93e4936afffe93091602e1c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.012439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9c191ac8-432f-4a18-b70a-26eb0e3ce293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '295bd1e7d93e4936afffe93091602e1c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.027279 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9c191ac8-432f-4a18-b70a-26eb0e3ce293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '295bd1e7d93e4936afffe93091602e1c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.028162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9c191ac8-432f-4a18-b70a-26eb0e3ce293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '295bd1e7d93e4936afffe93091602e1c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.034487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b62f3a4d-53ed-4714-a085-8ac02130c031 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fee1e0a6017e41fd9687bc17a31b51bc', 'request_id': 'req-b62f3a4d-53ed-4714-a085-8ac02130c031'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.038151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9c191ac8-432f-4a18-b70a-26eb0e3ce293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '295bd1e7d93e4936afffe93091602e1c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.042594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b62f3a4d-53ed-4714-a085-8ac02130c031 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fee1e0a6017e41fd9687bc17a31b51bc', 'request_id': 'req-b62f3a4d-53ed-4714-a085-8ac02130c031'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.046570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1329/2641] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:32 2022] DELETE /identity/v3/users/295bd1e7d93e4936afffe93091602e1c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:33.052080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d4fb8-32db-4c35-8839-e35be7270a9a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:33.052260 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b62f3a4d-53ed-4714-a085-8ac02130c031 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fee1e0a6017e41fd9687bc17a31b51bc', 'request_id': 'req-b62f3a4d-53ed-4714-a085-8ac02130c031'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.052383 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d4fb8-32db-4c35-8839-e35be7270a9a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:33.052686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d4fb8-32db-4c35-8839-e35be7270a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:33.069030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b62f3a4d-53ed-4714-a085-8ac02130c031 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] The token cache is being invalidate because project fee1e0a6017e41fd9687bc17a31b51bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:33.069323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b62f3a4d-53ed-4714-a085-8ac02130c031 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.069980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b62f3a4d-53ed-4714-a085-8ac02130c031 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.071705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1313/2642] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:32 2022] DELETE /identity/v3/projects/fee1e0a6017e41fd9687bc17a31b51bc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:33.083128 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-696d4fb8-32db-4c35-8839-e35be7270a9a None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:33.084271 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-696d4fb8-32db-4c35-8839-e35be7270a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:33.135546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:33.169017 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1330/2643] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:33.179060 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f3a4d-53ed-4714-a085-8ac02130c031 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:33.180749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b62f3a4d-53ed-4714-a085-8ac02130c031 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:33.241099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62f3a4d-53ed-4714-a085-8ac02130c031 tempest-VolumeQuotaClassesTest-1429934635 tempest-VolumeQuotaClassesTest-1429934635-project-admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:33.270445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d4fb8-32db-4c35-8839-e35be7270a9a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:33.272008 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-696d4fb8-32db-4c35-8839-e35be7270a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:33.284093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d4fb8-32db-4c35-8839-e35be7270a9a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:33.288901 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd6f01-7400-4e44-8f85-a2dfff57e77a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:33.289523 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd6f01-7400-4e44-8f85-a2dfff57e77a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:33.289802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd6f01-7400-4e44-8f85-a2dfff57e77a admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:33.290073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fd6f01-7400-4e44-8f85-a2dfff57e77a admin admin] PATH_INFO: `/v3/users/d0c682383daf492caba988685bf602e7` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:33.291187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd6f01-7400-4e44-8f85-a2dfff57e77a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0c682383daf492caba988685bf602e7)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:33.292200 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b278a9b-ebe7-4f5d-a760-f515ca4190a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:33.292862 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b278a9b-ebe7-4f5d-a760-f515ca4190a0 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:33.293138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b278a9b-ebe7-4f5d-a760-f515ca4190a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:33.293249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fd6f01-7400-4e44-8f85-a2dfff57e77a admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:33.293407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b278a9b-ebe7-4f5d-a760-f515ca4190a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:33.303082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b278a9b-ebe7-4f5d-a760-f515ca4190a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:33.304491 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b278a9b-ebe7-4f5d-a760-f515ca4190a0 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:33.313951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1314/2644] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:33.342473 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-19fd6f01-7400-4e44-8f85-a2dfff57e77a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0c682383daf492caba988685bf602e7'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.350709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-19fd6f01-7400-4e44-8f85-a2dfff57e77a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0c682383daf492caba988685bf602e7'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.365047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-19fd6f01-7400-4e44-8f85-a2dfff57e77a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0c682383daf492caba988685bf602e7'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.365821 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-19fd6f01-7400-4e44-8f85-a2dfff57e77a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0c682383daf492caba988685bf602e7'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.372852 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-19fd6f01-7400-4e44-8f85-a2dfff57e77a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0c682383daf492caba988685bf602e7'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.379241 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1331/2645] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:33 2022] DELETE /identity/v3/users/d0c682383daf492caba988685bf602e7 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:33.384147 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92e0dc-d976-4a5b-8e86-ed4caa5cd96d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:33.384437 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92e0dc-d976-4a5b-8e86-ed4caa5cd96d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:33.384776 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff92e0dc-d976-4a5b-8e86-ed4caa5cd96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:33.404100 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ff92e0dc-d976-4a5b-8e86-ed4caa5cd96d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:33.405351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ff92e0dc-d976-4a5b-8e86-ed4caa5cd96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:33.409326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:33.474474 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1315/2646] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:33.484866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd6f01-7400-4e44-8f85-a2dfff57e77a admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:33.486348 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-19fd6f01-7400-4e44-8f85-a2dfff57e77a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:33.545538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fd6f01-7400-4e44-8f85-a2dfff57e77a admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:33.549186 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930bf6e6-4579-4e37-9fd0-a8a404a27521 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:33.549783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bf6e6-4579-4e37-9fd0-a8a404a27521 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:33.550063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bf6e6-4579-4e37-9fd0-a8a404a27521 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:33.550385 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930bf6e6-4579-4e37-9fd0-a8a404a27521 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:33.560499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bf6e6-4579-4e37-9fd0-a8a404a27521 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:33.561997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930bf6e6-4579-4e37-9fd0-a8a404a27521 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:33.573173 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1332/2647] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:33.610419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92e0dc-d976-4a5b-8e86-ed4caa5cd96d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:33.612110 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ff92e0dc-d976-4a5b-8e86-ed4caa5cd96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:33.628942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff92e0dc-d976-4a5b-8e86-ed4caa5cd96d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:33.631883 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f898f47-ab4e-466a-ab2e-e6a1f3e4fdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:33.632703 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f898f47-ab4e-466a-ab2e-e6a1f3e4fdb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:33.633005 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f898f47-ab4e-466a-ab2e-e6a1f3e4fdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:33.633351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f898f47-ab4e-466a-ab2e-e6a1f3e4fdb6 admin admin] PATH_INFO: `/v3/projects/ad70465e11a14e14af1a0dbb55aa33b7` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:33.634591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f898f47-ab4e-466a-ab2e-e6a1f3e4fdb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad70465e11a14e14af1a0dbb55aa33b7)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:33.636707 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f898f47-ab4e-466a-ab2e-e6a1f3e4fdb6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:33.694715 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2f898f47-ab4e-466a-ab2e-e6a1f3e4fdb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad70465e11a14e14af1a0dbb55aa33b7', 'request_id': 'req-2f898f47-ab4e-466a-ab2e-e6a1f3e4fdb6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.700578 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2f898f47-ab4e-466a-ab2e-e6a1f3e4fdb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad70465e11a14e14af1a0dbb55aa33b7', 'request_id': 'req-2f898f47-ab4e-466a-ab2e-e6a1f3e4fdb6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.707130 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2f898f47-ab4e-466a-ab2e-e6a1f3e4fdb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad70465e11a14e14af1a0dbb55aa33b7', 'request_id': 'req-2f898f47-ab4e-466a-ab2e-e6a1f3e4fdb6'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.723358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2f898f47-ab4e-466a-ab2e-e6a1f3e4fdb6 admin admin] The token cache is being invalidate because project ad70465e11a14e14af1a0dbb55aa33b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:33.723645 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2f898f47-ab4e-466a-ab2e-e6a1f3e4fdb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.724322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2f898f47-ab4e-466a-ab2e-e6a1f3e4fdb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:33.726125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1316/2648] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:33 2022] DELETE /identity/v3/projects/ad70465e11a14e14af1a0dbb55aa33b7 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:33.730802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e4680-bb99-420b-9360-afece6f9bd25 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:33.731276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e4680-bb99-420b-9360-afece6f9bd25 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:33.731701 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68e4680-bb99-420b-9360-afece6f9bd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:33.768704 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e68e4680-bb99-420b-9360-afece6f9bd25 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:33.771071 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e68e4680-bb99-420b-9360-afece6f9bd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:33.841397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1333/2649] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:33.851024 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe55af-bee0-48eb-a34d-783478a160be None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:33.851313 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe55af-bee0-48eb-a34d-783478a160be None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:33.851691 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbe55af-bee0-48eb-a34d-783478a160be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:33.874536 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5dbe55af-bee0-48eb-a34d-783478a160be None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:33.876045 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5dbe55af-bee0-48eb-a34d-783478a160be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:33.887844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1317/2650] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:33.893781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e4680-bb99-420b-9360-afece6f9bd25 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:33.905656 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe55af-bee0-48eb-a34d-783478a160be None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:33.907026 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:33.911484 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5dbe55af-bee0-48eb-a34d-783478a160be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:33.919318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68e4680-bb99-420b-9360-afece6f9bd25 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:33.929016 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0374238-1201-4c77-9a75-399c85f694de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:33.929868 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0374238-1201-4c77-9a75-399c85f694de admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:33.930316 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0374238-1201-4c77-9a75-399c85f694de admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:33.930749 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0374238-1201-4c77-9a75-399c85f694de admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:33.931406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0374238-1201-4c77-9a75-399c85f694de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:44:33.931888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0374238-1201-4c77-9a75-399c85f694de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:33.933592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0374238-1201-4c77-9a75-399c85f694de admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:33.939785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbe55af-bee0-48eb-a34d-783478a160be None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:33.950044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1334/2651] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:44:33.950210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3df985-15fa-406e-b066-91e05bc736ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:33.950210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3df985-15fa-406e-b066-91e05bc736ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:33.950210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3df985-15fa-406e-b066-91e05bc736ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:33.950210 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3df985-15fa-406e-b066-91e05bc736ed admin admin] PATH_INFO: `/v3/projects/8514dc4d2dab4bb9b80bfed05d21a418` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:33.950590 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3df985-15fa-406e-b066-91e05bc736ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8514dc4d2dab4bb9b80bfed05d21a418)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:33.951313 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0374238-1201-4c77-9a75-399c85f694de admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:33.953474 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3df985-15fa-406e-b066-91e05bc736ed admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:33.975814 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0374238-1201-4c77-9a75-399c85f694de admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:33.982165 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd445a-f57d-4dcf-b837-4672126c7c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:33.982960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd445a-f57d-4dcf-b837-4672126c7c07 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:33.983106 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd445a-f57d-4dcf-b837-4672126c7c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:33.983328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd445a-f57d-4dcf-b837-4672126c7c07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:33.984648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd445a-f57d-4dcf-b837-4672126c7c07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:33.986929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd445a-f57d-4dcf-b837-4672126c7c07 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:34.016444 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dc3df985-15fa-406e-b066-91e05bc736ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8514dc4d2dab4bb9b80bfed05d21a418', 'request_id': 'req-dc3df985-15fa-406e-b066-91e05bc736ed'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:34.023561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dc3df985-15fa-406e-b066-91e05bc736ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8514dc4d2dab4bb9b80bfed05d21a418', 'request_id': 'req-dc3df985-15fa-406e-b066-91e05bc736ed'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:34.030894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1335/2652] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:33 2022] POST /identity/v3/projects => generated 391 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:34.032061 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dc3df985-15fa-406e-b066-91e05bc736ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8514dc4d2dab4bb9b80bfed05d21a418', 'request_id': 'req-dc3df985-15fa-406e-b066-91e05bc736ed'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:34.032493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd445a-f57d-4dcf-b837-4672126c7c07 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:34.047241 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dc3df985-15fa-406e-b066-91e05bc736ed admin admin] The token cache is being invalidate because project 8514dc4d2dab4bb9b80bfed05d21a418 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:34.047837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dc3df985-15fa-406e-b066-91e05bc736ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:34.048357 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-dc3df985-15fa-406e-b066-91e05bc736ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:34.049980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1318/2653] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:33 2022] DELETE /identity/v3/projects/8514dc4d2dab4bb9b80bfed05d21a418 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:34.054951 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3df985-15fa-406e-b066-91e05bc736ed admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:34.056437 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-dc3df985-15fa-406e-b066-91e05bc736ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:34.067759 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:34.105431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd445a-f57d-4dcf-b837-4672126c7c07 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:34.110262 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c976c-9887-44fa-aae1-2d5e4ca60bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:34.110869 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c976c-9887-44fa-aae1-2d5e4ca60bcc admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.111406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c976c-9887-44fa-aae1-2d5e4ca60bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.111406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c976c-9887-44fa-aae1-2d5e4ca60bcc admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:34.112044 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c976c-9887-44fa-aae1-2d5e4ca60bcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:34.114024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c976c-9887-44fa-aae1-2d5e4ca60bcc admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:34.127154 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3df985-15fa-406e-b066-91e05bc736ed admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:34.132874 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965cca5c-a633-4c29-988f-25ee2b160ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:34.133570 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cca5c-a633-4c29-988f-25ee2b160ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.133862 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cca5c-a633-4c29-988f-25ee2b160ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.134140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965cca5c-a633-4c29-988f-25ee2b160ae2 admin admin] PATH_INFO: `/v3/users/d5719a43d1644bdbb436116b9231a875` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:34.136142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cca5c-a633-4c29-988f-25ee2b160ae2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5719a43d1644bdbb436116b9231a875)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:34.138298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965cca5c-a633-4c29-988f-25ee2b160ae2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:34.142162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1336/2654] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:34 2022] POST /identity/v3/users => generated 296 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:34.146502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c976c-9887-44fa-aae1-2d5e4ca60bcc admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:34.148157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-973c976c-9887-44fa-aae1-2d5e4ca60bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:34.161888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c976c-9887-44fa-aae1-2d5e4ca60bcc admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:34.167904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c30e8-49d7-469e-8e1d-82770233132b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:34.168520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c30e8-49d7-469e-8e1d-82770233132b admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.168889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c30e8-49d7-469e-8e1d-82770233132b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.169153 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c30e8-49d7-469e-8e1d-82770233132b admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:34.169835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c30e8-49d7-469e-8e1d-82770233132b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:34.171506 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c30e8-49d7-469e-8e1d-82770233132b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:34.186303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1337/2655] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:34.187012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c30e8-49d7-469e-8e1d-82770233132b admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:34.197486 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c30e8-49d7-469e-8e1d-82770233132b admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:34.197781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-965cca5c-a633-4c29-988f-25ee2b160ae2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5719a43d1644bdbb436116b9231a875'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:34.202261 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976f5b7-f4cb-4f6c-a7d4-aa78ee1505fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:34.202866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976f5b7-f4cb-4f6c-a7d4-aa78ee1505fd admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.203152 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976f5b7-f4cb-4f6c-a7d4-aa78ee1505fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.203562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0976f5b7-f4cb-4f6c-a7d4-aa78ee1505fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:34.204218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976f5b7-f4cb-4f6c-a7d4-aa78ee1505fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:34.205858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0976f5b7-f4cb-4f6c-a7d4-aa78ee1505fd admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:34.206330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-965cca5c-a633-4c29-988f-25ee2b160ae2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5719a43d1644bdbb436116b9231a875'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:34.222630 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1338/2656] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:34.223904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976f5b7-f4cb-4f6c-a7d4-aa78ee1505fd admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:34.229992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-965cca5c-a633-4c29-988f-25ee2b160ae2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5719a43d1644bdbb436116b9231a875'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:34.234735 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0976f5b7-f4cb-4f6c-a7d4-aa78ee1505fd admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:34.240307 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d8b76-f01f-4330-a397-61bc6037253e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:34.241155 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d8b76-f01f-4330-a397-61bc6037253e admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.241499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d8b76-f01f-4330-a397-61bc6037253e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.241873 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d8b76-f01f-4330-a397-61bc6037253e admin admin] PATH_INFO: `/v3/projects/ea13c7dac4d445889ce17741c78938fc/users/5b0a829bfdd64d4b9fbf6f18e364a756/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:34.243494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-965cca5c-a633-4c29-988f-25ee2b160ae2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5719a43d1644bdbb436116b9231a875'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:34.244259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-965cca5c-a633-4c29-988f-25ee2b160ae2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5719a43d1644bdbb436116b9231a875'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:34.251288 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1319/2657] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:34 2022] DELETE /identity/v3/users/d5719a43d1644bdbb436116b9231a875 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:34.260345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d8b76-f01f-4330-a397-61bc6037253e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea13c7dac4d445889ce17741c78938fc, user_id=5b0a829bfdd64d4b9fbf6f18e364a756, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:34.263073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d8b76-f01f-4330-a397-61bc6037253e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:34.282047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1339/2658] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:34 2022] PUT /identity/v3/projects/ea13c7dac4d445889ce17741c78938fc/users/5b0a829bfdd64d4b9fbf6f18e364a756/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:34.292837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de49f3-f6d7-47bd-b2a1-24b632041191 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.293254 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de49f3-f6d7-47bd-b2a1-24b632041191 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.293632 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06de49f3-f6d7-47bd-b2a1-24b632041191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:34.324969 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-06de49f3-f6d7-47bd-b2a1-24b632041191 None None] MFA Rules not processed for user `5b0a829bfdd64d4b9fbf6f18e364a756`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:34.326439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-06de49f3-f6d7-47bd-b2a1-24b632041191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:34.421866 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1320/2659] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:34.428197 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d8b76-f01f-4330-a397-61bc6037253e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:34.430020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-eb3d8b76-f01f-4330-a397-61bc6037253e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:34.515483 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d8b76-f01f-4330-a397-61bc6037253e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:34.520280 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd8e72-8410-4a03-aa0d-47c076e8925f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:34.521075 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd8e72-8410-4a03-aa0d-47c076e8925f admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.521314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd8e72-8410-4a03-aa0d-47c076e8925f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.521583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fd8e72-8410-4a03-aa0d-47c076e8925f admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:34.522367 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd8e72-8410-4a03-aa0d-47c076e8925f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:34.524254 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fd8e72-8410-4a03-aa0d-47c076e8925f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:34.540519 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:34.564892 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1340/2660] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:34 2022] POST /identity/v3/projects => generated 393 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:34.570292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de49f3-f6d7-47bd-b2a1-24b632041191 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:34.585554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06de49f3-f6d7-47bd-b2a1-24b632041191 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:34.592348 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd8e72-8410-4a03-aa0d-47c076e8925f admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:34.594171 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c1fd8e72-8410-4a03-aa0d-47c076e8925f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:34.607088 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:34.673713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae35ff-51ba-42c5-ada7-f557f9252e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:34.674685 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae35ff-51ba-42c5-ada7-f557f9252e5b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.674966 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae35ff-51ba-42c5-ada7-f557f9252e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.675793 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae35ff-51ba-42c5-ada7-f557f9252e5b admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:34.676436 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae35ff-51ba-42c5-ada7-f557f9252e5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:34.678700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae35ff-51ba-42c5-ada7-f557f9252e5b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:34.685173 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fd8e72-8410-4a03-aa0d-47c076e8925f admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:34.690331 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83683b3-74c0-4f14-8e88-98cb59fbc4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:34.691420 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83683b3-74c0-4f14-8e88-98cb59fbc4df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.691707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83683b3-74c0-4f14-8e88-98cb59fbc4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.691974 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83683b3-74c0-4f14-8e88-98cb59fbc4df admin admin] PATH_INFO: `/v3/projects/033e490050a3407cbce2a93c9b8cb83f` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:34.693235 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83683b3-74c0-4f14-8e88-98cb59fbc4df admin admin] RBAC: Authorizing `identity:delete_project(project_id=033e490050a3407cbce2a93c9b8cb83f)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:34.695147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83683b3-74c0-4f14-8e88-98cb59fbc4df admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:34.710582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1321/2661] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:34 2022] POST /identity/v3/users => generated 303 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:34.717041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae35ff-51ba-42c5-ada7-f557f9252e5b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:34.727278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae35ff-51ba-42c5-ada7-f557f9252e5b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:34.732855 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab805922-8512-43c9-b237-a694f872483d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:34.733576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab805922-8512-43c9-b237-a694f872483d admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.733917 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab805922-8512-43c9-b237-a694f872483d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.734264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab805922-8512-43c9-b237-a694f872483d admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:34.734989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab805922-8512-43c9-b237-a694f872483d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:34.736655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab805922-8512-43c9-b237-a694f872483d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:34.749401 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1322/2662] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:34.753002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab805922-8512-43c9-b237-a694f872483d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:34.758042 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c83683b3-74c0-4f14-8e88-98cb59fbc4df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '033e490050a3407cbce2a93c9b8cb83f', 'request_id': 'req-c83683b3-74c0-4f14-8e88-98cb59fbc4df'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:34.764819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab805922-8512-43c9-b237-a694f872483d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:34.767795 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c83683b3-74c0-4f14-8e88-98cb59fbc4df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '033e490050a3407cbce2a93c9b8cb83f', 'request_id': 'req-c83683b3-74c0-4f14-8e88-98cb59fbc4df'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:34.773715 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c83683b3-74c0-4f14-8e88-98cb59fbc4df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '033e490050a3407cbce2a93c9b8cb83f', 'request_id': 'req-c83683b3-74c0-4f14-8e88-98cb59fbc4df'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:34.785041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c83683b3-74c0-4f14-8e88-98cb59fbc4df admin admin] The token cache is being invalidate because project 033e490050a3407cbce2a93c9b8cb83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:34.785330 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c83683b3-74c0-4f14-8e88-98cb59fbc4df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:34.785987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-c83683b3-74c0-4f14-8e88-98cb59fbc4df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:34.787466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1341/2663] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:34 2022] DELETE /identity/v3/projects/033e490050a3407cbce2a93c9b8cb83f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:34.792231 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1803-b4bf-4250-92e8-aa0a675e7fb9 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.792550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1803-b4bf-4250-92e8-aa0a675e7fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.792863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e1803-b4bf-4250-92e8-aa0a675e7fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:34.812425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9c4e1803-b4bf-4250-92e8-aa0a675e7fb9 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:34.813663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9c4e1803-b4bf-4250-92e8-aa0a675e7fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:34.826086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d122f65-fa58-4c0c-ae1b-0f31d1da611f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:34.826891 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d122f65-fa58-4c0c-ae1b-0f31d1da611f admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.827250 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d122f65-fa58-4c0c-ae1b-0f31d1da611f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.827596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d122f65-fa58-4c0c-ae1b-0f31d1da611f admin admin] PATH_INFO: `/v3/projects/451168306bbc40f39b8f1e404a483372/users/a69a583ed5d54832bf879e0fc3eb1712/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:34.842292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d122f65-fa58-4c0c-ae1b-0f31d1da611f admin admin] RBAC: Authorizing `identity:create_grant(project_id=451168306bbc40f39b8f1e404a483372, user_id=a69a583ed5d54832bf879e0fc3eb1712, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:34.845133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d122f65-fa58-4c0c-ae1b-0f31d1da611f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:34.858528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1323/2664] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:34 2022] PUT /identity/v3/projects/451168306bbc40f39b8f1e404a483372/users/a69a583ed5d54832bf879e0fc3eb1712/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:34.862377 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d122f65-fa58-4c0c-ae1b-0f31d1da611f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:34.864591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-4d122f65-fa58-4c0c-ae1b-0f31d1da611f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:34.876433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1342/2665] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:34.886334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc022ca-cd5c-44af-bc8a-4caa367e0b7b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.886620 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc022ca-cd5c-44af-bc8a-4caa367e0b7b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.886924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc022ca-cd5c-44af-bc8a-4caa367e0b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:34.906935 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-abc022ca-cd5c-44af-bc8a-4caa367e0b7b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:34.908136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-abc022ca-cd5c-44af-bc8a-4caa367e0b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:34.929138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d122f65-fa58-4c0c-ae1b-0f31d1da611f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:34.929317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:34.933915 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb2b07-993e-4414-a18d-909680816811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:34.934518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2b07-993e-4414-a18d-909680816811 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.934800 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2b07-993e-4414-a18d-909680816811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.935073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eb2b07-993e-4414-a18d-909680816811 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:34.935715 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb2b07-993e-4414-a18d-909680816811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:34.937355 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eb2b07-993e-4414-a18d-909680816811 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:34.950839 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1324/2666] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:34.951920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb2b07-993e-4414-a18d-909680816811 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:34.961666 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eb2b07-993e-4414-a18d-909680816811 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:34.966940 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd201f7-c202-444b-8431-d48403b4cc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:34.967728 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd201f7-c202-444b-8431-d48403b4cc4c admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.968058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd201f7-c202-444b-8431-d48403b4cc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.968342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd201f7-c202-444b-8431-d48403b4cc4c admin admin] PATH_INFO: `/v3/projects/451168306bbc40f39b8f1e404a483372/users/a69a583ed5d54832bf879e0fc3eb1712/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:34.970480 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd201f7-c202-444b-8431-d48403b4cc4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=451168306bbc40f39b8f1e404a483372, user_id=a69a583ed5d54832bf879e0fc3eb1712, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:34.973930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd201f7-c202-444b-8431-d48403b4cc4c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:34.974703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1343/2667] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:34.979009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc022ca-cd5c-44af-bc8a-4caa367e0b7b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:34.984444 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1325/2668] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:34 2022] PUT /identity/v3/projects/451168306bbc40f39b8f1e404a483372/users/a69a583ed5d54832bf879e0fc3eb1712/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:34.988641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc022ca-cd5c-44af-bc8a-4caa367e0b7b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:34.996461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2798b31-a027-46e4-b2ad-58a46835175e None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:34.996780 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2798b31-a027-46e4-b2ad-58a46835175e None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:34.997069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2798b31-a027-46e4-b2ad-58a46835175e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:35.005248 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:35.027017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-e2798b31-a027-46e4-b2ad-58a46835175e None None] MFA Rules not processed for user `a69a583ed5d54832bf879e0fc3eb1712`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:35.028239 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e2798b31-a027-46e4-b2ad-58a46835175e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:35.046920 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0adb2-dbb3-4721-abff-909c65d64d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:35.047528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0adb2-dbb3-4721-abff-909c65d64d65 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:35.047811 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0adb2-dbb3-4721-abff-909c65d64d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:35.048091 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d0adb2-dbb3-4721-abff-909c65d64d65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:35.048768 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0adb2-dbb3-4721-abff-909c65d64d65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:44:35.049075 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0adb2-dbb3-4721-abff-909c65d64d65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:35.051255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d0adb2-dbb3-4721-abff-909c65d64d65 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:35.063791 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1344/2669] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:44:35.068690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0adb2-dbb3-4721-abff-909c65d64d65 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:35.078361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d0adb2-dbb3-4721-abff-909c65d64d65 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:35.084588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b82adb-9442-474a-b853-8cf96feee296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:35.085373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b82adb-9442-474a-b853-8cf96feee296 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:35.085648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b82adb-9442-474a-b853-8cf96feee296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:35.085918 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b82adb-9442-474a-b853-8cf96feee296 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:35.086561 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b82adb-9442-474a-b853-8cf96feee296 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:35.088442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b82adb-9442-474a-b853-8cf96feee296 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:35.101527 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1326/2670] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:35.113719 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2798b31-a027-46e4-b2ad-58a46835175e None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:35.115199 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-e2798b31-a027-46e4-b2ad-58a46835175e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:35.117863 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1345/2671] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:35 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:35.121806 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b82adb-9442-474a-b853-8cf96feee296 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:35.173975 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2798b31-a027-46e4-b2ad-58a46835175e None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:35.183277 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b82adb-9442-474a-b853-8cf96feee296 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:35.187982 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d9732-b423-4443-b7cf-0e733dab0838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:35.188579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d9732-b423-4443-b7cf-0e733dab0838 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:35.188887 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d9732-b423-4443-b7cf-0e733dab0838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:35.189159 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d9732-b423-4443-b7cf-0e733dab0838 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:35.189817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d9732-b423-4443-b7cf-0e733dab0838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:35.192269 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d9732-b423-4443-b7cf-0e733dab0838 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:35.215152 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1346/2672] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:35 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:35.219282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d9732-b423-4443-b7cf-0e733dab0838 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:35.228618 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729d321-80e3-4b5f-a3cc-f6c1ca943319 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:35.229411 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729d321-80e3-4b5f-a3cc-f6c1ca943319 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:35.229764 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729d321-80e3-4b5f-a3cc-f6c1ca943319 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:35.229904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d9732-b423-4443-b7cf-0e733dab0838 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:35.230182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1729d321-80e3-4b5f-a3cc-f6c1ca943319 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:35.234701 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a814be0-4458-443c-99d1-22c81b5c9920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:35.235301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a814be0-4458-443c-99d1-22c81b5c9920 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:35.235581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a814be0-4458-443c-99d1-22c81b5c9920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:35.235853 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a814be0-4458-443c-99d1-22c81b5c9920 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:35.236497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a814be0-4458-443c-99d1-22c81b5c9920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:35.238922 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a814be0-4458-443c-99d1-22c81b5c9920 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:35.251846 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1347/2673] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:35.263126 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a814be0-4458-443c-99d1-22c81b5c9920 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:35.278945 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a814be0-4458-443c-99d1-22c81b5c9920 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:35.286343 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437818c-69a7-4c66-8313-7fc663289854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:35.286975 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437818c-69a7-4c66-8313-7fc663289854 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:35.287254 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437818c-69a7-4c66-8313-7fc663289854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:35.287529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437818c-69a7-4c66-8313-7fc663289854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:35.288355 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437818c-69a7-4c66-8313-7fc663289854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:35.290024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437818c-69a7-4c66-8313-7fc663289854 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:35.303858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1348/2674] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:35.308356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437818c-69a7-4c66-8313-7fc663289854 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:35.319743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437818c-69a7-4c66-8313-7fc663289854 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:35.325146 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b520f3a-de68-4526-a3e4-0f8a8bf7c525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:35.325980 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b520f3a-de68-4526-a3e4-0f8a8bf7c525 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:35.326361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b520f3a-de68-4526-a3e4-0f8a8bf7c525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:35.326755 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b520f3a-de68-4526-a3e4-0f8a8bf7c525 admin admin] PATH_INFO: `/v3/projects/65c4ff5ea2a94cc4919739e675223a8f/users/443eca56b79a40029b597107c21a5f36/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:35.329506 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:35.346485 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b520f3a-de68-4526-a3e4-0f8a8bf7c525 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65c4ff5ea2a94cc4919739e675223a8f, user_id=443eca56b79a40029b597107c21a5f36, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:35.349339 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b520f3a-de68-4526-a3e4-0f8a8bf7c525 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:35.370774 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1349/2675] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:35 2022] PUT /identity/v3/projects/65c4ff5ea2a94cc4919739e675223a8f/users/443eca56b79a40029b597107c21a5f36/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:35.381247 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94998e35-fbd6-4af4-870f-24bc3599e7d5 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:35.381791 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94998e35-fbd6-4af4-870f-24bc3599e7d5 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:35.382414 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94998e35-fbd6-4af4-870f-24bc3599e7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:35.420541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-94998e35-fbd6-4af4-870f-24bc3599e7d5 None None] MFA Rules not processed for user `443eca56b79a40029b597107c21a5f36`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:35.421963 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-94998e35-fbd6-4af4-870f-24bc3599e7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:35.438771 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:35.446226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729d321-80e3-4b5f-a3cc-f6c1ca943319 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:35.447947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1729d321-80e3-4b5f-a3cc-f6c1ca943319 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:35.469173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1327/2676] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:35 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:44:35.523502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1350/2677] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:35.528080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94998e35-fbd6-4af4-870f-24bc3599e7d5 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:35.528232 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729d321-80e3-4b5f-a3cc-f6c1ca943319 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:35.529716 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1729d321-80e3-4b5f-a3cc-f6c1ca943319 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:35.542391 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1729d321-80e3-4b5f-a3cc-f6c1ca943319 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:35.616498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94998e35-fbd6-4af4-870f-24bc3599e7d5 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:35.617821 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ef645-a973-4f6e-8089-444851fd8a6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:35.618556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef645-a973-4f6e-8089-444851fd8a6e service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:35.618968 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef645-a973-4f6e-8089-444851fd8a6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:35.619298 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ef645-a973-4f6e-8089-444851fd8a6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:35.621374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-7a6ef645-a973-4f6e-8089-444851fd8a6e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:35.621658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e67149-9c63-4ca9-a861-fb4f3154e39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:35.624779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e67149-9c63-4ca9-a861-fb4f3154e39a admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:35.624779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e67149-9c63-4ca9-a861-fb4f3154e39a admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:35.624779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e67149-9c63-4ca9-a861-fb4f3154e39a admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:35.624779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e67149-9c63-4ca9-a861-fb4f3154e39a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:35.625770 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e67149-9c63-4ca9-a861-fb4f3154e39a admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:35.658269 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1351/2678] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:35 2022] POST /identity/v3/projects => generated 381 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:35.665605 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e67149-9c63-4ca9-a861-fb4f3154e39a admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:35.687643 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ef645-a973-4f6e-8089-444851fd8a6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:35.689168 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ef645-a973-4f6e-8089-444851fd8a6e service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:35.698012 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1328/2679] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:35 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:35.727538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:35.731530 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e67149-9c63-4ca9-a861-fb4f3154e39a admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:35.738903 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde3051-13b8-478c-9f8e-6af9ae0ff23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:35.740062 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde3051-13b8-478c-9f8e-6af9ae0ff23e admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:35.740642 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde3051-13b8-478c-9f8e-6af9ae0ff23e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:35.740964 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cde3051-13b8-478c-9f8e-6af9ae0ff23e admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:35.741742 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde3051-13b8-478c-9f8e-6af9ae0ff23e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:35.744895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cde3051-13b8-478c-9f8e-6af9ae0ff23e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:35.781477 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1352/2680] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:35 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:35.786524 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ef645-a973-4f6e-8089-444851fd8a6e service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:35.802468 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ef645-a973-4f6e-8089-444851fd8a6e service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:35.814594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc85ae-3035-4755-89b2-417fb8e5baba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:35.814594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc85ae-3035-4755-89b2-417fb8e5baba admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:35.814594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc85ae-3035-4755-89b2-417fb8e5baba admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:35.814594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadc85ae-3035-4755-89b2-417fb8e5baba admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:35.815075 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc85ae-3035-4755-89b2-417fb8e5baba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:35.816970 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadc85ae-3035-4755-89b2-417fb8e5baba admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:35.830946 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1329/2681] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:35.832498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde3051-13b8-478c-9f8e-6af9ae0ff23e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:35.845868 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cde3051-13b8-478c-9f8e-6af9ae0ff23e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:35.852775 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1d978-8e49-49ca-b14c-e4e788627eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:35.853504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1d978-8e49-49ca-b14c-e4e788627eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:35.853786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1d978-8e49-49ca-b14c-e4e788627eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:35.856218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f1d978-8e49-49ca-b14c-e4e788627eb8 admin admin] PATH_INFO: `/v3/projects/ac75725b4cd84ad8bda82b46741df56c/users/a1bcacfe0d8a421a89bcb04e407013fc/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:35.886690 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1d978-8e49-49ca-b14c-e4e788627eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac75725b4cd84ad8bda82b46741df56c, user_id=a1bcacfe0d8a421a89bcb04e407013fc, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:35.890273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f1d978-8e49-49ca-b14c-e4e788627eb8 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:35.909085 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1353/2682] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:35 2022] PUT /identity/v3/projects/ac75725b4cd84ad8bda82b46741df56c/users/a1bcacfe0d8a421a89bcb04e407013fc/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:35.910186 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc85ae-3035-4755-89b2-417fb8e5baba admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:35.921467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadc85ae-3035-4755-89b2-417fb8e5baba admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:35.991928 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a58d96-bddd-4ee4-b8d4-422dd53fc3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:35.993261 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a58d96-bddd-4ee4-b8d4-422dd53fc3ef admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:35.993465 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a58d96-bddd-4ee4-b8d4-422dd53fc3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:35.993729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a58d96-bddd-4ee4-b8d4-422dd53fc3ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:35.994424 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a58d96-bddd-4ee4-b8d4-422dd53fc3ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:35.996049 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a58d96-bddd-4ee4-b8d4-422dd53fc3ef admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:36.007214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1330/2683] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:36.016901 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1d978-8e49-49ca-b14c-e4e788627eb8 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:36.022850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f1d978-8e49-49ca-b14c-e4e788627eb8 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:36.029257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13116419-3cb8-41c3-a10f-c8ab39a3f9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:36.030013 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13116419-3cb8-41c3-a10f-c8ab39a3f9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:36.030298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13116419-3cb8-41c3-a10f-c8ab39a3f9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:36.030626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13116419-3cb8-41c3-a10f-c8ab39a3f9ae admin admin] PATH_INFO: `/v3/projects/ac75725b4cd84ad8bda82b46741df56c/users/a1bcacfe0d8a421a89bcb04e407013fc/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:36.032956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13116419-3cb8-41c3-a10f-c8ab39a3f9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac75725b4cd84ad8bda82b46741df56c, user_id=a1bcacfe0d8a421a89bcb04e407013fc, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:36.035818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13116419-3cb8-41c3-a10f-c8ab39a3f9ae admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:36.049057 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1354/2684] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:36 2022] PUT /identity/v3/projects/ac75725b4cd84ad8bda82b46741df56c/users/a1bcacfe0d8a421a89bcb04e407013fc/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:36.062234 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c58f2-5652-4fbf-8fb0-0edb45ee6c06 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:36.062561 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c58f2-5652-4fbf-8fb0-0edb45ee6c06 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:36.062839 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c58f2-5652-4fbf-8fb0-0edb45ee6c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:36.096384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-903c58f2-5652-4fbf-8fb0-0edb45ee6c06 None None] MFA Rules not processed for user `a1bcacfe0d8a421a89bcb04e407013fc`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:36.098534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-903c58f2-5652-4fbf-8fb0-0edb45ee6c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:36.123291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:36.180168 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1331/2685] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:36 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:36.191425 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13116419-3cb8-41c3-a10f-c8ab39a3f9ae admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:36.248516 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13116419-3cb8-41c3-a10f-c8ab39a3f9ae admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:36.252170 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839543a2-9a07-451e-866e-ac38f74edbb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:36.252818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839543a2-9a07-451e-866e-ac38f74edbb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:36.253100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839543a2-9a07-451e-866e-ac38f74edbb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:36.253403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839543a2-9a07-451e-866e-ac38f74edbb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:36.262667 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839543a2-9a07-451e-866e-ac38f74edbb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:36.264102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839543a2-9a07-451e-866e-ac38f74edbb1 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:36.274651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1355/2686] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:36 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:36.383006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c58f2-5652-4fbf-8fb0-0edb45ee6c06 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:36.393118 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c58f2-5652-4fbf-8fb0-0edb45ee6c06 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:36.396787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7d8a1-30fc-45bf-993a-ede1d298de08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:36.397386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7d8a1-30fc-45bf-993a-ede1d298de08 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:36.397666 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7d8a1-30fc-45bf-993a-ede1d298de08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:36.397937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc7d8a1-30fc-45bf-993a-ede1d298de08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:36.455648 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7d8a1-30fc-45bf-993a-ede1d298de08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:36.457198 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc7d8a1-30fc-45bf-993a-ede1d298de08 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:36.465956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1332/2687] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:38.487983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839543a2-9a07-451e-866e-ac38f74edbb1 service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:38.496897 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839543a2-9a07-451e-866e-ac38f74edbb1 service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:38.500403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322efc4-4bb0-48c3-b9d2-0840bb63102d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:38.501334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322efc4-4bb0-48c3-b9d2-0840bb63102d service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:38.501334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322efc4-4bb0-48c3-b9d2-0840bb63102d service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:38.501749 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322efc4-4bb0-48c3-b9d2-0840bb63102d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:38.503208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4322efc4-4bb0-48c3-b9d2-0840bb63102d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:38.564390 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322efc4-4bb0-48c3-b9d2-0840bb63102d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:38.565883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322efc4-4bb0-48c3-b9d2-0840bb63102d service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:38.575399 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1356/2688] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:39.142329 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322efc4-4bb0-48c3-b9d2-0840bb63102d service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:39.142567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7d8a1-30fc-45bf-993a-ede1d298de08 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:39.219368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:39.222706 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc7d8a1-30fc-45bf-993a-ede1d298de08 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:39.228174 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7985f-0e26-4ced-903b-ffd19ae5abb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:39.228877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7985f-0e26-4ced-903b-ffd19ae5abb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:39.229160 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7985f-0e26-4ced-903b-ffd19ae5abb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:39.229426 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7985f-0e26-4ced-903b-ffd19ae5abb2 admin admin] PATH_INFO: `/v3/users/443eca56b79a40029b597107c21a5f36` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:39.230631 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7985f-0e26-4ced-903b-ffd19ae5abb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=443eca56b79a40029b597107c21a5f36)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:39.233434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba7985f-0e26-4ced-903b-ffd19ae5abb2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:39.241412 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322efc4-4bb0-48c3-b9d2-0840bb63102d service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:39.254939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc35bdf1-f591-49be-9c93-1eaea98825ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:39.254939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35bdf1-f591-49be-9c93-1eaea98825ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:39.254939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35bdf1-f591-49be-9c93-1eaea98825ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:39.254939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc35bdf1-f591-49be-9c93-1eaea98825ca admin admin] PATH_INFO: `/v3/users/5b0a829bfdd64d4b9fbf6f18e364a756` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:39.255724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35bdf1-f591-49be-9c93-1eaea98825ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b0a829bfdd64d4b9fbf6f18e364a756)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:39.255724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc35bdf1-f591-49be-9c93-1eaea98825ca admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:39.309129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dc35bdf1-f591-49be-9c93-1eaea98825ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b0a829bfdd64d4b9fbf6f18e364a756'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.312140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4ba7985f-0e26-4ced-903b-ffd19ae5abb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '443eca56b79a40029b597107c21a5f36'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.317015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dc35bdf1-f591-49be-9c93-1eaea98825ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b0a829bfdd64d4b9fbf6f18e364a756'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.320178 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4ba7985f-0e26-4ced-903b-ffd19ae5abb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '443eca56b79a40029b597107c21a5f36'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.324794 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:39.329950 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dc35bdf1-f591-49be-9c93-1eaea98825ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b0a829bfdd64d4b9fbf6f18e364a756'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.330722 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dc35bdf1-f591-49be-9c93-1eaea98825ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b0a829bfdd64d4b9fbf6f18e364a756'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.336982 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4ba7985f-0e26-4ced-903b-ffd19ae5abb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '443eca56b79a40029b597107c21a5f36'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.338764 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-dc35bdf1-f591-49be-9c93-1eaea98825ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b0a829bfdd64d4b9fbf6f18e364a756'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.344385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4ba7985f-0e26-4ced-903b-ffd19ae5abb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '443eca56b79a40029b597107c21a5f36'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.345010 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4ba7985f-0e26-4ced-903b-ffd19ae5abb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '443eca56b79a40029b597107c21a5f36'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.345363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1357/2689] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:39 2022] DELETE /identity/v3/users/5b0a829bfdd64d4b9fbf6f18e364a756 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:39.350362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46473c-25eb-41d3-a3ac-fa7be362cd49 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:39.351250 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46473c-25eb-41d3-a3ac-fa7be362cd49 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:39.351539 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46473c-25eb-41d3-a3ac-fa7be362cd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:39.359546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1333/2690] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:39 2022] DELETE /identity/v3/users/443eca56b79a40029b597107c21a5f36 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:39.361226 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6cfc7-5234-49df-8793-af5481f96a55 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:39.361517 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6cfc7-5234-49df-8793-af5481f96a55 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:39.361862 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb6cfc7-5234-49df-8793-af5481f96a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:39.372013 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6f46473c-25eb-41d3-a3ac-fa7be362cd49 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:39.377672 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6f46473c-25eb-41d3-a3ac-fa7be362cd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:39.382536 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5cb6cfc7-5234-49df-8793-af5481f96a55 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:39.383721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5cb6cfc7-5234-49df-8793-af5481f96a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:39.449416 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1358/2691] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:39.450965 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1334/2692] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:39.458278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46473c-25eb-41d3-a3ac-fa7be362cd49 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:39.459695 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6f46473c-25eb-41d3-a3ac-fa7be362cd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:39.460825 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6cfc7-5234-49df-8793-af5481f96a55 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:39.462151 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5cb6cfc7-5234-49df-8793-af5481f96a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:39.519628 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46473c-25eb-41d3-a3ac-fa7be362cd49 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:39.520214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb6cfc7-5234-49df-8793-af5481f96a55 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:39.523331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f1540-e435-4ee5-bc7c-aba834ef7fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:39.523470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce5890-0ac4-4c75-959d-b382b8664e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:39.523931 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f1540-e435-4ee5-bc7c-aba834ef7fac service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:39.524077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce5890-0ac4-4c75-959d-b382b8664e55 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:39.524212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f1540-e435-4ee5-bc7c-aba834ef7fac service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:39.524357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce5890-0ac4-4c75-959d-b382b8664e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:39.524538 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014f1540-e435-4ee5-bc7c-aba834ef7fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:39.524638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce5890-0ac4-4c75-959d-b382b8664e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:39.533916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce5890-0ac4-4c75-959d-b382b8664e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:39.534074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f1540-e435-4ee5-bc7c-aba834ef7fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:39.535384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce5890-0ac4-4c75-959d-b382b8664e55 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:39.535506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014f1540-e435-4ee5-bc7c-aba834ef7fac service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:39.544886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1359/2693] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:39.545531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1335/2694] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:39.824294 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce5890-0ac4-4c75-959d-b382b8664e55 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:39.824434 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d2ce5890-0ac4-4c75-959d-b382b8664e55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:39.825362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f1540-e435-4ee5-bc7c-aba834ef7fac service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:39.826973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-014f1540-e435-4ee5-bc7c-aba834ef7fac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:39.841125 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce5890-0ac4-4c75-959d-b382b8664e55 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:39.841971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014f1540-e435-4ee5-bc7c-aba834ef7fac service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:39.846586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e44f1-c717-4904-8636-c4d1ef85fba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:39.846921 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29a9a9-53b3-4298-b784-8237abeb0c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:39.847799 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e44f1-c717-4904-8636-c4d1ef85fba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:39.847971 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29a9a9-53b3-4298-b784-8237abeb0c3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:39.848073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e44f1-c717-4904-8636-c4d1ef85fba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:39.848237 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29a9a9-53b3-4298-b784-8237abeb0c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:39.848336 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e44f1-c717-4904-8636-c4d1ef85fba1 admin admin] PATH_INFO: `/v3/projects/65c4ff5ea2a94cc4919739e675223a8f` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:39.848495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf29a9a9-53b3-4298-b784-8237abeb0c3e admin admin] PATH_INFO: `/v3/projects/ea13c7dac4d445889ce17741c78938fc` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:39.849512 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e44f1-c717-4904-8636-c4d1ef85fba1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65c4ff5ea2a94cc4919739e675223a8f)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:39.849625 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29a9a9-53b3-4298-b784-8237abeb0c3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea13c7dac4d445889ce17741c78938fc)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:39.851431 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e44f1-c717-4904-8636-c4d1ef85fba1 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:39.851567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf29a9a9-53b3-4298-b784-8237abeb0c3e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:39.856612 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:39.909349 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-bf29a9a9-53b3-4298-b784-8237abeb0c3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea13c7dac4d445889ce17741c78938fc', 'request_id': 'req-bf29a9a9-53b3-4298-b784-8237abeb0c3e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.913860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-985e44f1-c717-4904-8636-c4d1ef85fba1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65c4ff5ea2a94cc4919739e675223a8f', 'request_id': 'req-985e44f1-c717-4904-8636-c4d1ef85fba1'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.915220 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-bf29a9a9-53b3-4298-b784-8237abeb0c3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea13c7dac4d445889ce17741c78938fc', 'request_id': 'req-bf29a9a9-53b3-4298-b784-8237abeb0c3e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.922056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-bf29a9a9-53b3-4298-b784-8237abeb0c3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea13c7dac4d445889ce17741c78938fc', 'request_id': 'req-bf29a9a9-53b3-4298-b784-8237abeb0c3e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.928869 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-985e44f1-c717-4904-8636-c4d1ef85fba1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65c4ff5ea2a94cc4919739e675223a8f', 'request_id': 'req-985e44f1-c717-4904-8636-c4d1ef85fba1'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.937200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-985e44f1-c717-4904-8636-c4d1ef85fba1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65c4ff5ea2a94cc4919739e675223a8f', 'request_id': 'req-985e44f1-c717-4904-8636-c4d1ef85fba1'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.938394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-bf29a9a9-53b3-4298-b784-8237abeb0c3e admin admin] The token cache is being invalidate because project ea13c7dac4d445889ce17741c78938fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:39.938687 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-bf29a9a9-53b3-4298-b784-8237abeb0c3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.939987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-bf29a9a9-53b3-4298-b784-8237abeb0c3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.941639 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1336/2695] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:39 2022] DELETE /identity/v3/projects/ea13c7dac4d445889ce17741c78938fc => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:39.945445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29a9a9-53b3-4298-b784-8237abeb0c3e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:39.946785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bf29a9a9-53b3-4298-b784-8237abeb0c3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:39.950340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-985e44f1-c717-4904-8636-c4d1ef85fba1 admin admin] The token cache is being invalidate because project 65c4ff5ea2a94cc4919739e675223a8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:39.950635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-985e44f1-c717-4904-8636-c4d1ef85fba1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.951309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-985e44f1-c717-4904-8636-c4d1ef85fba1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:39.951826 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:39.953110 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1360/2696] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:39 2022] DELETE /identity/v3/projects/65c4ff5ea2a94cc4919739e675223a8f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:39.957400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e44f1-c717-4904-8636-c4d1ef85fba1 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:39.958739 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-985e44f1-c717-4904-8636-c4d1ef85fba1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:40.018713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf29a9a9-53b3-4298-b784-8237abeb0c3e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:40.023379 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f91bdf-61e7-474e-aa84-a0554f6a9322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:40.023997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f91bdf-61e7-474e-aa84-a0554f6a9322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:40.024271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f91bdf-61e7-474e-aa84-a0554f6a9322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:40.024498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e44f1-c717-4904-8636-c4d1ef85fba1 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:40.024626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f91bdf-61e7-474e-aa84-a0554f6a9322 admin admin] PATH_INFO: `/v3/users/a69a583ed5d54832bf879e0fc3eb1712` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:40.025679 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f91bdf-61e7-474e-aa84-a0554f6a9322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a69a583ed5d54832bf879e0fc3eb1712)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:40.027585 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f91bdf-61e7-474e-aa84-a0554f6a9322 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:40.029195 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db16036-63bb-4475-bbe9-5183af52b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:40.029818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16036-63bb-4475-bbe9-5183af52b703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:40.030097 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16036-63bb-4475-bbe9-5183af52b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:40.030369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db16036-63bb-4475-bbe9-5183af52b703 admin admin] PATH_INFO: `/v3/users/a1bcacfe0d8a421a89bcb04e407013fc` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:40.031496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db16036-63bb-4475-bbe9-5183af52b703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1bcacfe0d8a421a89bcb04e407013fc)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:40.033461 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db16036-63bb-4475-bbe9-5183af52b703 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:40.074002 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-25f91bdf-61e7-474e-aa84-a0554f6a9322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a69a583ed5d54832bf879e0fc3eb1712'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.081299 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6db16036-63bb-4475-bbe9-5183af52b703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1bcacfe0d8a421a89bcb04e407013fc'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.081495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-25f91bdf-61e7-474e-aa84-a0554f6a9322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a69a583ed5d54832bf879e0fc3eb1712'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.088487 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6db16036-63bb-4475-bbe9-5183af52b703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1bcacfe0d8a421a89bcb04e407013fc'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.093454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-25f91bdf-61e7-474e-aa84-a0554f6a9322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a69a583ed5d54832bf879e0fc3eb1712'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.101072 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-25f91bdf-61e7-474e-aa84-a0554f6a9322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a69a583ed5d54832bf879e0fc3eb1712'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.101655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-25f91bdf-61e7-474e-aa84-a0554f6a9322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a69a583ed5d54832bf879e0fc3eb1712'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.102255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6db16036-63bb-4475-bbe9-5183af52b703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1bcacfe0d8a421a89bcb04e407013fc'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.102971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6db16036-63bb-4475-bbe9-5183af52b703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1bcacfe0d8a421a89bcb04e407013fc'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.107729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1337/2697] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:39 2022] DELETE /identity/v3/users/a69a583ed5d54832bf879e0fc3eb1712 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:40.110748 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6db16036-63bb-4475-bbe9-5183af52b703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1bcacfe0d8a421a89bcb04e407013fc'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.117498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1361/2698] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:39 2022] DELETE /identity/v3/users/a1bcacfe0d8a421a89bcb04e407013fc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:40.556824 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f91bdf-61e7-474e-aa84-a0554f6a9322 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:40.558175 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-25f91bdf-61e7-474e-aa84-a0554f6a9322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:40.593802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db16036-63bb-4475-bbe9-5183af52b703 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:40.595422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6db16036-63bb-4475-bbe9-5183af52b703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:40.620825 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:40.662994 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f91bdf-61e7-474e-aa84-a0554f6a9322 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:40.695006 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:40.698637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db16036-63bb-4475-bbe9-5183af52b703 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:40.704421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87677553-ef7c-4902-b428-beb262056f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:40.705413 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87677553-ef7c-4902-b428-beb262056f77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:40.705745 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87677553-ef7c-4902-b428-beb262056f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:40.706028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87677553-ef7c-4902-b428-beb262056f77 admin admin] PATH_INFO: `/v3/projects/ac75725b4cd84ad8bda82b46741df56c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:40.707263 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87677553-ef7c-4902-b428-beb262056f77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac75725b4cd84ad8bda82b46741df56c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:40.709297 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87677553-ef7c-4902-b428-beb262056f77 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:40.737316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6a7c1f-29a1-401a-b553-4570721a577f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:40.738487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a7c1f-29a1-401a-b553-4570721a577f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:40.738769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a7c1f-29a1-401a-b553-4570721a577f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:40.739045 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6a7c1f-29a1-401a-b553-4570721a577f admin admin] PATH_INFO: `/v3/projects/451168306bbc40f39b8f1e404a483372` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:40.740191 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a7c1f-29a1-401a-b553-4570721a577f admin admin] RBAC: Authorizing `identity:delete_project(project_id=451168306bbc40f39b8f1e404a483372)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:40.742694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6a7c1f-29a1-401a-b553-4570721a577f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:40.767423 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-87677553-ef7c-4902-b428-beb262056f77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac75725b4cd84ad8bda82b46741df56c', 'request_id': 'req-87677553-ef7c-4902-b428-beb262056f77'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.778833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-87677553-ef7c-4902-b428-beb262056f77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac75725b4cd84ad8bda82b46741df56c', 'request_id': 'req-87677553-ef7c-4902-b428-beb262056f77'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.785973 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-87677553-ef7c-4902-b428-beb262056f77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac75725b4cd84ad8bda82b46741df56c', 'request_id': 'req-87677553-ef7c-4902-b428-beb262056f77'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.797498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-87677553-ef7c-4902-b428-beb262056f77 admin admin] The token cache is being invalidate because project ac75725b4cd84ad8bda82b46741df56c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:40.797787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-87677553-ef7c-4902-b428-beb262056f77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.797996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cb6a7c1f-29a1-401a-b553-4570721a577f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451168306bbc40f39b8f1e404a483372', 'request_id': 'req-cb6a7c1f-29a1-401a-b553-4570721a577f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.798445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-87677553-ef7c-4902-b428-beb262056f77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.800724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1362/2699] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:40 2022] DELETE /identity/v3/projects/ac75725b4cd84ad8bda82b46741df56c => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:40.805227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cb6a7c1f-29a1-401a-b553-4570721a577f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451168306bbc40f39b8f1e404a483372', 'request_id': 'req-cb6a7c1f-29a1-401a-b553-4570721a577f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.805479 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91577c9b-4f65-4a90-9001-20a5f0f4021f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:40.805771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91577c9b-4f65-4a90-9001-20a5f0f4021f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:40.806046 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91577c9b-4f65-4a90-9001-20a5f0f4021f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:40.812145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cb6a7c1f-29a1-401a-b553-4570721a577f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451168306bbc40f39b8f1e404a483372', 'request_id': 'req-cb6a7c1f-29a1-401a-b553-4570721a577f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.826921 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-91577c9b-4f65-4a90-9001-20a5f0f4021f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:40.827994 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-91577c9b-4f65-4a90-9001-20a5f0f4021f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:40.828149 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cb6a7c1f-29a1-401a-b553-4570721a577f admin admin] The token cache is being invalidate because project 451168306bbc40f39b8f1e404a483372 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:40.828534 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cb6a7c1f-29a1-401a-b553-4570721a577f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.829268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-cb6a7c1f-29a1-401a-b553-4570721a577f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:40.830932 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1338/2700] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:40 2022] DELETE /identity/v3/projects/451168306bbc40f39b8f1e404a483372 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:40.837332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242f04f-26a3-4396-9489-f122ccce5eb1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:40.837731 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242f04f-26a3-4396-9489-f122ccce5eb1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:40.837924 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3242f04f-26a3-4396-9489-f122ccce5eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:40.858574 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-3242f04f-26a3-4396-9489-f122ccce5eb1 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:40.859901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3242f04f-26a3-4396-9489-f122ccce5eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:40.899092 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1363/2701] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:40.907508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c6133-facd-4dbe-8dca-6489b587b058 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:40.907792 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c6133-facd-4dbe-8dca-6489b587b058 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:40.908091 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88c6133-facd-4dbe-8dca-6489b587b058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:40.930653 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a88c6133-facd-4dbe-8dca-6489b587b058 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:40.932419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a88c6133-facd-4dbe-8dca-6489b587b058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:40.942241 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1339/2702] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:40.943435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1364/2703] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:40.949745 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6017553-8e1d-40ce-9b11-5cb0882c6410 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:40.950027 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6017553-8e1d-40ce-9b11-5cb0882c6410 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:40.950304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6017553-8e1d-40ce-9b11-5cb0882c6410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:40.952126 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c6133-facd-4dbe-8dca-6489b587b058 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:40.963122 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88c6133-facd-4dbe-8dca-6489b587b058 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:40.968604 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75b2c8-b592-4174-962c-c8cf3ac93917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:40.969258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75b2c8-b592-4174-962c-c8cf3ac93917 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:40.969540 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75b2c8-b592-4174-962c-c8cf3ac93917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:40.969811 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75b2c8-b592-4174-962c-c8cf3ac93917 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:40.970454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75b2c8-b592-4174-962c-c8cf3ac93917 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:44:40.970757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75b2c8-b592-4174-962c-c8cf3ac93917 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:40.970870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-b6017553-8e1d-40ce-9b11-5cb0882c6410 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:40.972613 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b6017553-8e1d-40ce-9b11-5cb0882c6410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:40.972926 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75b2c8-b592-4174-962c-c8cf3ac93917 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:40.980877 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1340/2704] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:40.984939 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6017553-8e1d-40ce-9b11-5cb0882c6410 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:40.989994 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1365/2705] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:44:40.991454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75b2c8-b592-4174-962c-c8cf3ac93917 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.001122 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6017553-8e1d-40ce-9b11-5cb0882c6410 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.002968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75b2c8-b592-4174-962c-c8cf3ac93917 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.006837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fed0cf-75f8-4816-bcfc-6ab3a737f9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.007447 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fed0cf-75f8-4816-bcfc-6ab3a737f9ee admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.007729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fed0cf-75f8-4816-bcfc-6ab3a737f9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.007998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fed0cf-75f8-4816-bcfc-6ab3a737f9ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.008443 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba42477-5a52-4b30-b4a1-849cab873487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.008646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fed0cf-75f8-4816-bcfc-6ab3a737f9ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:44:41.009050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fed0cf-75f8-4816-bcfc-6ab3a737f9ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.009157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba42477-5a52-4b30-b4a1-849cab873487 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.009417 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba42477-5a52-4b30-b4a1-849cab873487 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.009694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba42477-5a52-4b30-b4a1-849cab873487 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.010322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba42477-5a52-4b30-b4a1-849cab873487 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.010627 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fed0cf-75f8-4816-bcfc-6ab3a737f9ee admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.012203 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba42477-5a52-4b30-b4a1-849cab873487 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.024058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1341/2706] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:44:41.028370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fed0cf-75f8-4816-bcfc-6ab3a737f9ee admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.040342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fed0cf-75f8-4816-bcfc-6ab3a737f9ee admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.040995 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:41.045660 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcd69d-6fe4-4b41-a4ed-a68ee9750886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.047781 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcd69d-6fe4-4b41-a4ed-a68ee9750886 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.048374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcd69d-6fe4-4b41-a4ed-a68ee9750886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.049345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1366/2707] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:40 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:41.049991 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bcd69d-6fe4-4b41-a4ed-a68ee9750886 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.051015 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcd69d-6fe4-4b41-a4ed-a68ee9750886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.053701 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba42477-5a52-4b30-b4a1-849cab873487 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.054015 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bcd69d-6fe4-4b41-a4ed-a68ee9750886 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.092638 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1342/2708] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:41 2022] POST /identity/v3/projects => generated 409 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:41.093717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcd69d-6fe4-4b41-a4ed-a68ee9750886 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.124277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:41.135999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba42477-5a52-4b30-b4a1-849cab873487 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.182376 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bcd69d-6fe4-4b41-a4ed-a68ee9750886 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.188317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecfed4-dcfc-475a-882d-72d618fe454e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.189102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecfed4-dcfc-475a-882d-72d618fe454e admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.189374 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecfed4-dcfc-475a-882d-72d618fe454e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.189667 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ecfed4-dcfc-475a-882d-72d618fe454e admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.190389 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecfed4-dcfc-475a-882d-72d618fe454e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.193373 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ecfed4-dcfc-475a-882d-72d618fe454e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.210553 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd817d-7864-4d93-aca3-085ed7ec70cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.211300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd817d-7864-4d93-aca3-085ed7ec70cf admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.211600 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd817d-7864-4d93-aca3-085ed7ec70cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.211861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd817d-7864-4d93-aca3-085ed7ec70cf admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.213588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd817d-7864-4d93-aca3-085ed7ec70cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.221094 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1343/2709] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:41 2022] POST /identity/v3/users => generated 305 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:41.221648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cd817d-7864-4d93-aca3-085ed7ec70cf admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.225738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecfed4-dcfc-475a-882d-72d618fe454e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.245381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ecfed4-dcfc-475a-882d-72d618fe454e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.250488 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b69a9d-927f-41e3-a0ae-3aa309d62c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.251172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b69a9d-927f-41e3-a0ae-3aa309d62c3a admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.254500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b69a9d-927f-41e3-a0ae-3aa309d62c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.254500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b69a9d-927f-41e3-a0ae-3aa309d62c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.254707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1367/2710] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:41 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:41.254859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b69a9d-927f-41e3-a0ae-3aa309d62c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.254859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b69a9d-927f-41e3-a0ae-3aa309d62c3a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.256213 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd817d-7864-4d93-aca3-085ed7ec70cf admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.265889 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1344/2711] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:41.271208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b69a9d-927f-41e3-a0ae-3aa309d62c3a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.274253 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd817d-7864-4d93-aca3-085ed7ec70cf admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.280022 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d870c-a554-4b77-ab44-a6aa4ecdd39f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.280916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d870c-a554-4b77-ab44-a6aa4ecdd39f admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.281074 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d870c-a554-4b77-ab44-a6aa4ecdd39f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.281656 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d870c-a554-4b77-ab44-a6aa4ecdd39f admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.281966 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d870c-a554-4b77-ab44-a6aa4ecdd39f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.283506 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d870c-a554-4b77-ab44-a6aa4ecdd39f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.284998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b69a9d-927f-41e3-a0ae-3aa309d62c3a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.290942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7475ec-e291-4366-836d-e828cad1490e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.291624 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7475ec-e291-4366-836d-e828cad1490e admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.292014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7475ec-e291-4366-836d-e828cad1490e admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.292356 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7475ec-e291-4366-836d-e828cad1490e admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.293138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7475ec-e291-4366-836d-e828cad1490e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.294886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7475ec-e291-4366-836d-e828cad1490e admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.295129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1368/2712] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:41.298875 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d870c-a554-4b77-ab44-a6aa4ecdd39f admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.308711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1345/2713] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:41.309642 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d870c-a554-4b77-ab44-a6aa4ecdd39f admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.314394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fb99d-d593-4fe1-96d4-dce5941dd2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.314967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fb99d-d593-4fe1-96d4-dce5941dd2b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.315251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fb99d-d593-4fe1-96d4-dce5941dd2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.315557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5fb99d-d593-4fe1-96d4-dce5941dd2b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.316207 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fb99d-d593-4fe1-96d4-dce5941dd2b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.317473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7475ec-e291-4366-836d-e828cad1490e admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.317834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5fb99d-d593-4fe1-96d4-dce5941dd2b1 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.331005 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1369/2714] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:41.331950 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7475ec-e291-4366-836d-e828cad1490e admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.335422 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fb99d-d593-4fe1-96d4-dce5941dd2b1 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.338638 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be2695-46ea-4df1-8d4f-f78bdcb09328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.339181 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be2695-46ea-4df1-8d4f-f78bdcb09328 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.339457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be2695-46ea-4df1-8d4f-f78bdcb09328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.339729 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be2695-46ea-4df1-8d4f-f78bdcb09328 admin admin] PATH_INFO: `/v3/projects/8a874d89e9c6482d80de0f4cd2a5918a/users/7e0feb3dbbff4b4fbc6291dcdb38a191/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.345640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5fb99d-d593-4fe1-96d4-dce5941dd2b1 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.350972 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526ec531-0051-481b-befe-3c517c41d9ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.351626 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ec531-0051-481b-befe-3c517c41d9ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.351920 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ec531-0051-481b-befe-3c517c41d9ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.352195 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526ec531-0051-481b-befe-3c517c41d9ef admin admin] PATH_INFO: `/v3/projects/c254681b10674f6c967dc1c7657816b5/users/0e5a8fde12b7408b8d9f6d89e279a60e/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.357388 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be2695-46ea-4df1-8d4f-f78bdcb09328 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a874d89e9c6482d80de0f4cd2a5918a, user_id=7e0feb3dbbff4b4fbc6291dcdb38a191, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.360163 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be2695-46ea-4df1-8d4f-f78bdcb09328 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.370871 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ec531-0051-481b-befe-3c517c41d9ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c254681b10674f6c967dc1c7657816b5, user_id=0e5a8fde12b7408b8d9f6d89e279a60e, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.373544 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526ec531-0051-481b-befe-3c517c41d9ef admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.374784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1346/2715] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:41 2022] PUT /identity/v3/projects/8a874d89e9c6482d80de0f4cd2a5918a/users/7e0feb3dbbff4b4fbc6291dcdb38a191/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:41.384857 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1103ff-1fcc-412c-aabb-4c0a2577466b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.385142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1103ff-1fcc-412c-aabb-4c0a2577466b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.385420 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1103ff-1fcc-412c-aabb-4c0a2577466b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.401677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1370/2716] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:41 2022] PUT /identity/v3/projects/c254681b10674f6c967dc1c7657816b5/users/0e5a8fde12b7408b8d9f6d89e279a60e/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:41.413227 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9d1c-38e9-45a9-a351-19891c96c063 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.413504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9d1c-38e9-45a9-a351-19891c96c063 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.413766 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae9d1c-38e9-45a9-a351-19891c96c063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.418206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-bd1103ff-1fcc-412c-aabb-4c0a2577466b None None] MFA Rules not processed for user `7e0feb3dbbff4b4fbc6291dcdb38a191`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:41.419388 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bd1103ff-1fcc-412c-aabb-4c0a2577466b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:41.445365 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-09ae9d1c-38e9-45a9-a351-19891c96c063 None None] MFA Rules not processed for user `0e5a8fde12b7408b8d9f6d89e279a60e`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:41.446734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-09ae9d1c-38e9-45a9-a351-19891c96c063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:41.490199 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1347/2717] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:41 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:41.492140 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:41.494973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1103ff-1fcc-412c-aabb-4c0a2577466b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.521771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1371/2718] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:41.526111 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9d1c-38e9-45a9-a351-19891c96c063 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.545998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:41.559480 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1103ff-1fcc-412c-aabb-4c0a2577466b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.564228 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27ad3e-598b-4b6d-9427-0fd82f3493b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.564862 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27ad3e-598b-4b6d-9427-0fd82f3493b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.565143 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27ad3e-598b-4b6d-9427-0fd82f3493b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.565419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27ad3e-598b-4b6d-9427-0fd82f3493b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.566100 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27ad3e-598b-4b6d-9427-0fd82f3493b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.567981 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c27ad3e-598b-4b6d-9427-0fd82f3493b3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.592490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae9d1c-38e9-45a9-a351-19891c96c063 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.596030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1348/2719] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:41 2022] POST /identity/v3/projects => generated 409 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:41.597836 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d567697-2ff0-48ba-9179-0974cfcfa7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.598443 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d567697-2ff0-48ba-9179-0974cfcfa7dc admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.599514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d567697-2ff0-48ba-9179-0974cfcfa7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.599844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d567697-2ff0-48ba-9179-0974cfcfa7dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.600480 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d567697-2ff0-48ba-9179-0974cfcfa7dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.600786 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27ad3e-598b-4b6d-9427-0fd82f3493b3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.602441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d567697-2ff0-48ba-9179-0974cfcfa7dc admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.642594 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1372/2720] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:41 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:41.646983 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d567697-2ff0-48ba-9179-0974cfcfa7dc admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.674701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27ad3e-598b-4b6d-9427-0fd82f3493b3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.731721 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d567697-2ff0-48ba-9179-0974cfcfa7dc admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.738073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6b1a2-60dc-45d1-b6d0-c9c0774bdfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.738778 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6b1a2-60dc-45d1-b6d0-c9c0774bdfc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.739060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6b1a2-60dc-45d1-b6d0-c9c0774bdfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.739337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6b1a2-60dc-45d1-b6d0-c9c0774bdfc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.739967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6b1a2-60dc-45d1-b6d0-c9c0774bdfc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.742634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6b1a2-60dc-45d1-b6d0-c9c0774bdfc1 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.772140 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1373/2721] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:41 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:41.775883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6b1a2-60dc-45d1-b6d0-c9c0774bdfc1 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.779893 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad21e5-a245-419e-8d10-36e285a13e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.780612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad21e5-a245-419e-8d10-36e285a13e1c admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.780868 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad21e5-a245-419e-8d10-36e285a13e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.781135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dad21e5-a245-419e-8d10-36e285a13e1c admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.781771 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad21e5-a245-419e-8d10-36e285a13e1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.783822 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dad21e5-a245-419e-8d10-36e285a13e1c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.789527 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6b1a2-60dc-45d1-b6d0-c9c0774bdfc1 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.800870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae4806-9cb6-43f4-89bd-3b0a93080f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.801518 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae4806-9cb6-43f4-89bd-3b0a93080f7c admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.801810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae4806-9cb6-43f4-89bd-3b0a93080f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.802090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ae4806-9cb6-43f4-89bd-3b0a93080f7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.802749 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae4806-9cb6-43f4-89bd-3b0a93080f7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.804554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ae4806-9cb6-43f4-89bd-3b0a93080f7c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.810999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1349/2722] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:41 2022] POST /identity/v3/users => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:41.814743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad21e5-a245-419e-8d10-36e285a13e1c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.815073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1374/2723] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:41.819447 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae4806-9cb6-43f4-89bd-3b0a93080f7c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.829402 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ae4806-9cb6-43f4-89bd-3b0a93080f7c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.834726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dad21e5-a245-419e-8d10-36e285a13e1c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.835126 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa4036-4e43-472a-b8b5-5094312d2962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.835865 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa4036-4e43-472a-b8b5-5094312d2962 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.836221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa4036-4e43-472a-b8b5-5094312d2962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.836566 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaa4036-4e43-472a-b8b5-5094312d2962 admin admin] PATH_INFO: `/v3/projects/fbeb6e4e17c84786bb6f38e62aa2007d/users/6afdc5cff4944116a78040017bf1ef6a/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.841526 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b8cdc-a3f4-4931-9062-d1ff7a59a845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.842135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b8cdc-a3f4-4931-9062-d1ff7a59a845 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.842419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b8cdc-a3f4-4931-9062-d1ff7a59a845 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.842694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b8cdc-a3f4-4931-9062-d1ff7a59a845 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.843345 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b8cdc-a3f4-4931-9062-d1ff7a59a845 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.845681 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b8cdc-a3f4-4931-9062-d1ff7a59a845 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.860787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1350/2724] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:41.862078 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa4036-4e43-472a-b8b5-5094312d2962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbeb6e4e17c84786bb6f38e62aa2007d, user_id=6afdc5cff4944116a78040017bf1ef6a, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.862668 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b8cdc-a3f4-4931-9062-d1ff7a59a845 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.865529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbaa4036-4e43-472a-b8b5-5094312d2962 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.873859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b8cdc-a3f4-4931-9062-d1ff7a59a845 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.879228 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b2d51-1598-4d76-9abb-f0a3bdbcc869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:41.880382 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b2d51-1598-4d76-9abb-f0a3bdbcc869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:41.880560 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b2d51-1598-4d76-9abb-f0a3bdbcc869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:41.880829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b2d51-1598-4d76-9abb-f0a3bdbcc869 admin admin] PATH_INFO: `/v3/projects/42cc7b43620c41a1bbc93ac065276085/users/050080db78404313a889cfd62192e972/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:41.892729 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1375/2725] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:41 2022] PUT /identity/v3/projects/fbeb6e4e17c84786bb6f38e62aa2007d/users/6afdc5cff4944116a78040017bf1ef6a/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:41.896744 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa4036-4e43-472a-b8b5-5094312d2962 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.899619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b2d51-1598-4d76-9abb-f0a3bdbcc869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42cc7b43620c41a1bbc93ac065276085, user_id=050080db78404313a889cfd62192e972, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:41.902706 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b2d51-1598-4d76-9abb-f0a3bdbcc869 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:41.920953 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:41.927699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1351/2726] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:41 2022] PUT /identity/v3/projects/42cc7b43620c41a1bbc93ac065276085/users/050080db78404313a889cfd62192e972/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:41.931956 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b2d51-1598-4d76-9abb-f0a3bdbcc869 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:41.972995 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaa4036-4e43-472a-b8b5-5094312d2962 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:41.986563 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:42.015782 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b2d51-1598-4d76-9abb-f0a3bdbcc869 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:42.021162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400577d-54de-4d01-9c02-2205cf01835b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:42.021754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400577d-54de-4d01-9c02-2205cf01835b admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:42.022027 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400577d-54de-4d01-9c02-2205cf01835b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:42.022295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400577d-54de-4d01-9c02-2205cf01835b admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:42.022960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400577d-54de-4d01-9c02-2205cf01835b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:42.024525 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400577d-54de-4d01-9c02-2205cf01835b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:42.034992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1352/2727] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:42.036438 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14625ddc-3f23-47e5-9bd1-4c1121af8032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:42.037083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14625ddc-3f23-47e5-9bd1-4c1121af8032 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:42.037368 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14625ddc-3f23-47e5-9bd1-4c1121af8032 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:42.037643 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14625ddc-3f23-47e5-9bd1-4c1121af8032 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:42.038295 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14625ddc-3f23-47e5-9bd1-4c1121af8032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:42.039209 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400577d-54de-4d01-9c02-2205cf01835b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:42.039914 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14625ddc-3f23-47e5-9bd1-4c1121af8032 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:42.048992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400577d-54de-4d01-9c02-2205cf01835b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:42.050378 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1376/2728] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:41 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:42.054182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2917278b-00e3-4e19-868c-6fce9f9d3132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:42.054347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14625ddc-3f23-47e5-9bd1-4c1121af8032 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:42.054819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917278b-00e3-4e19-868c-6fce9f9d3132 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:42.055116 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917278b-00e3-4e19-868c-6fce9f9d3132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:42.055386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2917278b-00e3-4e19-868c-6fce9f9d3132 admin admin] PATH_INFO: `/v3/projects/42cc7b43620c41a1bbc93ac065276085/users/050080db78404313a889cfd62192e972/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:42.057304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917278b-00e3-4e19-868c-6fce9f9d3132 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42cc7b43620c41a1bbc93ac065276085, user_id=050080db78404313a889cfd62192e972, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:42.059895 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2917278b-00e3-4e19-868c-6fce9f9d3132 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:42.064272 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14625ddc-3f23-47e5-9bd1-4c1121af8032 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:42.070546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1353/2729] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:42 2022] PUT /identity/v3/projects/42cc7b43620c41a1bbc93ac065276085/users/050080db78404313a889cfd62192e972/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:42.083439 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b2aa7-82c8-4749-9bd3-cb9e3e59b2d0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:42.083727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b2aa7-82c8-4749-9bd3-cb9e3e59b2d0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:42.084059 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b2aa7-82c8-4749-9bd3-cb9e3e59b2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:42.113763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-8e7b2aa7-82c8-4749-9bd3-cb9e3e59b2d0 None None] MFA Rules not processed for user `050080db78404313a889cfd62192e972`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:42.114984 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8e7b2aa7-82c8-4749-9bd3-cb9e3e59b2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:42.121888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017e0c3d-5ded-43cd-a9f5-43259dd5c38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:42.122534 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e0c3d-5ded-43cd-a9f5-43259dd5c38f admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:42.122810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e0c3d-5ded-43cd-a9f5-43259dd5c38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:42.123080 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017e0c3d-5ded-43cd-a9f5-43259dd5c38f admin admin] PATH_INFO: `/v3/projects/fbeb6e4e17c84786bb6f38e62aa2007d/users/6afdc5cff4944116a78040017bf1ef6a/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:42.125043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e0c3d-5ded-43cd-a9f5-43259dd5c38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbeb6e4e17c84786bb6f38e62aa2007d, user_id=6afdc5cff4944116a78040017bf1ef6a, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:42.127655 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017e0c3d-5ded-43cd-a9f5-43259dd5c38f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:42.137818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1377/2730] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:42 2022] PUT /identity/v3/projects/fbeb6e4e17c84786bb6f38e62aa2007d/users/6afdc5cff4944116a78040017bf1ef6a/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:42.149394 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9784f-3aa2-4362-983e-6a49b1ab0d34 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:42.149681 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9784f-3aa2-4362-983e-6a49b1ab0d34 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:42.149958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9784f-3aa2-4362-983e-6a49b1ab0d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:42.178491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e0d9784f-3aa2-4362-983e-6a49b1ab0d34 None None] MFA Rules not processed for user `6afdc5cff4944116a78040017bf1ef6a`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:42.179705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e0d9784f-3aa2-4362-983e-6a49b1ab0d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:42.183920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1354/2731] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:42 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:42.195165 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b2aa7-82c8-4749-9bd3-cb9e3e59b2d0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:42.196483 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-8e7b2aa7-82c8-4749-9bd3-cb9e3e59b2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:42.226101 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:42.251519 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1378/2732] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:42 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:42.255888 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b2aa7-82c8-4749-9bd3-cb9e3e59b2d0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:42.262841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9784f-3aa2-4362-983e-6a49b1ab0d34 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:42.264319 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e0d9784f-3aa2-4362-983e-6a49b1ab0d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:42.306472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa530c-143e-4b20-8a77-7ed3ee735a09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:42.307075 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa530c-143e-4b20-8a77-7ed3ee735a09 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:42.307352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa530c-143e-4b20-8a77-7ed3ee735a09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:42.307620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fa530c-143e-4b20-8a77-7ed3ee735a09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:42.320399 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:42.330439 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9784f-3aa2-4362-983e-6a49b1ab0d34 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:42.334606 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323c66a-0fff-453a-83e9-8c3522d2f44e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:42.335211 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323c66a-0fff-453a-83e9-8c3522d2f44e service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:42.335492 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323c66a-0fff-453a-83e9-8c3522d2f44e service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:42.335763 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c323c66a-0fff-453a-83e9-8c3522d2f44e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:42.373630 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa530c-143e-4b20-8a77-7ed3ee735a09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:42.375337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fa530c-143e-4b20-8a77-7ed3ee735a09 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:42.386289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1355/2733] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:42 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:44:42.391708 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323c66a-0fff-453a-83e9-8c3522d2f44e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:42.393180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c323c66a-0fff-453a-83e9-8c3522d2f44e service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:42.402242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1379/2734] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 06:44:42.551765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa530c-143e-4b20-8a77-7ed3ee735a09 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:42.560918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fa530c-143e-4b20-8a77-7ed3ee735a09 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:42.564754 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8df62-4a9b-4e7a-9981-1d7e8508d939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:42.565350 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8df62-4a9b-4e7a-9981-1d7e8508d939 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:42.566206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8df62-4a9b-4e7a-9981-1d7e8508d939 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:42.566479 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8df62-4a9b-4e7a-9981-1d7e8508d939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:42.650683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8df62-4a9b-4e7a-9981-1d7e8508d939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:42.650683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d8df62-4a9b-4e7a-9981-1d7e8508d939 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:42.656857 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1356/2735] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:42 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:44.962108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323c66a-0fff-453a-83e9-8c3522d2f44e service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:45.023727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c323c66a-0fff-453a-83e9-8c3522d2f44e service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:45.028177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39c525-c51b-4540-975f-7bac2734099c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:45.028829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39c525-c51b-4540-975f-7bac2734099c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:45.029113 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39c525-c51b-4540-975f-7bac2734099c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:45.029385 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39c525-c51b-4540-975f-7bac2734099c admin admin] PATH_INFO: `/v3/users/0e5a8fde12b7408b8d9f6d89e279a60e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:45.030489 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39c525-c51b-4540-975f-7bac2734099c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e5a8fde12b7408b8d9f6d89e279a60e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:45.032391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39c525-c51b-4540-975f-7bac2734099c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:45.073583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:45.080686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-2a39c525-c51b-4540-975f-7bac2734099c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e5a8fde12b7408b8d9f6d89e279a60e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:45.089711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-2a39c525-c51b-4540-975f-7bac2734099c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e5a8fde12b7408b8d9f6d89e279a60e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:45.102550 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-2a39c525-c51b-4540-975f-7bac2734099c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e5a8fde12b7408b8d9f6d89e279a60e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:45.103388 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-2a39c525-c51b-4540-975f-7bac2734099c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e5a8fde12b7408b8d9f6d89e279a60e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:45.111388 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-2a39c525-c51b-4540-975f-7bac2734099c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e5a8fde12b7408b8d9f6d89e279a60e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:45.118404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1380/2736] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:44 2022] DELETE /identity/v3/users/0e5a8fde12b7408b8d9f6d89e279a60e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:45.122867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fdcd0-db33-42d4-98ce-6016aa6e1748 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:45.123358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fdcd0-db33-42d4-98ce-6016aa6e1748 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:45.123448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706fdcd0-db33-42d4-98ce-6016aa6e1748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:45.142145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-706fdcd0-db33-42d4-98ce-6016aa6e1748 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:45.143321 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-706fdcd0-db33-42d4-98ce-6016aa6e1748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:45.204646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1357/2737] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:45.214153 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39c525-c51b-4540-975f-7bac2734099c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:45.215634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2a39c525-c51b-4540-975f-7bac2734099c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:45.301007 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39c525-c51b-4540-975f-7bac2734099c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:45.323497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0f46a-0f2f-404d-bb68-2bc179403735 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:45.324221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0f46a-0f2f-404d-bb68-2bc179403735 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:45.324594 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0f46a-0f2f-404d-bb68-2bc179403735 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:45.324991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0f46a-0f2f-404d-bb68-2bc179403735 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:45.334937 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0f46a-0f2f-404d-bb68-2bc179403735 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:45.336374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0f46a-0f2f-404d-bb68-2bc179403735 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:45.347023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1381/2738] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:45.672750 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fdcd0-db33-42d4-98ce-6016aa6e1748 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:45.674665 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-706fdcd0-db33-42d4-98ce-6016aa6e1748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:45.706564 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706fdcd0-db33-42d4-98ce-6016aa6e1748 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:45.714763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3a79d-b674-4049-b768-1528b534458a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:45.715409 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a79d-b674-4049-b768-1528b534458a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:45.715719 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a79d-b674-4049-b768-1528b534458a admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:45.715989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef3a79d-b674-4049-b768-1528b534458a admin admin] PATH_INFO: `/v3/projects/c254681b10674f6c967dc1c7657816b5` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:45.717323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3a79d-b674-4049-b768-1528b534458a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c254681b10674f6c967dc1c7657816b5)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:45.719478 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef3a79d-b674-4049-b768-1528b534458a admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:45.786380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:45.789996 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9ef3a79d-b674-4049-b768-1528b534458a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c254681b10674f6c967dc1c7657816b5', 'request_id': 'req-9ef3a79d-b674-4049-b768-1528b534458a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:45.802836 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9ef3a79d-b674-4049-b768-1528b534458a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c254681b10674f6c967dc1c7657816b5', 'request_id': 'req-9ef3a79d-b674-4049-b768-1528b534458a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:45.810363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9ef3a79d-b674-4049-b768-1528b534458a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c254681b10674f6c967dc1c7657816b5', 'request_id': 'req-9ef3a79d-b674-4049-b768-1528b534458a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:45.835182 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9ef3a79d-b674-4049-b768-1528b534458a admin admin] The token cache is being invalidate because project c254681b10674f6c967dc1c7657816b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:45.835496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9ef3a79d-b674-4049-b768-1528b534458a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:45.836124 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-9ef3a79d-b674-4049-b768-1528b534458a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:45.838289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1358/2739] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:45 2022] DELETE /identity/v3/projects/c254681b10674f6c967dc1c7657816b5 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:45.842033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0f46a-0f2f-404d-bb68-2bc179403735 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:45.853482 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0f46a-0f2f-404d-bb68-2bc179403735 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:45.928027 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ec390-02f8-45f6-b9b1-dab755aba55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:45.928685 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ec390-02f8-45f6-b9b1-dab755aba55e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:45.928975 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ec390-02f8-45f6-b9b1-dab755aba55e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:45.929249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ec390-02f8-45f6-b9b1-dab755aba55e admin admin] PATH_INFO: `/v3/users/6afdc5cff4944116a78040017bf1ef6a` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:45.930384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ec390-02f8-45f6-b9b1-dab755aba55e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6afdc5cff4944116a78040017bf1ef6a)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:45.932308 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ec390-02f8-45f6-b9b1-dab755aba55e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:45.979664 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-362ec390-02f8-45f6-b9b1-dab755aba55e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6afdc5cff4944116a78040017bf1ef6a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:45.986926 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-362ec390-02f8-45f6-b9b1-dab755aba55e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6afdc5cff4944116a78040017bf1ef6a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:45.991362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:46.001392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-362ec390-02f8-45f6-b9b1-dab755aba55e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6afdc5cff4944116a78040017bf1ef6a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:46.002193 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-362ec390-02f8-45f6-b9b1-dab755aba55e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6afdc5cff4944116a78040017bf1ef6a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:46.010105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-362ec390-02f8-45f6-b9b1-dab755aba55e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6afdc5cff4944116a78040017bf1ef6a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:46.016136 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1382/2740] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:45 2022] DELETE /identity/v3/users/6afdc5cff4944116a78040017bf1ef6a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:46.283892 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3a79d-b674-4049-b768-1528b534458a admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:46.286189 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9ef3a79d-b674-4049-b768-1528b534458a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:46.302214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef3a79d-b674-4049-b768-1528b534458a admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:46.358701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6458ff48-d7a5-4f1a-b765-9f6f15c486aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:46.359330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ff48-d7a5-4f1a-b765-9f6f15c486aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:46.359612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ff48-d7a5-4f1a-b765-9f6f15c486aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:46.359885 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6458ff48-d7a5-4f1a-b765-9f6f15c486aa admin admin] PATH_INFO: `/v3/projects/fbeb6e4e17c84786bb6f38e62aa2007d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:46.361033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458ff48-d7a5-4f1a-b765-9f6f15c486aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbeb6e4e17c84786bb6f38e62aa2007d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:46.362999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6458ff48-d7a5-4f1a-b765-9f6f15c486aa admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:46.408205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6458ff48-d7a5-4f1a-b765-9f6f15c486aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbeb6e4e17c84786bb6f38e62aa2007d', 'request_id': 'req-6458ff48-d7a5-4f1a-b765-9f6f15c486aa'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:46.414148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6458ff48-d7a5-4f1a-b765-9f6f15c486aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbeb6e4e17c84786bb6f38e62aa2007d', 'request_id': 'req-6458ff48-d7a5-4f1a-b765-9f6f15c486aa'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:46.420295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6458ff48-d7a5-4f1a-b765-9f6f15c486aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbeb6e4e17c84786bb6f38e62aa2007d', 'request_id': 'req-6458ff48-d7a5-4f1a-b765-9f6f15c486aa'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:46.433132 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6458ff48-d7a5-4f1a-b765-9f6f15c486aa admin admin] The token cache is being invalidate because project fbeb6e4e17c84786bb6f38e62aa2007d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:46.433423 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6458ff48-d7a5-4f1a-b765-9f6f15c486aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:46.434044 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6458ff48-d7a5-4f1a-b765-9f6f15c486aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:46.435494 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1359/2741] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:46 2022] DELETE /identity/v3/projects/fbeb6e4e17c84786bb6f38e62aa2007d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:46.440514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50555cd-6cee-46bd-b390-14843f843499 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:46.440834 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50555cd-6cee-46bd-b390-14843f843499 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:46.441112 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50555cd-6cee-46bd-b390-14843f843499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:46.461210 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d50555cd-6cee-46bd-b390-14843f843499 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:46.462416 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d50555cd-6cee-46bd-b390-14843f843499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:46.527641 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1383/2742] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:46.535842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b817e9-361d-4aa5-97ac-9000de5309fd None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:46.536155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b817e9-361d-4aa5-97ac-9000de5309fd None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:46.536430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b817e9-361d-4aa5-97ac-9000de5309fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:46.556865 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-89b817e9-361d-4aa5-97ac-9000de5309fd None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:46.558079 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-89b817e9-361d-4aa5-97ac-9000de5309fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:46.566058 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1360/2743] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:46.570301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50555cd-6cee-46bd-b390-14843f843499 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:46.579970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50555cd-6cee-46bd-b390-14843f843499 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:46.585139 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806da0e5-27e8-46fc-9b7b-d212ca3d9710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:46.585750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806da0e5-27e8-46fc-9b7b-d212ca3d9710 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:46.586030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806da0e5-27e8-46fc-9b7b-d212ca3d9710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:46.586303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806da0e5-27e8-46fc-9b7b-d212ca3d9710 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:46.586960 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806da0e5-27e8-46fc-9b7b-d212ca3d9710 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:44:46.587264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806da0e5-27e8-46fc-9b7b-d212ca3d9710 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:46.588879 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806da0e5-27e8-46fc-9b7b-d212ca3d9710 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:46.600817 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1384/2744] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:44:46.605161 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b817e9-361d-4aa5-97ac-9000de5309fd None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:46.614704 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b817e9-361d-4aa5-97ac-9000de5309fd None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:46.619657 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c6ead-17ff-4dc6-8e43-dfc7325acdb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:46.620252 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c6ead-17ff-4dc6-8e43-dfc7325acdb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:46.620531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c6ead-17ff-4dc6-8e43-dfc7325acdb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:46.620836 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c6ead-17ff-4dc6-8e43-dfc7325acdb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:46.621470 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c6ead-17ff-4dc6-8e43-dfc7325acdb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:46.623338 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c6ead-17ff-4dc6-8e43-dfc7325acdb0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:46.656480 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1361/2745] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:46 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:46.657855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806da0e5-27e8-46fc-9b7b-d212ca3d9710 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:46.667904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806da0e5-27e8-46fc-9b7b-d212ca3d9710 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:46.723363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e33d74-f61a-41d9-9bdc-6577423cdf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:46.723952 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e33d74-f61a-41d9-9bdc-6577423cdf7c admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:46.724230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e33d74-f61a-41d9-9bdc-6577423cdf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:46.724501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e33d74-f61a-41d9-9bdc-6577423cdf7c admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:46.725164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e33d74-f61a-41d9-9bdc-6577423cdf7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:46.727066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e33d74-f61a-41d9-9bdc-6577423cdf7c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:46.748255 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1385/2746] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:46 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:46.752310 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c6ead-17ff-4dc6-8e43-dfc7325acdb0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:46.762642 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c6ead-17ff-4dc6-8e43-dfc7325acdb0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:46.767262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8ae9c-ddb3-4288-a718-5fc609aa372d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:46.767849 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8ae9c-ddb3-4288-a718-5fc609aa372d admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:46.768128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8ae9c-ddb3-4288-a718-5fc609aa372d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:46.768928 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d8ae9c-ddb3-4288-a718-5fc609aa372d admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:46.769576 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8ae9c-ddb3-4288-a718-5fc609aa372d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:46.771138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d8ae9c-ddb3-4288-a718-5fc609aa372d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:46.781794 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1362/2747] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:44:46.786434 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e33d74-f61a-41d9-9bdc-6577423cdf7c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:46.796958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e33d74-f61a-41d9-9bdc-6577423cdf7c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:46.801665 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6024aba7-d07e-45ee-864a-d04a8172812e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:46.802373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024aba7-d07e-45ee-864a-d04a8172812e admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:46.802618 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024aba7-d07e-45ee-864a-d04a8172812e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:46.802895 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6024aba7-d07e-45ee-864a-d04a8172812e admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:46.803609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024aba7-d07e-45ee-864a-d04a8172812e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:46.805138 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6024aba7-d07e-45ee-864a-d04a8172812e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:46.815911 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1386/2748] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:46.820290 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8ae9c-ddb3-4288-a718-5fc609aa372d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:46.830496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d8ae9c-ddb3-4288-a718-5fc609aa372d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:46.835945 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60062482-0222-4fee-b972-3b80a459fa74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:46.836586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60062482-0222-4fee-b972-3b80a459fa74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:46.836897 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60062482-0222-4fee-b972-3b80a459fa74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:46.837194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60062482-0222-4fee-b972-3b80a459fa74 admin admin] PATH_INFO: `/v3/projects/71e17b97332b47bd88b5178f723a83e1/users/023904c12714482685c72be7e8b68fda/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:46.856850 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60062482-0222-4fee-b972-3b80a459fa74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e17b97332b47bd88b5178f723a83e1, user_id=023904c12714482685c72be7e8b68fda, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:46.859515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60062482-0222-4fee-b972-3b80a459fa74 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:46.870941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:46.876238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1363/2749] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:46 2022] PUT /identity/v3/projects/71e17b97332b47bd88b5178f723a83e1/users/023904c12714482685c72be7e8b68fda/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:46.883418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10731c-394b-4da6-9674-79f7af465f41 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:46.883709 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10731c-394b-4da6-9674-79f7af465f41 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:46.883984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10731c-394b-4da6-9674-79f7af465f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:46.904372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-dc10731c-394b-4da6-9674-79f7af465f41 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:46.905699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-dc10731c-394b-4da6-9674-79f7af465f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:46.951757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:46.974461 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1387/2750] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:46.984406 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60062482-0222-4fee-b972-3b80a459fa74 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:46.986451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-60062482-0222-4fee-b972-3b80a459fa74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:47.048312 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60062482-0222-4fee-b972-3b80a459fa74 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:47.052238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fda850-5c00-4c26-b586-13b703de7b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:47.052927 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fda850-5c00-4c26-b586-13b703de7b6b service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:47.053144 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fda850-5c00-4c26-b586-13b703de7b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:47.053444 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fda850-5c00-4c26-b586-13b703de7b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:47.062901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fda850-5c00-4c26-b586-13b703de7b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:47.064322 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fda850-5c00-4c26-b586-13b703de7b6b service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:47.076529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1364/2751] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:47.735965 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5b56-54b9-4962-a700-9db8a7d3ce42 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:47.736440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5b56-54b9-4962-a700-9db8a7d3ce42 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:47.736719 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b5b56-54b9-4962-a700-9db8a7d3ce42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:47.768170 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-071b5b56-54b9-4962-a700-9db8a7d3ce42 None None] MFA Rules not processed for user `023904c12714482685c72be7e8b68fda`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:47.769568 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-071b5b56-54b9-4962-a700-9db8a7d3ce42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:47.856765 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1388/2752] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:47.864690 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fda850-5c00-4c26-b586-13b703de7b6b service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:47.866158 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a5fda850-5c00-4c26-b586-13b703de7b6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:47.931047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fda850-5c00-4c26-b586-13b703de7b6b service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:47.934671 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eec1b5-054e-4c99-a8f9-a4a05d583d0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:47.935278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eec1b5-054e-4c99-a8f9-a4a05d583d0c service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:47.935555 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eec1b5-054e-4c99-a8f9-a4a05d583d0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:47.935833 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eec1b5-054e-4c99-a8f9-a4a05d583d0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:47.946710 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eec1b5-054e-4c99-a8f9-a4a05d583d0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:47.948232 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eec1b5-054e-4c99-a8f9-a4a05d583d0c service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:47.957501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1365/2753] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:48.091620 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b5b56-54b9-4962-a700-9db8a7d3ce42 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:48.093151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-071b5b56-54b9-4962-a700-9db8a7d3ce42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:48.107747 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b5b56-54b9-4962-a700-9db8a7d3ce42 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:48.113028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48f886-7bd6-429c-b1ea-8f966af4b4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:48.113733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48f886-7bd6-429c-b1ea-8f966af4b4e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:48.114025 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48f886-7bd6-429c-b1ea-8f966af4b4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:48.114303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed48f886-7bd6-429c-b1ea-8f966af4b4e1 admin admin] PATH_INFO: `/v3/users/7e0feb3dbbff4b4fbc6291dcdb38a191` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:48.115461 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48f886-7bd6-429c-b1ea-8f966af4b4e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e0feb3dbbff4b4fbc6291dcdb38a191)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:48.119126 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed48f886-7bd6-429c-b1ea-8f966af4b4e1 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:48.167664 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ed48f886-7bd6-429c-b1ea-8f966af4b4e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e0feb3dbbff4b4fbc6291dcdb38a191'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:48.177004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ed48f886-7bd6-429c-b1ea-8f966af4b4e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e0feb3dbbff4b4fbc6291dcdb38a191'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:48.191683 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ed48f886-7bd6-429c-b1ea-8f966af4b4e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e0feb3dbbff4b4fbc6291dcdb38a191'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:48.192472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ed48f886-7bd6-429c-b1ea-8f966af4b4e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e0feb3dbbff4b4fbc6291dcdb38a191'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:48.202100 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ed48f886-7bd6-429c-b1ea-8f966af4b4e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e0feb3dbbff4b4fbc6291dcdb38a191'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:48.213613 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1389/2754] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:48 2022] DELETE /identity/v3/users/7e0feb3dbbff4b4fbc6291dcdb38a191 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:48.214927 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c8d00-3c9e-40d9-a2e1-41c3abd81fb4 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:48.215212 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c8d00-3c9e-40d9-a2e1-41c3abd81fb4 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:48.215485 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c8d00-3c9e-40d9-a2e1-41c3abd81fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:48.257014 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a55c8d00-3c9e-40d9-a2e1-41c3abd81fb4 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:48.258240 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a55c8d00-3c9e-40d9-a2e1-41c3abd81fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:48.350128 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1366/2755] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:48.360975 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48f886-7bd6-429c-b1ea-8f966af4b4e1 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:48.363391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ed48f886-7bd6-429c-b1ea-8f966af4b4e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:48.420377 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:48.427379 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed48f886-7bd6-429c-b1ea-8f966af4b4e1 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:48.433056 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53578b-ecfd-4ca8-bbdf-3df5327c9ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:48.434508 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53578b-ecfd-4ca8-bbdf-3df5327c9ade service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:48.434959 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53578b-ecfd-4ca8-bbdf-3df5327c9ade service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:48.435334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53578b-ecfd-4ca8-bbdf-3df5327c9ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:48.451594 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53578b-ecfd-4ca8-bbdf-3df5327c9ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:48.453331 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b53578b-ecfd-4ca8-bbdf-3df5327c9ade service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:48.465433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1390/2756] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:48.760505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c8d00-3c9e-40d9-a2e1-41c3abd81fb4 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:48.761952 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a55c8d00-3c9e-40d9-a2e1-41c3abd81fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:48.774011 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c8d00-3c9e-40d9-a2e1-41c3abd81fb4 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:48.779454 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39828a-b774-47e8-81a5-cc5764920cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:48.780089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39828a-b774-47e8-81a5-cc5764920cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:48.780367 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39828a-b774-47e8-81a5-cc5764920cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:48.780636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e39828a-b774-47e8-81a5-cc5764920cd1 admin admin] PATH_INFO: `/v3/projects/8a874d89e9c6482d80de0f4cd2a5918a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:48.781884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39828a-b774-47e8-81a5-cc5764920cd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a874d89e9c6482d80de0f4cd2a5918a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:48.783757 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e39828a-b774-47e8-81a5-cc5764920cd1 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:48.825125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:48.832041 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6e39828a-b774-47e8-81a5-cc5764920cd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a874d89e9c6482d80de0f4cd2a5918a', 'request_id': 'req-6e39828a-b774-47e8-81a5-cc5764920cd1'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:48.837553 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6e39828a-b774-47e8-81a5-cc5764920cd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a874d89e9c6482d80de0f4cd2a5918a', 'request_id': 'req-6e39828a-b774-47e8-81a5-cc5764920cd1'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:48.843584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6e39828a-b774-47e8-81a5-cc5764920cd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a874d89e9c6482d80de0f4cd2a5918a', 'request_id': 'req-6e39828a-b774-47e8-81a5-cc5764920cd1'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:48.855708 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6e39828a-b774-47e8-81a5-cc5764920cd1 admin admin] The token cache is being invalidate because project 8a874d89e9c6482d80de0f4cd2a5918a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:48.855989 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6e39828a-b774-47e8-81a5-cc5764920cd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:48.856602 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6e39828a-b774-47e8-81a5-cc5764920cd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:48.858097 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1367/2757] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:48 2022] DELETE /identity/v3/projects/8a874d89e9c6482d80de0f4cd2a5918a => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:48.865738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53578b-ecfd-4ca8-bbdf-3df5327c9ade service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:48.876931 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53578b-ecfd-4ca8-bbdf-3df5327c9ade service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:48.934397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb8f43d-bed4-4d53-b14e-005e691b1b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:48.935028 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8f43d-bed4-4d53-b14e-005e691b1b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:48.935306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8f43d-bed4-4d53-b14e-005e691b1b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:48.935579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb8f43d-bed4-4d53-b14e-005e691b1b49 admin admin] PATH_INFO: `/v3/users/050080db78404313a889cfd62192e972` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:48.936727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8f43d-bed4-4d53-b14e-005e691b1b49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=050080db78404313a889cfd62192e972)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:48.938637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb8f43d-bed4-4d53-b14e-005e691b1b49 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:48.983833 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-cbb8f43d-bed4-4d53-b14e-005e691b1b49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '050080db78404313a889cfd62192e972'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:48.991396 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-cbb8f43d-bed4-4d53-b14e-005e691b1b49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '050080db78404313a889cfd62192e972'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:49.004179 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-cbb8f43d-bed4-4d53-b14e-005e691b1b49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '050080db78404313a889cfd62192e972'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:49.004929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-cbb8f43d-bed4-4d53-b14e-005e691b1b49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '050080db78404313a889cfd62192e972'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:49.012866 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-cbb8f43d-bed4-4d53-b14e-005e691b1b49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '050080db78404313a889cfd62192e972'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:49.020639 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1391/2758] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:48 2022] DELETE /identity/v3/users/050080db78404313a889cfd62192e972 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:49.280566 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39828a-b774-47e8-81a5-cc5764920cd1 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:49.282082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-6e39828a-b774-47e8-81a5-cc5764920cd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:49.295223 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e39828a-b774-47e8-81a5-cc5764920cd1 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:49.360451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5937fb-abce-4023-a334-792a38490425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:49.361148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5937fb-abce-4023-a334-792a38490425 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:49.361430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5937fb-abce-4023-a334-792a38490425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:49.361699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5937fb-abce-4023-a334-792a38490425 admin admin] PATH_INFO: `/v3/projects/42cc7b43620c41a1bbc93ac065276085` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:49.362923 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5937fb-abce-4023-a334-792a38490425 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42cc7b43620c41a1bbc93ac065276085)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:49.364895 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5937fb-abce-4023-a334-792a38490425 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:49.414284 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005dbe1-1a50-42a3-9b50-2f048047113e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:49.414602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005dbe1-1a50-42a3-9b50-2f048047113e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:49.414874 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4005dbe1-1a50-42a3-9b50-2f048047113e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:49.416449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b5937fb-abce-4023-a334-792a38490425 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42cc7b43620c41a1bbc93ac065276085', 'request_id': 'req-2b5937fb-abce-4023-a334-792a38490425'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:49.422104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b5937fb-abce-4023-a334-792a38490425 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42cc7b43620c41a1bbc93ac065276085', 'request_id': 'req-2b5937fb-abce-4023-a334-792a38490425'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:49.428338 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b5937fb-abce-4023-a334-792a38490425 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42cc7b43620c41a1bbc93ac065276085', 'request_id': 'req-2b5937fb-abce-4023-a334-792a38490425'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:49.435041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-4005dbe1-1a50-42a3-9b50-2f048047113e None None] MFA Rules not processed for user `023904c12714482685c72be7e8b68fda`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:49.436233 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4005dbe1-1a50-42a3-9b50-2f048047113e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:49.443347 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b5937fb-abce-4023-a334-792a38490425 admin admin] The token cache is being invalidate because project 42cc7b43620c41a1bbc93ac065276085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:44:49.443675 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b5937fb-abce-4023-a334-792a38490425 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:49.444448 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-2b5937fb-abce-4023-a334-792a38490425 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:49.445914 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1368/2759] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:49 2022] DELETE /identity/v3/projects/42cc7b43620c41a1bbc93ac065276085 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:49.451521 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfb67c-b829-4733-a091-e4524dfef3d9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:49.451802 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfb67c-b829-4733-a091-e4524dfef3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:49.452076 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdfb67c-b829-4733-a091-e4524dfef3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:49.474936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9fdfb67c-b829-4733-a091-e4524dfef3d9 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:49.476406 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9fdfb67c-b829-4733-a091-e4524dfef3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:49.495484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1392/2760] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:49.528333 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:49.538756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1369/2761] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:49.550293 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18b041-b749-42a1-bdb9-005b89b68ac8 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:49.550647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18b041-b749-42a1-bdb9-005b89b68ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:49.551098 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18b041-b749-42a1-bdb9-005b89b68ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:49.577646 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-df18b041-b749-42a1-bdb9-005b89b68ac8 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:49.579166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-df18b041-b749-42a1-bdb9-005b89b68ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:49.588134 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1393/2762] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:44:49.592334 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfb67c-b829-4733-a091-e4524dfef3d9 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:49.604727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdfb67c-b829-4733-a091-e4524dfef3d9 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:49.609489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6607daa-cb3c-402d-a9f3-d98b3b1da0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:49.610258 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6607daa-cb3c-402d-a9f3-d98b3b1da0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:49.610650 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6607daa-cb3c-402d-a9f3-d98b3b1da0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:49.611013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6607daa-cb3c-402d-a9f3-d98b3b1da0a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:49.612030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6607daa-cb3c-402d-a9f3-d98b3b1da0a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:44:49.612464 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6607daa-cb3c-402d-a9f3-d98b3b1da0a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:49.614181 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6607daa-cb3c-402d-a9f3-d98b3b1da0a9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:49.634735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1370/2763] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:44:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 06:44:49.639712 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18b041-b749-42a1-bdb9-005b89b68ac8 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:49.652088 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18b041-b749-42a1-bdb9-005b89b68ac8 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:49.658754 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e86aac-e288-4229-8bff-379271ef49a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:49.659953 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e86aac-e288-4229-8bff-379271ef49a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:49.660229 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e86aac-e288-4229-8bff-379271ef49a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:49.660501 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e86aac-e288-4229-8bff-379271ef49a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:49.661296 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e86aac-e288-4229-8bff-379271ef49a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:49.663278 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e86aac-e288-4229-8bff-379271ef49a9 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:49.668300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:49.708406 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1394/2764] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:44:49 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:44:49.712967 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6607daa-cb3c-402d-a9f3-d98b3b1da0a9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:49.723544 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6607daa-cb3c-402d-a9f3-d98b3b1da0a9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:49.785898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c953d9f-c811-4bc6-bd1a-ad76696948ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:49.786579 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c953d9f-c811-4bc6-bd1a-ad76696948ee admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:49.786889 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c953d9f-c811-4bc6-bd1a-ad76696948ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:49.787163 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c953d9f-c811-4bc6-bd1a-ad76696948ee admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:49.787800 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c953d9f-c811-4bc6-bd1a-ad76696948ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:49.789738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c953d9f-c811-4bc6-bd1a-ad76696948ee admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:49.813680 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1371/2765] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:44:49 2022] POST /identity/v3/users => generated 289 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:44:49.819556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e86aac-e288-4229-8bff-379271ef49a9 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:49.834180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e86aac-e288-4229-8bff-379271ef49a9 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:49.843499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970e374-7f9f-43da-943e-727f4a964a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:49.844473 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970e374-7f9f-43da-943e-727f4a964a19 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:49.844918 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970e374-7f9f-43da-943e-727f4a964a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:49.847517 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970e374-7f9f-43da-943e-727f4a964a19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:49.847517 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970e374-7f9f-43da-943e-727f4a964a19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:49.848970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f970e374-7f9f-43da-943e-727f4a964a19 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:49.866374 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1395/2766] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:49.870641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c953d9f-c811-4bc6-bd1a-ad76696948ee admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:49.886053 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c953d9f-c811-4bc6-bd1a-ad76696948ee admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:49.890686 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db745b-689c-4e17-a9ae-fac397e68838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:49.891289 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db745b-689c-4e17-a9ae-fac397e68838 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:49.891568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db745b-689c-4e17-a9ae-fac397e68838 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:49.891833 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db745b-689c-4e17-a9ae-fac397e68838 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:49.892469 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db745b-689c-4e17-a9ae-fac397e68838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:49.894641 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db745b-689c-4e17-a9ae-fac397e68838 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:49.905811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1372/2767] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:44:49.910547 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970e374-7f9f-43da-943e-727f4a964a19 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:49.922270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970e374-7f9f-43da-943e-727f4a964a19 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:49.930354 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e590a69-e58a-4ca4-a10e-656995b19705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:49.931442 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e590a69-e58a-4ca4-a10e-656995b19705 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:49.931726 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e590a69-e58a-4ca4-a10e-656995b19705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:49.932026 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e590a69-e58a-4ca4-a10e-656995b19705 admin admin] PATH_INFO: `/v3/projects/732540bd7b1a477a92ded6f39afcd2c3/users/e9d55f43c77d4048b531254f2885ed6e/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:49.949277 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e590a69-e58a-4ca4-a10e-656995b19705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=732540bd7b1a477a92ded6f39afcd2c3, user_id=e9d55f43c77d4048b531254f2885ed6e, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:49.952037 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e590a69-e58a-4ca4-a10e-656995b19705 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:49.967156 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1396/2768] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:44:49 2022] PUT /identity/v3/projects/732540bd7b1a477a92ded6f39afcd2c3/users/e9d55f43c77d4048b531254f2885ed6e/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:44:49.978700 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf63cb4-e421-4646-bfb3-1112833e063c None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:49.979053 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf63cb4-e421-4646-bfb3-1112833e063c None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:49.979342 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf63cb4-e421-4646-bfb3-1112833e063c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:50.012717 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5bf63cb4-e421-4646-bfb3-1112833e063c None None] MFA Rules not processed for user `e9d55f43c77d4048b531254f2885ed6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:44:50.014138 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5bf63cb4-e421-4646-bfb3-1112833e063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:50.089344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1373/2769] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:44:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:44:50.101842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e590a69-e58a-4ca4-a10e-656995b19705 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:50.103595 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9e590a69-e58a-4ca4-a10e-656995b19705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:50.184899 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e590a69-e58a-4ca4-a10e-656995b19705 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:50.189493 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e503c-37c9-4f7b-bd24-4fffe7a36515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:50.190860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e503c-37c9-4f7b-bd24-4fffe7a36515 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:50.191149 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e503c-37c9-4f7b-bd24-4fffe7a36515 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:50.191423 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e503c-37c9-4f7b-bd24-4fffe7a36515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:50.201915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e503c-37c9-4f7b-bd24-4fffe7a36515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:50.203666 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e503c-37c9-4f7b-bd24-4fffe7a36515 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:50.216404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1397/2770] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:44:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:44:59.366827 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf63cb4-e421-4646-bfb3-1112833e063c None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:59.370954 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5bf63cb4-e421-4646-bfb3-1112833e063c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:44:59.449501 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:44:59.456894 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf63cb4-e421-4646-bfb3-1112833e063c None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:59.461320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0283e-77ce-4379-8673-4506a82be5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:59.461942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0283e-77ce-4379-8673-4506a82be5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:59.462219 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0283e-77ce-4379-8673-4506a82be5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:59.462600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f0283e-77ce-4379-8673-4506a82be5e5 admin admin] PATH_INFO: `/v3/users/aa79546df651495abf850a92f20b92e2` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:59.463810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0283e-77ce-4379-8673-4506a82be5e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa79546df651495abf850a92f20b92e2)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:59.465756 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f0283e-77ce-4379-8673-4506a82be5e5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:44:59.513791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-92f0283e-77ce-4379-8673-4506a82be5e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa79546df651495abf850a92f20b92e2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:59.521078 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-92f0283e-77ce-4379-8673-4506a82be5e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa79546df651495abf850a92f20b92e2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:59.533238 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-92f0283e-77ce-4379-8673-4506a82be5e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa79546df651495abf850a92f20b92e2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:59.543919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-92f0283e-77ce-4379-8673-4506a82be5e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa79546df651495abf850a92f20b92e2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:59.544176 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-92f0283e-77ce-4379-8673-4506a82be5e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa79546df651495abf850a92f20b92e2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:44:59.554655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1374/2771] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:44:59 2022] DELETE /identity/v3/users/aa79546df651495abf850a92f20b92e2 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:44:59.797390 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e503c-37c9-4f7b-bd24-4fffe7a36515 service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:44:59.820204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e503c-37c9-4f7b-bd24-4fffe7a36515 service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:44:59.920164 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4257e9-8aa0-4be5-96dc-c187055cdac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:44:59.921107 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4257e9-8aa0-4be5-96dc-c187055cdac7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:44:59.921564 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4257e9-8aa0-4be5-96dc-c187055cdac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:44:59.921995 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4257e9-8aa0-4be5-96dc-c187055cdac7 admin admin] PATH_INFO: `/v3/projects/49fa8c8d889c4b8eb4f8c59f9fd43200` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:44:59.949232 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4257e9-8aa0-4be5-96dc-c187055cdac7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49fa8c8d889c4b8eb4f8c59f9fd43200)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:44:59.951415 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4257e9-8aa0-4be5-96dc-c187055cdac7 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:00.027420 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-7d4257e9-8aa0-4be5-96dc-c187055cdac7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49fa8c8d889c4b8eb4f8c59f9fd43200', 'request_id': 'req-7d4257e9-8aa0-4be5-96dc-c187055cdac7'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:00.033090 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:00.041670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-7d4257e9-8aa0-4be5-96dc-c187055cdac7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49fa8c8d889c4b8eb4f8c59f9fd43200', 'request_id': 'req-7d4257e9-8aa0-4be5-96dc-c187055cdac7'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:00.054476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-7d4257e9-8aa0-4be5-96dc-c187055cdac7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49fa8c8d889c4b8eb4f8c59f9fd43200', 'request_id': 'req-7d4257e9-8aa0-4be5-96dc-c187055cdac7'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:00.078315 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-7d4257e9-8aa0-4be5-96dc-c187055cdac7 admin admin] The token cache is being invalidate because project 49fa8c8d889c4b8eb4f8c59f9fd43200 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:00.081152 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-7d4257e9-8aa0-4be5-96dc-c187055cdac7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:00.083380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-7d4257e9-8aa0-4be5-96dc-c187055cdac7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:00.087200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1398/2772] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:44:59 2022] DELETE /identity/v3/projects/49fa8c8d889c4b8eb4f8c59f9fd43200 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:00.091492 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0283e-77ce-4379-8673-4506a82be5e5 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:00.093052 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-92f0283e-77ce-4379-8673-4506a82be5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:00.117412 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f0283e-77ce-4379-8673-4506a82be5e5 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:00.204774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f437a2-2543-449e-8adc-4d4f1a712820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:00.205681 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f437a2-2543-449e-8adc-4d4f1a712820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:00.206141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f437a2-2543-449e-8adc-4d4f1a712820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:00.206421 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f437a2-2543-449e-8adc-4d4f1a712820 admin admin] PATH_INFO: `/v3/users/ca8af2d653f24ff0810f936006611b13` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:00.207716 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f437a2-2543-449e-8adc-4d4f1a712820 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca8af2d653f24ff0810f936006611b13)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:00.210023 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f437a2-2543-449e-8adc-4d4f1a712820 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:00.311364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c9f437a2-2543-449e-8adc-4d4f1a712820 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca8af2d653f24ff0810f936006611b13'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:00.323658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c9f437a2-2543-449e-8adc-4d4f1a712820 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca8af2d653f24ff0810f936006611b13'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:00.345277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c9f437a2-2543-449e-8adc-4d4f1a712820 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca8af2d653f24ff0810f936006611b13'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:00.349683 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:00.359211 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c9f437a2-2543-449e-8adc-4d4f1a712820 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca8af2d653f24ff0810f936006611b13'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:00.359843 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c9f437a2-2543-449e-8adc-4d4f1a712820 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca8af2d653f24ff0810f936006611b13'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:00.371645 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1375/2773] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:00 2022] DELETE /identity/v3/users/ca8af2d653f24ff0810f936006611b13 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:00.829404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4257e9-8aa0-4be5-96dc-c187055cdac7 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:00.832592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-7d4257e9-8aa0-4be5-96dc-c187055cdac7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:00.868221 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4257e9-8aa0-4be5-96dc-c187055cdac7 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:00.986303 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e7dc5-6655-47bf-92e6-7645c3ce83a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:00.987520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e7dc5-6655-47bf-92e6-7645c3ce83a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:00.987943 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e7dc5-6655-47bf-92e6-7645c3ce83a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:00.988145 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e7dc5-6655-47bf-92e6-7645c3ce83a4 admin admin] PATH_INFO: `/v3/projects/1fb4e25e933149d98daa31dcdecc6895` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:00.993035 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e7dc5-6655-47bf-92e6-7645c3ce83a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb4e25e933149d98daa31dcdecc6895)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:00.993035 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e7dc5-6655-47bf-92e6-7645c3ce83a4 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:01.086345 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e62e7dc5-6655-47bf-92e6-7645c3ce83a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb4e25e933149d98daa31dcdecc6895', 'request_id': 'req-e62e7dc5-6655-47bf-92e6-7645c3ce83a4'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:01.099502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e62e7dc5-6655-47bf-92e6-7645c3ce83a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb4e25e933149d98daa31dcdecc6895', 'request_id': 'req-e62e7dc5-6655-47bf-92e6-7645c3ce83a4'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:01.107533 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e62e7dc5-6655-47bf-92e6-7645c3ce83a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb4e25e933149d98daa31dcdecc6895', 'request_id': 'req-e62e7dc5-6655-47bf-92e6-7645c3ce83a4'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:01.121440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e62e7dc5-6655-47bf-92e6-7645c3ce83a4 admin admin] The token cache is being invalidate because project 1fb4e25e933149d98daa31dcdecc6895 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:01.121737 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e62e7dc5-6655-47bf-92e6-7645c3ce83a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:01.122407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e62e7dc5-6655-47bf-92e6-7645c3ce83a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:01.128036 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1399/2774] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:00 2022] DELETE /identity/v3/projects/1fb4e25e933149d98daa31dcdecc6895 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:01.129740 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32d076-b118-483e-aabd-086d8218f13b None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:01.130032 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32d076-b118-483e-aabd-086d8218f13b None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:01.130314 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a32d076-b118-483e-aabd-086d8218f13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:01.160306 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-5a32d076-b118-483e-aabd-086d8218f13b None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:01.163278 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5a32d076-b118-483e-aabd-086d8218f13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:01.230362 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1376/2775] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:45:01.239020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95a3a7-809c-4bf8-97ad-270a0fcb37f5 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:01.239314 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95a3a7-809c-4bf8-97ad-270a0fcb37f5 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:01.239643 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95a3a7-809c-4bf8-97ad-270a0fcb37f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:01.261894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0a95a3a7-809c-4bf8-97ad-270a0fcb37f5 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:01.263135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0a95a3a7-809c-4bf8-97ad-270a0fcb37f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:01.272746 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1400/2776] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:01.277409 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32d076-b118-483e-aabd-086d8218f13b None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:01.290451 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a32d076-b118-483e-aabd-086d8218f13b None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:01.295713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1271dde-082a-4b0c-aff3-7403ea562493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:01.296330 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1271dde-082a-4b0c-aff3-7403ea562493 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:01.296617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1271dde-082a-4b0c-aff3-7403ea562493 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:01.297036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1271dde-082a-4b0c-aff3-7403ea562493 admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:01.297696 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1271dde-082a-4b0c-aff3-7403ea562493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:45:01.298008 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1271dde-082a-4b0c-aff3-7403ea562493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:01.299720 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1271dde-082a-4b0c-aff3-7403ea562493 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:01.312300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1377/2777] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:45:01.317275 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95a3a7-809c-4bf8-97ad-270a0fcb37f5 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:01.333880 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95a3a7-809c-4bf8-97ad-270a0fcb37f5 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:01.339825 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40993d0d-b189-498d-bca2-6e3f836df155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:01.340511 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40993d0d-b189-498d-bca2-6e3f836df155 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:01.340890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40993d0d-b189-498d-bca2-6e3f836df155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:01.341169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40993d0d-b189-498d-bca2-6e3f836df155 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:01.341966 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40993d0d-b189-498d-bca2-6e3f836df155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:01.344001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40993d0d-b189-498d-bca2-6e3f836df155 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:01.376416 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1401/2778] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:45:01 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:45:01.381719 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1271dde-082a-4b0c-aff3-7403ea562493 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:01.404408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1271dde-082a-4b0c-aff3-7403ea562493 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:01.476199 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b8cef-a575-4383-a632-e7c5f925cce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:01.476844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b8cef-a575-4383-a632-e7c5f925cce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:01.477125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b8cef-a575-4383-a632-e7c5f925cce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:01.477595 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b8cef-a575-4383-a632-e7c5f925cce8 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:01.478231 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b8cef-a575-4383-a632-e7c5f925cce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:01.480315 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b8cef-a575-4383-a632-e7c5f925cce8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:01.509223 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1378/2779] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:45:01 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:01.513856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40993d0d-b189-498d-bca2-6e3f836df155 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:01.526573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40993d0d-b189-498d-bca2-6e3f836df155 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:01.539170 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589a897-6452-438f-b5c3-34253df9b7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:01.539706 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589a897-6452-438f-b5c3-34253df9b7bb admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:01.539985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589a897-6452-438f-b5c3-34253df9b7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:01.540261 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589a897-6452-438f-b5c3-34253df9b7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:01.543341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589a897-6452-438f-b5c3-34253df9b7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:01.543341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589a897-6452-438f-b5c3-34253df9b7bb admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:01.554323 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1402/2780] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:01.558324 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b8cef-a575-4383-a632-e7c5f925cce8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:01.569051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b8cef-a575-4383-a632-e7c5f925cce8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:01.578037 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352971c-d253-42a8-b4fb-b56b318973c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:01.578816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352971c-d253-42a8-b4fb-b56b318973c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:01.579106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352971c-d253-42a8-b4fb-b56b318973c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:01.579384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352971c-d253-42a8-b4fb-b56b318973c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:01.580046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352971c-d253-42a8-b4fb-b56b318973c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:01.581741 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b352971c-d253-42a8-b4fb-b56b318973c2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:01.593461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1379/2781] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:01.597699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589a897-6452-438f-b5c3-34253df9b7bb admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:01.608488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589a897-6452-438f-b5c3-34253df9b7bb admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:01.614635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9d367-1c63-4f8e-8e67-a55ee5c6e38c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:01.615356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9d367-1c63-4f8e-8e67-a55ee5c6e38c admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:01.615642 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9d367-1c63-4f8e-8e67-a55ee5c6e38c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:01.616015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f9d367-1c63-4f8e-8e67-a55ee5c6e38c admin admin] PATH_INFO: `/v3/projects/ed85e98c0c8a4f19ab56338afd67036a/users/7e3f8d97e8604120bdc283288689a178/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:01.638746 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9d367-1c63-4f8e-8e67-a55ee5c6e38c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed85e98c0c8a4f19ab56338afd67036a, user_id=7e3f8d97e8604120bdc283288689a178, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:01.647312 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f9d367-1c63-4f8e-8e67-a55ee5c6e38c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:01.667079 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1403/2782] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:45:01 2022] PUT /identity/v3/projects/ed85e98c0c8a4f19ab56338afd67036a/users/7e3f8d97e8604120bdc283288689a178/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:01.677838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25078a-55b7-4ce0-a9f3-4e52de272f45 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:01.678157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25078a-55b7-4ce0-a9f3-4e52de272f45 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:01.678752 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b25078a-55b7-4ce0-a9f3-4e52de272f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:01.711573 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-1b25078a-55b7-4ce0-a9f3-4e52de272f45 None None] MFA Rules not processed for user `7e3f8d97e8604120bdc283288689a178`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:01.713987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1b25078a-55b7-4ce0-a9f3-4e52de272f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:01.769489 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:01.795515 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1380/2783] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:01.809339 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9d367-1c63-4f8e-8e67-a55ee5c6e38c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:01.811271 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-07f9d367-1c63-4f8e-8e67-a55ee5c6e38c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:01.823826 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:01.891166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f9d367-1c63-4f8e-8e67-a55ee5c6e38c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:01.896268 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8640e8a3-3a66-4d1c-8e51-f5099f863b12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:01.897125 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640e8a3-3a66-4d1c-8e51-f5099f863b12 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:01.897557 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640e8a3-3a66-4d1c-8e51-f5099f863b12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:01.898114 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8640e8a3-3a66-4d1c-8e51-f5099f863b12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:01.919263 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640e8a3-3a66-4d1c-8e51-f5099f863b12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:01.921396 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8640e8a3-3a66-4d1c-8e51-f5099f863b12 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:01.937328 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1404/2784] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:01 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:02.378242 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25078a-55b7-4ce0-a9f3-4e52de272f45 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:02.380205 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-1b25078a-55b7-4ce0-a9f3-4e52de272f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:02.470034 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b25078a-55b7-4ce0-a9f3-4e52de272f45 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:02.476236 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea2621-4626-4d79-8550-3942ba997cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:02.477371 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea2621-4626-4d79-8550-3942ba997cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:02.477901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea2621-4626-4d79-8550-3942ba997cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:02.478381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ea2621-4626-4d79-8550-3942ba997cc7 admin admin] PATH_INFO: `/v3/users/e9d55f43c77d4048b531254f2885ed6e` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:02.479751 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea2621-4626-4d79-8550-3942ba997cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9d55f43c77d4048b531254f2885ed6e)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:02.481907 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ea2621-4626-4d79-8550-3942ba997cc7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:02.537446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-97ea2621-4626-4d79-8550-3942ba997cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9d55f43c77d4048b531254f2885ed6e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:02.546035 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-97ea2621-4626-4d79-8550-3942ba997cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9d55f43c77d4048b531254f2885ed6e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:02.572070 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-97ea2621-4626-4d79-8550-3942ba997cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9d55f43c77d4048b531254f2885ed6e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:02.579959 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-97ea2621-4626-4d79-8550-3942ba997cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9d55f43c77d4048b531254f2885ed6e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:02.581215 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-97ea2621-4626-4d79-8550-3942ba997cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9d55f43c77d4048b531254f2885ed6e'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:02.587504 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1381/2785] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:02 2022] DELETE /identity/v3/users/e9d55f43c77d4048b531254f2885ed6e => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:02.592562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f560a9-1f69-46e0-8eae-1c68b991a9c5 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:02.593011 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f560a9-1f69-46e0-8eae-1c68b991a9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:02.593600 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f560a9-1f69-46e0-8eae-1c68b991a9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:02.613829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-78f560a9-1f69-46e0-8eae-1c68b991a9c5 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:02.615214 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-78f560a9-1f69-46e0-8eae-1c68b991a9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:02.678596 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1405/2786] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:45:02.688277 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea2621-4626-4d79-8550-3942ba997cc7 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:02.690276 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-97ea2621-4626-4d79-8550-3942ba997cc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:02.763060 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ea2621-4626-4d79-8550-3942ba997cc7 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:02.766967 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273d2f1-6c4d-4d19-8d9a-fc5c5761e9ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:02.767578 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273d2f1-6c4d-4d19-8d9a-fc5c5761e9ae service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:02.767907 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273d2f1-6c4d-4d19-8d9a-fc5c5761e9ae service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:02.768808 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273d2f1-6c4d-4d19-8d9a-fc5c5761e9ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:02.778319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273d2f1-6c4d-4d19-8d9a-fc5c5761e9ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:02.779772 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273d2f1-6c4d-4d19-8d9a-fc5c5761e9ae service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:02.789596 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1382/2787] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:03.070955 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f560a9-1f69-46e0-8eae-1c68b991a9c5 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:03.073110 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-78f560a9-1f69-46e0-8eae-1c68b991a9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:03.086865 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f560a9-1f69-46e0-8eae-1c68b991a9c5 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:03.094638 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7d7e3-a0da-4202-96d9-2a917d369136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:03.097574 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7d7e3-a0da-4202-96d9-2a917d369136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:03.098392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7d7e3-a0da-4202-96d9-2a917d369136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:03.098926 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7d7e3-a0da-4202-96d9-2a917d369136 admin admin] PATH_INFO: `/v3/projects/732540bd7b1a477a92ded6f39afcd2c3` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:03.102581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7d7e3-a0da-4202-96d9-2a917d369136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=732540bd7b1a477a92ded6f39afcd2c3)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:03.105350 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7d7e3-a0da-4202-96d9-2a917d369136 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:03.163846 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ebf7d7e3-a0da-4202-96d9-2a917d369136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '732540bd7b1a477a92ded6f39afcd2c3', 'request_id': 'req-ebf7d7e3-a0da-4202-96d9-2a917d369136'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:03.174448 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ebf7d7e3-a0da-4202-96d9-2a917d369136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '732540bd7b1a477a92ded6f39afcd2c3', 'request_id': 'req-ebf7d7e3-a0da-4202-96d9-2a917d369136'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:03.184034 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ebf7d7e3-a0da-4202-96d9-2a917d369136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '732540bd7b1a477a92ded6f39afcd2c3', 'request_id': 'req-ebf7d7e3-a0da-4202-96d9-2a917d369136'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:03.197200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ebf7d7e3-a0da-4202-96d9-2a917d369136 admin admin] The token cache is being invalidate because project 732540bd7b1a477a92ded6f39afcd2c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:03.198858 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ebf7d7e3-a0da-4202-96d9-2a917d369136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:03.199588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ebf7d7e3-a0da-4202-96d9-2a917d369136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:03.204842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1406/2788] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:03 2022] DELETE /identity/v3/projects/732540bd7b1a477a92ded6f39afcd2c3 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:45:03.207265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5546e-34ef-428d-863b-817596a078e5 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:03.207556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5546e-34ef-428d-863b-817596a078e5 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:03.207834 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5546e-34ef-428d-863b-817596a078e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:03.229747 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9ae5546e-34ef-428d-863b-817596a078e5 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:03.230958 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9ae5546e-34ef-428d-863b-817596a078e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:03.236227 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:03.294151 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1383/2789] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:03.302445 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c0f32-a2c8-4f0e-8775-a449608847bb None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:03.302736 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c0f32-a2c8-4f0e-8775-a449608847bb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:03.303017 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35c0f32-a2c8-4f0e-8775-a449608847bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:03.324373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d35c0f32-a2c8-4f0e-8775-a449608847bb None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:03.325939 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d35c0f32-a2c8-4f0e-8775-a449608847bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:03.334824 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1407/2790] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:03.339151 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5546e-34ef-428d-863b-817596a078e5 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:03.349136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5546e-34ef-428d-863b-817596a078e5 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:03.354153 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cdea1-c521-4a98-9d8f-5076e6cbf4fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:03.354847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cdea1-c521-4a98-9d8f-5076e6cbf4fd admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:03.355194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cdea1-c521-4a98-9d8f-5076e6cbf4fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:03.355539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96cdea1-c521-4a98-9d8f-5076e6cbf4fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:03.356261 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cdea1-c521-4a98-9d8f-5076e6cbf4fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:45:03.356635 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cdea1-c521-4a98-9d8f-5076e6cbf4fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:03.358335 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96cdea1-c521-4a98-9d8f-5076e6cbf4fd admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:03.372360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1384/2791] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:45:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:45:03.376856 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c0f32-a2c8-4f0e-8775-a449608847bb None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:03.397676 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35c0f32-a2c8-4f0e-8775-a449608847bb None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:03.402852 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6339156-78cb-47e4-8801-1389aa502a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:03.404249 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6339156-78cb-47e4-8801-1389aa502a6a admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:03.404532 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6339156-78cb-47e4-8801-1389aa502a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:03.404842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6339156-78cb-47e4-8801-1389aa502a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:03.406829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6339156-78cb-47e4-8801-1389aa502a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:03.409289 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6339156-78cb-47e4-8801-1389aa502a6a admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:03.443614 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1408/2792] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:45:03 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:03.448036 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cdea1-c521-4a98-9d8f-5076e6cbf4fd admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:03.460067 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96cdea1-c521-4a98-9d8f-5076e6cbf4fd admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:03.538246 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc321a-ff0d-4e84-bda7-595aa7e30836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:03.540013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc321a-ff0d-4e84-bda7-595aa7e30836 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:03.540013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc321a-ff0d-4e84-bda7-595aa7e30836 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:03.540291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedc321a-ff0d-4e84-bda7-595aa7e30836 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:03.541267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc321a-ff0d-4e84-bda7-595aa7e30836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:03.544863 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedc321a-ff0d-4e84-bda7-595aa7e30836 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:03.589166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1385/2793] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:45:03 2022] POST /identity/v3/users => generated 293 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:03.590005 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6339156-78cb-47e4-8801-1389aa502a6a admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:03.609647 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6339156-78cb-47e4-8801-1389aa502a6a admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:03.615971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608582f-120b-49ae-810c-a0b04a2fa7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:03.616546 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608582f-120b-49ae-810c-a0b04a2fa7cd admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:03.616860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608582f-120b-49ae-810c-a0b04a2fa7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:03.617382 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f608582f-120b-49ae-810c-a0b04a2fa7cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:03.618047 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608582f-120b-49ae-810c-a0b04a2fa7cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:03.619639 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f608582f-120b-49ae-810c-a0b04a2fa7cd admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:03.621218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:03.661488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1409/2794] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:03.665715 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc321a-ff0d-4e84-bda7-595aa7e30836 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:03.695510 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedc321a-ff0d-4e84-bda7-595aa7e30836 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:03.701196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf8a8ad-6927-4f34-b2bc-fac4323e77ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:03.702126 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8a8ad-6927-4f34-b2bc-fac4323e77ed admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:03.702568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8a8ad-6927-4f34-b2bc-fac4323e77ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:03.702997 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf8a8ad-6927-4f34-b2bc-fac4323e77ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:03.703811 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8a8ad-6927-4f34-b2bc-fac4323e77ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:03.705761 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf8a8ad-6927-4f34-b2bc-fac4323e77ed admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:03.728932 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1386/2795] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:03.730105 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608582f-120b-49ae-810c-a0b04a2fa7cd admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:03.746166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f608582f-120b-49ae-810c-a0b04a2fa7cd admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:03.760703 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc8c8c-d27a-407d-85d8-d8e6b21ee9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:03.761535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc8c8c-d27a-407d-85d8-d8e6b21ee9eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:03.761899 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc8c8c-d27a-407d-85d8-d8e6b21ee9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:03.762174 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc8c8c-d27a-407d-85d8-d8e6b21ee9eb admin admin] PATH_INFO: `/v3/projects/ac625dab96b64ea982a0cb730fa4d0e6/users/853206bff1ee4edca1f4f3b5d7d70258/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:03.786901 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc8c8c-d27a-407d-85d8-d8e6b21ee9eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac625dab96b64ea982a0cb730fa4d0e6, user_id=853206bff1ee4edca1f4f3b5d7d70258, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:03.790023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc8c8c-d27a-407d-85d8-d8e6b21ee9eb admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:03.811749 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1410/2796] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:45:03 2022] PUT /identity/v3/projects/ac625dab96b64ea982a0cb730fa4d0e6/users/853206bff1ee4edca1f4f3b5d7d70258/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:03.821985 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2cf87-b6fe-4389-af69-3ccfd7d0c00d None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:03.822417 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2cf87-b6fe-4389-af69-3ccfd7d0c00d None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:03.822819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2cf87-b6fe-4389-af69-3ccfd7d0c00d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:03.855303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2bf2cf87-b6fe-4389-af69-3ccfd7d0c00d None None] MFA Rules not processed for user `853206bff1ee4edca1f4f3b5d7d70258`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:03.856738 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2bf2cf87-b6fe-4389-af69-3ccfd7d0c00d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:03.934465 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1387/2797] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:03.942571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc8c8c-d27a-407d-85d8-d8e6b21ee9eb admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:04.032580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc8c8c-d27a-407d-85d8-d8e6b21ee9eb admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:04.039499 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5c1ad-3a7a-45b4-985c-e6d8d80882a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:04.040187 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5c1ad-3a7a-45b4-985c-e6d8d80882a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:04.040612 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5c1ad-3a7a-45b4-985c-e6d8d80882a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:04.040932 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab5c1ad-3a7a-45b4-985c-e6d8d80882a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:04.041730 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5c1ad-3a7a-45b4-985c-e6d8d80882a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:04.043699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab5c1ad-3a7a-45b4-985c-e6d8d80882a2 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:04.078415 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1411/2798] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:45:03 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:04.083155 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2cf87-b6fe-4389-af69-3ccfd7d0c00d None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:04.099898 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2cf87-b6fe-4389-af69-3ccfd7d0c00d None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:04.104801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:04.173808 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c47b6-8e9d-4b9b-b470-b74f4675a5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:04.175066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c47b6-8e9d-4b9b-b470-b74f4675a5c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:04.175352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c47b6-8e9d-4b9b-b470-b74f4675a5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:04.175629 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c47b6-8e9d-4b9b-b470-b74f4675a5c6 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:04.176281 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c47b6-8e9d-4b9b-b470-b74f4675a5c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:04.178364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c47b6-8e9d-4b9b-b470-b74f4675a5c6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:04.206057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1388/2799] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:45:04 2022] POST /identity/v3/users => generated 292 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:04.211024 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5c1ad-3a7a-45b4-985c-e6d8d80882a2 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:04.224248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab5c1ad-3a7a-45b4-985c-e6d8d80882a2 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:04.230707 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ea987-270f-4b1e-bbb8-4593ad3fb929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:04.231465 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ea987-270f-4b1e-bbb8-4593ad3fb929 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:04.231962 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ea987-270f-4b1e-bbb8-4593ad3fb929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:04.232311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ea987-270f-4b1e-bbb8-4593ad3fb929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:04.233066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ea987-270f-4b1e-bbb8-4593ad3fb929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:04.234773 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ea987-270f-4b1e-bbb8-4593ad3fb929 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:04.252340 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1412/2800] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:04.256579 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c47b6-8e9d-4b9b-b470-b74f4675a5c6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:04.267203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c47b6-8e9d-4b9b-b470-b74f4675a5c6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:04.273040 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321c5ef8-41ba-497f-95fb-070044284e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:04.274030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c5ef8-41ba-497f-95fb-070044284e99 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:04.274269 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c5ef8-41ba-497f-95fb-070044284e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:04.274646 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c5ef8-41ba-497f-95fb-070044284e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:04.275911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c5ef8-41ba-497f-95fb-070044284e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:04.277621 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321c5ef8-41ba-497f-95fb-070044284e99 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:04.294385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1389/2801] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:45:04.298732 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ea987-270f-4b1e-bbb8-4593ad3fb929 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:04.316082 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ea987-270f-4b1e-bbb8-4593ad3fb929 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:04.320382 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252071a4-5c84-4313-ae93-b6c013189fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:04.321111 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252071a4-5c84-4313-ae93-b6c013189fb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:04.321392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252071a4-5c84-4313-ae93-b6c013189fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:04.321674 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252071a4-5c84-4313-ae93-b6c013189fb4 admin admin] PATH_INFO: `/v3/projects/cccb9da24db7470d86caf07c7f687a56/users/43855ddc3a1e422cbe219e186937916a/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:04.337060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252071a4-5c84-4313-ae93-b6c013189fb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cccb9da24db7470d86caf07c7f687a56, user_id=43855ddc3a1e422cbe219e186937916a, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:04.339734 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252071a4-5c84-4313-ae93-b6c013189fb4 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:04.354154 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1413/2802] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:45:04 2022] PUT /identity/v3/projects/cccb9da24db7470d86caf07c7f687a56/users/43855ddc3a1e422cbe219e186937916a/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:04.420591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1ed4c-988a-4800-a03b-de8f0c6f0850 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:04.420950 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1ed4c-988a-4800-a03b-de8f0c6f0850 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:04.421229 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c1ed4c-988a-4800-a03b-de8f0c6f0850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:04.455025 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-15c1ed4c-988a-4800-a03b-de8f0c6f0850 None None] MFA Rules not processed for user `43855ddc3a1e422cbe219e186937916a`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:04.456307 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-15c1ed4c-988a-4800-a03b-de8f0c6f0850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:04.525223 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1390/2803] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:04.529811 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252071a4-5c84-4313-ae93-b6c013189fb4 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:04.592725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252071a4-5c84-4313-ae93-b6c013189fb4 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:04.597687 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9e253-830a-4524-a913-1b08db89bc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:04.598012 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9e253-830a-4524-a913-1b08db89bc59 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:04.598290 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9e253-830a-4524-a913-1b08db89bc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:04.598563 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9e253-830a-4524-a913-1b08db89bc59 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:04.599190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9e253-830a-4524-a913-1b08db89bc59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:04.601131 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9e253-830a-4524-a913-1b08db89bc59 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:04.636166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1414/2804] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:45:04 2022] POST /identity/v3/projects => generated 385 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:45:04.637099 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1ed4c-988a-4800-a03b-de8f0c6f0850 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:04.649765 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c1ed4c-988a-4800-a03b-de8f0c6f0850 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:04.726172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86bd4d-6507-494d-93a2-cab9015d0d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:04.726903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86bd4d-6507-494d-93a2-cab9015d0d1b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:04.727172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86bd4d-6507-494d-93a2-cab9015d0d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:04.727410 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86bd4d-6507-494d-93a2-cab9015d0d1b admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:04.728303 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86bd4d-6507-494d-93a2-cab9015d0d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:04.730472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86bd4d-6507-494d-93a2-cab9015d0d1b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:04.759581 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1391/2805] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:45:04 2022] POST /identity/v3/users => generated 299 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:04.760923 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9e253-830a-4524-a913-1b08db89bc59 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:04.792786 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9e253-830a-4524-a913-1b08db89bc59 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:04.803071 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab186bf-7331-44dc-8637-460f4a458004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:04.803783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab186bf-7331-44dc-8637-460f4a458004 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:04.804064 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab186bf-7331-44dc-8637-460f4a458004 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:04.804338 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab186bf-7331-44dc-8637-460f4a458004 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:04.805039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab186bf-7331-44dc-8637-460f4a458004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:04.806648 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab186bf-7331-44dc-8637-460f4a458004 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:04.808129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:04.834585 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1415/2806] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:04.834743 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86bd4d-6507-494d-93a2-cab9015d0d1b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:04.841319 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:04.846965 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86bd4d-6507-494d-93a2-cab9015d0d1b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:04.855043 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b315cf-ba61-4239-97a4-55e63ab0a8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:04.856413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b315cf-ba61-4239-97a4-55e63ab0a8c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:04.856413 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b315cf-ba61-4239-97a4-55e63ab0a8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:04.856794 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b315cf-ba61-4239-97a4-55e63ab0a8c2 admin admin] PATH_INFO: `/v3/projects/cd9e0f61b94745ccb38762f00d7c0742/users/03e5f10bf7784ba598da08aa1cd7e82e/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:04.878926 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b315cf-ba61-4239-97a4-55e63ab0a8c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9e0f61b94745ccb38762f00d7c0742, user_id=03e5f10bf7784ba598da08aa1cd7e82e, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:04.882317 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b315cf-ba61-4239-97a4-55e63ab0a8c2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:04.915758 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab186bf-7331-44dc-8637-460f4a458004 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:04.916206 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1392/2807] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:45:04 2022] PUT /identity/v3/projects/cd9e0f61b94745ccb38762f00d7c0742/users/03e5f10bf7784ba598da08aa1cd7e82e/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:45:04.926787 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab186bf-7331-44dc-8637-460f4a458004 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:04.994261 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a2849d-2196-4168-85df-42095c5c3c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:04.994880 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2849d-2196-4168-85df-42095c5c3c5c admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:04.995219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2849d-2196-4168-85df-42095c5c3c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:04.995570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a2849d-2196-4168-85df-42095c5c3c5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:04.996309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2849d-2196-4168-85df-42095c5c3c5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:04.998067 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a2849d-2196-4168-85df-42095c5c3c5c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:05.015913 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b315cf-ba61-4239-97a4-55e63ab0a8c2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:05.022251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1416/2808] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:04 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:05.028107 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b315cf-ba61-4239-97a4-55e63ab0a8c2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:05.033969 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca0064-c7e8-45bb-ac3d-c3b5a4200795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:05.034344 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca0064-c7e8-45bb-ac3d-c3b5a4200795 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:05.034586 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca0064-c7e8-45bb-ac3d-c3b5a4200795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:05.034867 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca0064-c7e8-45bb-ac3d-c3b5a4200795 admin admin] PATH_INFO: `/v3/projects/cd9e0f61b94745ccb38762f00d7c0742/users/03e5f10bf7784ba598da08aa1cd7e82e/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:05.037134 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca0064-c7e8-45bb-ac3d-c3b5a4200795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9e0f61b94745ccb38762f00d7c0742, user_id=03e5f10bf7784ba598da08aa1cd7e82e, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:05.039767 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca0064-c7e8-45bb-ac3d-c3b5a4200795 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:05.056993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1393/2809] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:45:05 2022] PUT /identity/v3/projects/cd9e0f61b94745ccb38762f00d7c0742/users/03e5f10bf7784ba598da08aa1cd7e82e/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:05.065362 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66c9a5-bfce-44ee-a479-9ad258c43e6c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:05.065692 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66c9a5-bfce-44ee-a479-9ad258c43e6c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:05.065948 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c66c9a5-bfce-44ee-a479-9ad258c43e6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:05.151286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8c66c9a5-bfce-44ee-a479-9ad258c43e6c None None] MFA Rules not processed for user `03e5f10bf7784ba598da08aa1cd7e82e`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:05.154694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8c66c9a5-bfce-44ee-a479-9ad258c43e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:05.270850 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1417/2810] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:05.339889 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca0064-c7e8-45bb-ac3d-c3b5a4200795 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:05.341987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c0ca0064-c7e8-45bb-ac3d-c3b5a4200795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:05.450404 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca0064-c7e8-45bb-ac3d-c3b5a4200795 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:05.465063 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef160c0-a4de-43b6-a7fa-451b60f4b169 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:05.465774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef160c0-a4de-43b6-a7fa-451b60f4b169 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:05.466056 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef160c0-a4de-43b6-a7fa-451b60f4b169 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:05.466329 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef160c0-a4de-43b6-a7fa-451b60f4b169 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:05.577625 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef160c0-a4de-43b6-a7fa-451b60f4b169 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:05.579232 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef160c0-a4de-43b6-a7fa-451b60f4b169 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:05.589551 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1394/2811] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:05.633382 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66c9a5-bfce-44ee-a479-9ad258c43e6c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:05.634839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8c66c9a5-bfce-44ee-a479-9ad258c43e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:05.747723 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c66c9a5-bfce-44ee-a479-9ad258c43e6c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:05.754614 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735fa6c-6458-4d36-8e8d-2ab914dae70a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:05.757037 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735fa6c-6458-4d36-8e8d-2ab914dae70a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:05.758200 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735fa6c-6458-4d36-8e8d-2ab914dae70a admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:05.758689 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e735fa6c-6458-4d36-8e8d-2ab914dae70a admin admin] PATH_INFO: `/v3/users/2786a5ef016e45fb940e568a0305cd24` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:05.760727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735fa6c-6458-4d36-8e8d-2ab914dae70a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2786a5ef016e45fb940e568a0305cd24)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:05.763277 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e735fa6c-6458-4d36-8e8d-2ab914dae70a admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:05.808058 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:05.859984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e735fa6c-6458-4d36-8e8d-2ab914dae70a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2786a5ef016e45fb940e568a0305cd24'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:05.874865 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e735fa6c-6458-4d36-8e8d-2ab914dae70a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2786a5ef016e45fb940e568a0305cd24'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:05.903238 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e735fa6c-6458-4d36-8e8d-2ab914dae70a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2786a5ef016e45fb940e568a0305cd24'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:05.903670 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e735fa6c-6458-4d36-8e8d-2ab914dae70a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2786a5ef016e45fb940e568a0305cd24'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:05.929317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-e735fa6c-6458-4d36-8e8d-2ab914dae70a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2786a5ef016e45fb940e568a0305cd24'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:05.929317 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1418/2812] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:05 2022] DELETE /identity/v3/users/2786a5ef016e45fb940e568a0305cd24 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:06.215397 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef160c0-a4de-43b6-a7fa-451b60f4b169 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:06.229162 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef160c0-a4de-43b6-a7fa-451b60f4b169 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:06.287686 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950558b-e15f-400f-b47f-68856977d44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:06.288316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950558b-e15f-400f-b47f-68856977d44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:06.288597 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950558b-e15f-400f-b47f-68856977d44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:06.288903 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950558b-e15f-400f-b47f-68856977d44c admin admin] PATH_INFO: `/v3/projects/3cc6990b08964020b981f20a452e220b` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:06.290020 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950558b-e15f-400f-b47f-68856977d44c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cc6990b08964020b981f20a452e220b)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:06.291900 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950558b-e15f-400f-b47f-68856977d44c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:06.316546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:06.339689 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3950558b-e15f-400f-b47f-68856977d44c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cc6990b08964020b981f20a452e220b', 'request_id': 'req-3950558b-e15f-400f-b47f-68856977d44c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:06.345062 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3950558b-e15f-400f-b47f-68856977d44c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cc6990b08964020b981f20a452e220b', 'request_id': 'req-3950558b-e15f-400f-b47f-68856977d44c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:06.351188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3950558b-e15f-400f-b47f-68856977d44c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cc6990b08964020b981f20a452e220b', 'request_id': 'req-3950558b-e15f-400f-b47f-68856977d44c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:06.364487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3950558b-e15f-400f-b47f-68856977d44c admin admin] The token cache is being invalidate because project 3cc6990b08964020b981f20a452e220b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:06.364726 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3950558b-e15f-400f-b47f-68856977d44c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:06.365360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3950558b-e15f-400f-b47f-68856977d44c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:06.367558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1395/2813] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:06 2022] DELETE /identity/v3/projects/3cc6990b08964020b981f20a452e220b => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:45:06.371810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735fa6c-6458-4d36-8e8d-2ab914dae70a admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:06.373333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e735fa6c-6458-4d36-8e8d-2ab914dae70a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:06.387281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e735fa6c-6458-4d36-8e8d-2ab914dae70a admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:06.443503 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2645b-ce86-49ac-afbe-8d52126d41c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:06.444344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2645b-ce86-49ac-afbe-8d52126d41c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:06.444740 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2645b-ce86-49ac-afbe-8d52126d41c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:06.445127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d2645b-ce86-49ac-afbe-8d52126d41c0 admin admin] PATH_INFO: `/v3/users/8bc5c58a1b7a4f18affba43b2d65eaf5` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:06.446401 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2645b-ce86-49ac-afbe-8d52126d41c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bc5c58a1b7a4f18affba43b2d65eaf5)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:06.448420 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d2645b-ce86-49ac-afbe-8d52126d41c0 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:06.493949 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-44d2645b-ce86-49ac-afbe-8d52126d41c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bc5c58a1b7a4f18affba43b2d65eaf5'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:06.500947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-44d2645b-ce86-49ac-afbe-8d52126d41c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bc5c58a1b7a4f18affba43b2d65eaf5'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:06.512912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-44d2645b-ce86-49ac-afbe-8d52126d41c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bc5c58a1b7a4f18affba43b2d65eaf5'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:06.513687 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-44d2645b-ce86-49ac-afbe-8d52126d41c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bc5c58a1b7a4f18affba43b2d65eaf5'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:06.520608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-44d2645b-ce86-49ac-afbe-8d52126d41c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bc5c58a1b7a4f18affba43b2d65eaf5'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:06.526526 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1419/2814] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:06 2022] DELETE /identity/v3/users/8bc5c58a1b7a4f18affba43b2d65eaf5 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:06.700699 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950558b-e15f-400f-b47f-68856977d44c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:06.702419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3950558b-e15f-400f-b47f-68856977d44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:06.718640 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950558b-e15f-400f-b47f-68856977d44c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:06.777057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:06.777690 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:06.777973 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:06.778253 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2 admin admin] PATH_INFO: `/v3/projects/f555288934ce42868dfe74e33975b16d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:06.779372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f555288934ce42868dfe74e33975b16d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:06.781313 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:06.826758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f555288934ce42868dfe74e33975b16d', 'request_id': 'req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:06.832341 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f555288934ce42868dfe74e33975b16d', 'request_id': 'req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:06.838446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f555288934ce42868dfe74e33975b16d', 'request_id': 'req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:06.850046 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2 admin admin] The token cache is being invalidate because project f555288934ce42868dfe74e33975b16d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:06.850337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:06.850978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:06.852419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1396/2815] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:06 2022] DELETE /identity/v3/projects/f555288934ce42868dfe74e33975b16d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:07.246823 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2645b-ce86-49ac-afbe-8d52126d41c0 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:07.248560 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-44d2645b-ce86-49ac-afbe-8d52126d41c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:07.268402 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:07.311651 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d2645b-ce86-49ac-afbe-8d52126d41c0 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:07.362944 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81de91d-cd03-4583-a16f-ca7caeeb2263 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:07.363301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81de91d-cd03-4583-a16f-ca7caeeb2263 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:07.364380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81de91d-cd03-4583-a16f-ca7caeeb2263 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:07.364689 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81de91d-cd03-4583-a16f-ca7caeeb2263 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:07.366611 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a81de91d-cd03-4583-a16f-ca7caeeb2263 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:07.428554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81de91d-cd03-4583-a16f-ca7caeeb2263 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:07.430114 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81de91d-cd03-4583-a16f-ca7caeeb2263 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:07.440043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1420/2816] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:08.006351 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:08.007844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:08.020730 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2eaaa8-81b2-4936-b541-c6bfb1b336d2 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:08.024256 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8c9b83-8dbf-4502-9b57-76448d864667 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:08.024886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c9b83-8dbf-4502-9b57-76448d864667 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:08.025166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c9b83-8dbf-4502-9b57-76448d864667 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:08.025440 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8c9b83-8dbf-4502-9b57-76448d864667 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:08.027150 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-bf8c9b83-8dbf-4502-9b57-76448d864667 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:08.069365 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:08.079104 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81de91d-cd03-4583-a16f-ca7caeeb2263 service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:08.081117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a81de91d-cd03-4583-a16f-ca7caeeb2263 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:08.094040 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c9b83-8dbf-4502-9b57-76448d864667 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:08.095486 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8c9b83-8dbf-4502-9b57-76448d864667 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:08.105101 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1397/2817] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:08 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:08.149984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81de91d-cd03-4583-a16f-ca7caeeb2263 service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:08.154579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121e14d-133e-4a07-acd6-2a97661f267a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:08.155199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121e14d-133e-4a07-acd6-2a97661f267a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:08.155725 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121e14d-133e-4a07-acd6-2a97661f267a admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:08.155825 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f121e14d-133e-4a07-acd6-2a97661f267a admin admin] PATH_INFO: `/v3/users/7e3f8d97e8604120bdc283288689a178` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:08.156967 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121e14d-133e-4a07-acd6-2a97661f267a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e3f8d97e8604120bdc283288689a178)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:08.161270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f121e14d-133e-4a07-acd6-2a97661f267a admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:08.194166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:08.214454 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-f121e14d-133e-4a07-acd6-2a97661f267a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e3f8d97e8604120bdc283288689a178'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:08.222333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-f121e14d-133e-4a07-acd6-2a97661f267a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e3f8d97e8604120bdc283288689a178'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:08.234822 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-f121e14d-133e-4a07-acd6-2a97661f267a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e3f8d97e8604120bdc283288689a178'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:08.235555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-f121e14d-133e-4a07-acd6-2a97661f267a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e3f8d97e8604120bdc283288689a178'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:08.243462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-f121e14d-133e-4a07-acd6-2a97661f267a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e3f8d97e8604120bdc283288689a178'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:08.249304 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1421/2818] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:08 2022] DELETE /identity/v3/users/7e3f8d97e8604120bdc283288689a178 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:45:08.253819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7816850-41e4-4bfd-a2c0-ac216cc8b664 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:08.254217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7816850-41e4-4bfd-a2c0-ac216cc8b664 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:08.254566 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7816850-41e4-4bfd-a2c0-ac216cc8b664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:08.276943 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-d7816850-41e4-4bfd-a2c0-ac216cc8b664 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:08.278140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d7816850-41e4-4bfd-a2c0-ac216cc8b664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:08.343093 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1398/2819] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:08.355911 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121e14d-133e-4a07-acd6-2a97661f267a admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:08.357802 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f121e14d-133e-4a07-acd6-2a97661f267a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:08.435694 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f121e14d-133e-4a07-acd6-2a97661f267a admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:08.442327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e781e17-4d9e-43f9-83fa-dc4a5e78949e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:08.443418 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e781e17-4d9e-43f9-83fa-dc4a5e78949e service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:08.444111 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e781e17-4d9e-43f9-83fa-dc4a5e78949e service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:08.444689 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e781e17-4d9e-43f9-83fa-dc4a5e78949e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:08.455468 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e781e17-4d9e-43f9-83fa-dc4a5e78949e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:08.456936 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e781e17-4d9e-43f9-83fa-dc4a5e78949e service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:08.466795 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1422/2820] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:08.737593 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7816850-41e4-4bfd-a2c0-ac216cc8b664 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:08.739037 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-d7816850-41e4-4bfd-a2c0-ac216cc8b664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:08.754605 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7816850-41e4-4bfd-a2c0-ac216cc8b664 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:08.759321 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfbd5a2-daae-4816-92e1-022b2653537d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:08.759949 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbd5a2-daae-4816-92e1-022b2653537d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:08.760230 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbd5a2-daae-4816-92e1-022b2653537d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:08.760522 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfbd5a2-daae-4816-92e1-022b2653537d admin admin] PATH_INFO: `/v3/projects/ed85e98c0c8a4f19ab56338afd67036a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:08.761654 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbd5a2-daae-4816-92e1-022b2653537d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed85e98c0c8a4f19ab56338afd67036a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:08.763531 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfbd5a2-daae-4816-92e1-022b2653537d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:08.809757 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6cfbd5a2-daae-4816-92e1-022b2653537d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed85e98c0c8a4f19ab56338afd67036a', 'request_id': 'req-6cfbd5a2-daae-4816-92e1-022b2653537d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:08.815203 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6cfbd5a2-daae-4816-92e1-022b2653537d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed85e98c0c8a4f19ab56338afd67036a', 'request_id': 'req-6cfbd5a2-daae-4816-92e1-022b2653537d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:08.821710 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6cfbd5a2-daae-4816-92e1-022b2653537d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed85e98c0c8a4f19ab56338afd67036a', 'request_id': 'req-6cfbd5a2-daae-4816-92e1-022b2653537d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:08.833617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6cfbd5a2-daae-4816-92e1-022b2653537d admin admin] The token cache is being invalidate because project ed85e98c0c8a4f19ab56338afd67036a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:08.833924 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6cfbd5a2-daae-4816-92e1-022b2653537d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:08.834536 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-6cfbd5a2-daae-4816-92e1-022b2653537d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:08.835978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1399/2821] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:08 2022] DELETE /identity/v3/projects/ed85e98c0c8a4f19ab56338afd67036a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:08.840835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926cc40-dab2-4c22-8040-3e4ed493c801 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:08.841117 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926cc40-dab2-4c22-8040-3e4ed493c801 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:08.841390 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e926cc40-dab2-4c22-8040-3e4ed493c801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:08.860970 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e926cc40-dab2-4c22-8040-3e4ed493c801 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:08.862829 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e926cc40-dab2-4c22-8040-3e4ed493c801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:08.919899 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1423/2822] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:08.928727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bddf6-3703-44dc-8eb7-00a4506bd1a0 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:08.929017 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bddf6-3703-44dc-8eb7-00a4506bd1a0 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:08.929294 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085bddf6-3703-44dc-8eb7-00a4506bd1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:08.948942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-085bddf6-3703-44dc-8eb7-00a4506bd1a0 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:08.950172 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-085bddf6-3703-44dc-8eb7-00a4506bd1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:08.957916 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1400/2823] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:08.961924 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926cc40-dab2-4c22-8040-3e4ed493c801 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:08.972054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e926cc40-dab2-4c22-8040-3e4ed493c801 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:08.976602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838c1f5-4ad9-4beb-a263-dbc14aa2e025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:08.977289 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c1f5-4ad9-4beb-a263-dbc14aa2e025 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:08.977568 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c1f5-4ad9-4beb-a263-dbc14aa2e025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:08.977841 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c1f5-4ad9-4beb-a263-dbc14aa2e025 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:08.978482 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838c1f5-4ad9-4beb-a263-dbc14aa2e025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:45:08.978785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838c1f5-4ad9-4beb-a263-dbc14aa2e025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:08.980424 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838c1f5-4ad9-4beb-a263-dbc14aa2e025 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:08.992562 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1424/2824] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:45:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:45:08.996635 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bddf6-3703-44dc-8eb7-00a4506bd1a0 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:09.005744 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085bddf6-3703-44dc-8eb7-00a4506bd1a0 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:09.010358 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0df80-fe97-4c49-abee-203895d5c682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:09.010972 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0df80-fe97-4c49-abee-203895d5c682 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:09.011194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0df80-fe97-4c49-abee-203895d5c682 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:09.011461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0df80-fe97-4c49-abee-203895d5c682 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:09.012084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0df80-fe97-4c49-abee-203895d5c682 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:09.013969 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0df80-fe97-4c49-abee-203895d5c682 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:09.041833 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1401/2825] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:45:08 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:45:09.046023 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838c1f5-4ad9-4beb-a263-dbc14aa2e025 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:09.058282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838c1f5-4ad9-4beb-a263-dbc14aa2e025 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:09.095273 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:09.121151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dde5fd-442f-4b8f-ad2f-87bdec25fb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:09.121743 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dde5fd-442f-4b8f-ad2f-87bdec25fb2e admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:09.122020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dde5fd-442f-4b8f-ad2f-87bdec25fb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:09.122290 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dde5fd-442f-4b8f-ad2f-87bdec25fb2e admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:09.122906 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dde5fd-442f-4b8f-ad2f-87bdec25fb2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:09.124819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dde5fd-442f-4b8f-ad2f-87bdec25fb2e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:09.145855 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1425/2826] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:45:09 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:09.149977 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0df80-fe97-4c49-abee-203895d5c682 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:09.160285 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0df80-fe97-4c49-abee-203895d5c682 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:09.164968 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9c21c-3076-47ce-a6ea-427ab8da5ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:09.165556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9c21c-3076-47ce-a6ea-427ab8da5ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:09.165837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9c21c-3076-47ce-a6ea-427ab8da5ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:09.166111 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9c21c-3076-47ce-a6ea-427ab8da5ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:09.166749 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9c21c-3076-47ce-a6ea-427ab8da5ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:09.168320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9c21c-3076-47ce-a6ea-427ab8da5ab8 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:09.178529 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1402/2827] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:09.182268 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dde5fd-442f-4b8f-ad2f-87bdec25fb2e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:09.192696 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dde5fd-442f-4b8f-ad2f-87bdec25fb2e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:09.197311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305da3d-3efa-4f2b-bf89-d98f402d9b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:09.197889 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305da3d-3efa-4f2b-bf89-d98f402d9b50 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:09.198166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305da3d-3efa-4f2b-bf89-d98f402d9b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:09.198434 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305da3d-3efa-4f2b-bf89-d98f402d9b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:09.199068 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305da3d-3efa-4f2b-bf89-d98f402d9b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:09.200636 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305da3d-3efa-4f2b-bf89-d98f402d9b50 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:09.211074 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1426/2828] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:09.215012 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9c21c-3076-47ce-a6ea-427ab8da5ab8 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:09.225389 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9c21c-3076-47ce-a6ea-427ab8da5ab8 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:09.229978 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708eb00-5162-4328-85e4-8dd346020888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:09.230668 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708eb00-5162-4328-85e4-8dd346020888 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:09.230897 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708eb00-5162-4328-85e4-8dd346020888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:09.231196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0708eb00-5162-4328-85e4-8dd346020888 admin admin] PATH_INFO: `/v3/projects/1e20927880e64a32aac2c8e44862cbd3/users/8b5760ecd4924ed8b100a3e422cecb6e/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:09.247807 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708eb00-5162-4328-85e4-8dd346020888 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e20927880e64a32aac2c8e44862cbd3, user_id=8b5760ecd4924ed8b100a3e422cecb6e, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:09.250503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0708eb00-5162-4328-85e4-8dd346020888 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:09.254364 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:09.268755 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1403/2829] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:45:09 2022] PUT /identity/v3/projects/1e20927880e64a32aac2c8e44862cbd3/users/8b5760ecd4924ed8b100a3e422cecb6e/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:09.335183 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67689459-4a5d-4eae-abc0-ef81596fb32b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:09.335471 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67689459-4a5d-4eae-abc0-ef81596fb32b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:09.335750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67689459-4a5d-4eae-abc0-ef81596fb32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:09.367680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-67689459-4a5d-4eae-abc0-ef81596fb32b None None] MFA Rules not processed for user `8b5760ecd4924ed8b100a3e422cecb6e`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:09.367680 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-67689459-4a5d-4eae-abc0-ef81596fb32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:09.446724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1427/2830] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:09.448089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708eb00-5162-4328-85e4-8dd346020888 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:09.538929 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0708eb00-5162-4328-85e4-8dd346020888 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:09.546066 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de8f2e-a9bb-4b74-a126-632e8ef3e989 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:09.546565 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de8f2e-a9bb-4b74-a126-632e8ef3e989 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:09.547022 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3de8f2e-a9bb-4b74-a126-632e8ef3e989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:09.549449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9ab9b-2bf5-4616-b0db-09ac8cc2f1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:09.550198 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9ab9b-2bf5-4616-b0db-09ac8cc2f1b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:09.550552 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9ab9b-2bf5-4616-b0db-09ac8cc2f1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:09.550901 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9ab9b-2bf5-4616-b0db-09ac8cc2f1b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:09.551619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9ab9b-2bf5-4616-b0db-09ac8cc2f1b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:09.553674 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9ab9b-2bf5-4616-b0db-09ac8cc2f1b6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:09.569899 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a3de8f2e-a9bb-4b74-a126-632e8ef3e989 None None] MFA Rules not processed for user `023904c12714482685c72be7e8b68fda`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:09.571419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a3de8f2e-a9bb-4b74-a126-632e8ef3e989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:09.584438 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1404/2831] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:45:09 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:45:09.588378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9ab9b-2bf5-4616-b0db-09ac8cc2f1b6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:09.638096 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1428/2832] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:09 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:45:09.664591 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9ab9b-2bf5-4616-b0db-09ac8cc2f1b6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:09.669808 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f55876-03e5-472c-aea4-c1e8c8d7d3a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:09.670408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f55876-03e5-472c-aea4-c1e8c8d7d3a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:09.671219 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f55876-03e5-472c-aea4-c1e8c8d7d3a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:09.671219 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f55876-03e5-472c-aea4-c1e8c8d7d3a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:09.671587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f55876-03e5-472c-aea4-c1e8c8d7d3a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:09.673507 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f55876-03e5-472c-aea4-c1e8c8d7d3a0 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:09.699193 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1405/2833] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:45:09 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:45:09.701326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de8f2e-a9bb-4b74-a126-632e8ef3e989 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:09.712949 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3de8f2e-a9bb-4b74-a126-632e8ef3e989 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:09.717529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676be06-4779-43d2-9769-bb681b40c27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:09.718188 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676be06-4779-43d2-9769-bb681b40c27a admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:09.718491 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676be06-4779-43d2-9769-bb681b40c27a admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:09.718775 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9676be06-4779-43d2-9769-bb681b40c27a admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:09.719421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676be06-4779-43d2-9769-bb681b40c27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:09.721586 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9676be06-4779-43d2-9769-bb681b40c27a admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:09.732733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1429/2834] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:09.737545 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f55876-03e5-472c-aea4-c1e8c8d7d3a0 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:09.748047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f55876-03e5-472c-aea4-c1e8c8d7d3a0 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:09.752869 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4cbf43-cad2-42f7-8791-423fac814fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:09.753457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cbf43-cad2-42f7-8791-423fac814fbb admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:09.753736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cbf43-cad2-42f7-8791-423fac814fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:09.754004 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4cbf43-cad2-42f7-8791-423fac814fbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:09.754678 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cbf43-cad2-42f7-8791-423fac814fbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:09.756232 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4cbf43-cad2-42f7-8791-423fac814fbb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:09.768118 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1406/2835] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:09.772135 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676be06-4779-43d2-9769-bb681b40c27a admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:09.785525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9676be06-4779-43d2-9769-bb681b40c27a admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:09.790346 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704dd98-d76d-46b4-88c1-be360304bf96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:09.790991 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704dd98-d76d-46b4-88c1-be360304bf96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:09.791267 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704dd98-d76d-46b4-88c1-be360304bf96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:09.791538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704dd98-d76d-46b4-88c1-be360304bf96 admin admin] PATH_INFO: `/v3/projects/b0a515d6935c4c2db54856872beb2ef4/users/23b8062d286d407486338a5aa615b8bb/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:09.806414 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704dd98-d76d-46b4-88c1-be360304bf96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0a515d6935c4c2db54856872beb2ef4, user_id=23b8062d286d407486338a5aa615b8bb, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:09.809091 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704dd98-d76d-46b4-88c1-be360304bf96 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:09.823073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1430/2836] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:45:09 2022] PUT /identity/v3/projects/b0a515d6935c4c2db54856872beb2ef4/users/23b8062d286d407486338a5aa615b8bb/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:09.833906 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645ef10-0785-487c-8c5d-5d4cacd8792a None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:09.834195 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645ef10-0785-487c-8c5d-5d4cacd8792a None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:09.834473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645ef10-0785-487c-8c5d-5d4cacd8792a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:09.863769 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-a645ef10-0785-487c-8c5d-5d4cacd8792a None None] MFA Rules not processed for user `23b8062d286d407486338a5aa615b8bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:09.865074 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-a645ef10-0785-487c-8c5d-5d4cacd8792a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:09.914481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:09.936170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1407/2837] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:09.940912 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704dd98-d76d-46b4-88c1-be360304bf96 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:09.955947 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:10.011994 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704dd98-d76d-46b4-88c1-be360304bf96 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:10.016678 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82695617-e0df-4a36-9fcc-c4f791064e43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:10.017313 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82695617-e0df-4a36-9fcc-c4f791064e43 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:10.018107 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82695617-e0df-4a36-9fcc-c4f791064e43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:10.018385 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82695617-e0df-4a36-9fcc-c4f791064e43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:10.019102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82695617-e0df-4a36-9fcc-c4f791064e43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:10.021054 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82695617-e0df-4a36-9fcc-c4f791064e43 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:10.048074 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1431/2838] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:45:09 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:10.052352 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645ef10-0785-487c-8c5d-5d4cacd8792a None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:10.063013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a645ef10-0785-487c-8c5d-5d4cacd8792a None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:10.121262 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8facf-17f4-491d-817e-df078f2693c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:10.121868 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8facf-17f4-491d-817e-df078f2693c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:10.122217 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8facf-17f4-491d-817e-df078f2693c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:10.122408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8facf-17f4-491d-817e-df078f2693c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:10.123069 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8facf-17f4-491d-817e-df078f2693c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:10.124991 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8facf-17f4-491d-817e-df078f2693c3 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:10.147524 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1408/2839] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:45:10 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:45:10.151771 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82695617-e0df-4a36-9fcc-c4f791064e43 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:10.164861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82695617-e0df-4a36-9fcc-c4f791064e43 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:10.170344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e262d01-1df5-412d-969a-5795a48104a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:10.170951 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e262d01-1df5-412d-969a-5795a48104a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:10.171237 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e262d01-1df5-412d-969a-5795a48104a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:10.171514 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e262d01-1df5-412d-969a-5795a48104a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:10.172165 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e262d01-1df5-412d-969a-5795a48104a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:10.173835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e262d01-1df5-412d-969a-5795a48104a4 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:10.185890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1432/2840] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:10.191919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8facf-17f4-491d-817e-df078f2693c3 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:10.203813 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8facf-17f4-491d-817e-df078f2693c3 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:10.208902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04037e3d-758c-4c46-8757-1e312d5b9c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:10.209737 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04037e3d-758c-4c46-8757-1e312d5b9c55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:10.210021 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04037e3d-758c-4c46-8757-1e312d5b9c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:10.210291 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04037e3d-758c-4c46-8757-1e312d5b9c55 admin admin] PATH_INFO: `/v3/projects/8c6c0cf135054597ac7ba92d8f38a5b2/users/626e7c7f6d3947c780e429c0865d8a90/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:10.227840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04037e3d-758c-4c46-8757-1e312d5b9c55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c6c0cf135054597ac7ba92d8f38a5b2, user_id=626e7c7f6d3947c780e429c0865d8a90, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:10.230590 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04037e3d-758c-4c46-8757-1e312d5b9c55 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:10.247013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1409/2841] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:45:10 2022] PUT /identity/v3/projects/8c6c0cf135054597ac7ba92d8f38a5b2/users/626e7c7f6d3947c780e429c0865d8a90/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:10.251037 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e262d01-1df5-412d-969a-5795a48104a4 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:10.261979 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e262d01-1df5-412d-969a-5795a48104a4 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:10.325298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a34f98-5e34-4bcf-b300-514c6cfb25e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:10.325915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a34f98-5e34-4bcf-b300-514c6cfb25e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:10.326199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a34f98-5e34-4bcf-b300-514c6cfb25e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:10.326472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a34f98-5e34-4bcf-b300-514c6cfb25e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:10.327125 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a34f98-5e34-4bcf-b300-514c6cfb25e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:10.328738 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a34f98-5e34-4bcf-b300-514c6cfb25e9 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:10.339029 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1433/2842] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:10.343453 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04037e3d-758c-4c46-8757-1e312d5b9c55 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:10.354224 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04037e3d-758c-4c46-8757-1e312d5b9c55 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:10.359393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225d586-d1a2-4576-8b84-e3be2f0eab38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:10.360031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225d586-d1a2-4576-8b84-e3be2f0eab38 admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:10.360305 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225d586-d1a2-4576-8b84-e3be2f0eab38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:10.360644 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c225d586-d1a2-4576-8b84-e3be2f0eab38 admin admin] PATH_INFO: `/v3/projects/8c6c0cf135054597ac7ba92d8f38a5b2/users/626e7c7f6d3947c780e429c0865d8a90/roles/6382a06103714d068409d25cbeb48744` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:10.363140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225d586-d1a2-4576-8b84-e3be2f0eab38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c6c0cf135054597ac7ba92d8f38a5b2, user_id=626e7c7f6d3947c780e429c0865d8a90, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:10.365799 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c225d586-d1a2-4576-8b84-e3be2f0eab38 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:10.376958 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1410/2843] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:45:10 2022] PUT /identity/v3/projects/8c6c0cf135054597ac7ba92d8f38a5b2/users/626e7c7f6d3947c780e429c0865d8a90/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:10.387296 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ee48b-c730-40ac-bda2-65f3b2c105d8 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:10.387582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ee48b-c730-40ac-bda2-65f3b2c105d8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:10.387877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43ee48b-c730-40ac-bda2-65f3b2c105d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:10.417178 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a43ee48b-c730-40ac-bda2-65f3b2c105d8 None None] MFA Rules not processed for user `626e7c7f6d3947c780e429c0865d8a90`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:10.418535 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a43ee48b-c730-40ac-bda2-65f3b2c105d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:10.499949 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1434/2844] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:10 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:10.508569 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225d586-d1a2-4576-8b84-e3be2f0eab38 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:10.510461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c225d586-d1a2-4576-8b84-e3be2f0eab38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:10.575998 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c225d586-d1a2-4576-8b84-e3be2f0eab38 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:10.581934 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54664b82-1d33-4334-b299-5190f65c2df7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:10.582635 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54664b82-1d33-4334-b299-5190f65c2df7 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:10.583030 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54664b82-1d33-4334-b299-5190f65c2df7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:10.583225 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54664b82-1d33-4334-b299-5190f65c2df7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:10.653008 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:10.656073 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54664b82-1d33-4334-b299-5190f65c2df7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:10.657771 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54664b82-1d33-4334-b299-5190f65c2df7 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:10.670392 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1411/2845] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:10 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:12.115423 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ee48b-c730-40ac-bda2-65f3b2c105d8 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:12.116525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a43ee48b-c730-40ac-bda2-65f3b2c105d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:12.128124 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:12.207411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43ee48b-c730-40ac-bda2-65f3b2c105d8 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:12.212565 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174457f7-45da-45df-bd49-0409c8c3dad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:12.213242 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174457f7-45da-45df-bd49-0409c8c3dad5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:12.213519 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174457f7-45da-45df-bd49-0409c8c3dad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:12.213985 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174457f7-45da-45df-bd49-0409c8c3dad5 admin admin] PATH_INFO: `/v3/users/853206bff1ee4edca1f4f3b5d7d70258` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:12.215291 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174457f7-45da-45df-bd49-0409c8c3dad5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=853206bff1ee4edca1f4f3b5d7d70258)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:12.217403 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174457f7-45da-45df-bd49-0409c8c3dad5 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:12.255598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54664b82-1d33-4334-b299-5190f65c2df7 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:12.258133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-54664b82-1d33-4334-b299-5190f65c2df7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:12.273443 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54664b82-1d33-4334-b299-5190f65c2df7 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:12.277470 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78cde9-2f2b-48eb-aceb-6751ea220019 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:12.278118 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-174457f7-45da-45df-bd49-0409c8c3dad5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '853206bff1ee4edca1f4f3b5d7d70258'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:12.278265 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78cde9-2f2b-48eb-aceb-6751ea220019 service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:12.278518 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78cde9-2f2b-48eb-aceb-6751ea220019 service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:12.278858 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a78cde9-2f2b-48eb-aceb-6751ea220019 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:12.286971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-174457f7-45da-45df-bd49-0409c8c3dad5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '853206bff1ee4edca1f4f3b5d7d70258'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:12.300727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-174457f7-45da-45df-bd49-0409c8c3dad5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '853206bff1ee4edca1f4f3b5d7d70258'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:12.301441 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-174457f7-45da-45df-bd49-0409c8c3dad5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '853206bff1ee4edca1f4f3b5d7d70258'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:12.309868 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-174457f7-45da-45df-bd49-0409c8c3dad5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '853206bff1ee4edca1f4f3b5d7d70258'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:12.316366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1435/2846] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:12 2022] DELETE /identity/v3/users/853206bff1ee4edca1f4f3b5d7d70258 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:12.320522 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c11a17-3a1d-4889-a1ee-25ddd6706ca8 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:12.320844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c11a17-3a1d-4889-a1ee-25ddd6706ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:12.321160 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c11a17-3a1d-4889-a1ee-25ddd6706ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:12.344615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78cde9-2f2b-48eb-aceb-6751ea220019 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:12.346840 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a78cde9-2f2b-48eb-aceb-6751ea220019 service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:12.346999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f6c11a17-3a1d-4889-a1ee-25ddd6706ca8 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:12.348201 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f6c11a17-3a1d-4889-a1ee-25ddd6706ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:12.356584 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1412/2847] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:12.425935 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1436/2848] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:12.436526 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78cde9-2f2b-48eb-aceb-6751ea220019 service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:12.437962 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2a78cde9-2f2b-48eb-aceb-6751ea220019 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:12.520987 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a78cde9-2f2b-48eb-aceb-6751ea220019 service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:12.581050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8381d-405c-4f01-a289-439952b10a06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:12.581894 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8381d-405c-4f01-a289-439952b10a06 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:12.582174 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8381d-405c-4f01-a289-439952b10a06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:12.582467 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8381d-405c-4f01-a289-439952b10a06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:12.592947 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8381d-405c-4f01-a289-439952b10a06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:12.594532 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8381d-405c-4f01-a289-439952b10a06 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:12.606040 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1413/2849] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:13.024978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c11a17-3a1d-4889-a1ee-25ddd6706ca8 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:13.026399 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f6c11a17-3a1d-4889-a1ee-25ddd6706ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:13.061108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:13.105175 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c11a17-3a1d-4889-a1ee-25ddd6706ca8 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:13.109333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb2bf3-6335-4b75-b175-9f3f370713ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:13.110051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb2bf3-6335-4b75-b175-9f3f370713ce service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:13.111296 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb2bf3-6335-4b75-b175-9f3f370713ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:13.111697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cb2bf3-6335-4b75-b175-9f3f370713ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:13.114435 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a3cb2bf3-6335-4b75-b175-9f3f370713ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:13.181590 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb2bf3-6335-4b75-b175-9f3f370713ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:13.183022 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cb2bf3-6335-4b75-b175-9f3f370713ce service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:13.193573 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1437/2850] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:13 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:13.347013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8381d-405c-4f01-a289-439952b10a06 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:13.348557 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-67a8381d-405c-4f01-a289-439952b10a06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:13.361884 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8381d-405c-4f01-a289-439952b10a06 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:13.367343 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:13.368083 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:13.368380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:13.368810 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9 admin admin] PATH_INFO: `/v3/projects/ac625dab96b64ea982a0cb730fa4d0e6` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:13.370113 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac625dab96b64ea982a0cb730fa4d0e6)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:13.372533 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:13.425105 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:13.427089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac625dab96b64ea982a0cb730fa4d0e6', 'request_id': 'req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:13.435066 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac625dab96b64ea982a0cb730fa4d0e6', 'request_id': 'req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:13.442590 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac625dab96b64ea982a0cb730fa4d0e6', 'request_id': 'req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:13.456842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9 admin admin] The token cache is being invalidate because project ac625dab96b64ea982a0cb730fa4d0e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:13.457106 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:13.458115 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:13.460245 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1414/2851] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:13 2022] DELETE /identity/v3/projects/ac625dab96b64ea982a0cb730fa4d0e6 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:13.464540 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb2bf3-6335-4b75-b175-9f3f370713ce service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:13.477428 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cb2bf3-6335-4b75-b175-9f3f370713ce service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:13.540251 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a613c09-b419-4a00-a27a-247bf7375d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:13.540915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a613c09-b419-4a00-a27a-247bf7375d45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:13.541195 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a613c09-b419-4a00-a27a-247bf7375d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:13.542168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a613c09-b419-4a00-a27a-247bf7375d45 admin admin] PATH_INFO: `/v3/users/43855ddc3a1e422cbe219e186937916a` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:13.542595 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a613c09-b419-4a00-a27a-247bf7375d45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43855ddc3a1e422cbe219e186937916a)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:13.544588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a613c09-b419-4a00-a27a-247bf7375d45 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:13.593513 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6a613c09-b419-4a00-a27a-247bf7375d45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43855ddc3a1e422cbe219e186937916a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:13.601870 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6a613c09-b419-4a00-a27a-247bf7375d45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43855ddc3a1e422cbe219e186937916a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:13.614027 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6a613c09-b419-4a00-a27a-247bf7375d45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43855ddc3a1e422cbe219e186937916a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:13.614757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6a613c09-b419-4a00-a27a-247bf7375d45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43855ddc3a1e422cbe219e186937916a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:13.623253 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6a613c09-b419-4a00-a27a-247bf7375d45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43855ddc3a1e422cbe219e186937916a'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:13.624882 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:13.631784 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1438/2852] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:13 2022] DELETE /identity/v3/users/43855ddc3a1e422cbe219e186937916a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:13.925592 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:13.927033 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:13.942967 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94c87a1-1e4a-4eb2-a3d5-0a54769abbd9 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:14.000919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85feab9-af9e-4347-9344-9c2a959da8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:14.001548 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85feab9-af9e-4347-9344-9c2a959da8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:14.001844 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85feab9-af9e-4347-9344-9c2a959da8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:14.002124 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85feab9-af9e-4347-9344-9c2a959da8eb admin admin] PATH_INFO: `/v3/projects/cccb9da24db7470d86caf07c7f687a56` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:14.003240 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85feab9-af9e-4347-9344-9c2a959da8eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=cccb9da24db7470d86caf07c7f687a56)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:14.006202 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85feab9-af9e-4347-9344-9c2a959da8eb admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:14.053331 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c85feab9-af9e-4347-9344-9c2a959da8eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cccb9da24db7470d86caf07c7f687a56', 'request_id': 'req-c85feab9-af9e-4347-9344-9c2a959da8eb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:14.058941 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c85feab9-af9e-4347-9344-9c2a959da8eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cccb9da24db7470d86caf07c7f687a56', 'request_id': 'req-c85feab9-af9e-4347-9344-9c2a959da8eb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:14.065142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c85feab9-af9e-4347-9344-9c2a959da8eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cccb9da24db7470d86caf07c7f687a56', 'request_id': 'req-c85feab9-af9e-4347-9344-9c2a959da8eb'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:14.080446 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c85feab9-af9e-4347-9344-9c2a959da8eb admin admin] The token cache is being invalidate because project cccb9da24db7470d86caf07c7f687a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:14.080770 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c85feab9-af9e-4347-9344-9c2a959da8eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:14.081390 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c85feab9-af9e-4347-9344-9c2a959da8eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:14.083094 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1415/2853] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:13 2022] DELETE /identity/v3/projects/cccb9da24db7470d86caf07c7f687a56 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:14.087476 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a613c09-b419-4a00-a27a-247bf7375d45 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:14.088902 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6a613c09-b419-4a00-a27a-247bf7375d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:14.102363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a613c09-b419-4a00-a27a-247bf7375d45 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:14.158785 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83b2bd-4e14-4f30-bd87-c8ba5a4596c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:14.159419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83b2bd-4e14-4f30-bd87-c8ba5a4596c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:14.159698 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83b2bd-4e14-4f30-bd87-c8ba5a4596c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:14.159968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83b2bd-4e14-4f30-bd87-c8ba5a4596c7 admin admin] PATH_INFO: `/v3/users/03e5f10bf7784ba598da08aa1cd7e82e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:14.161120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83b2bd-4e14-4f30-bd87-c8ba5a4596c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03e5f10bf7784ba598da08aa1cd7e82e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:14.163076 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83b2bd-4e14-4f30-bd87-c8ba5a4596c7 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:14.209789 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-be83b2bd-4e14-4f30-bd87-c8ba5a4596c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03e5f10bf7784ba598da08aa1cd7e82e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:14.216762 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-be83b2bd-4e14-4f30-bd87-c8ba5a4596c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03e5f10bf7784ba598da08aa1cd7e82e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:14.230582 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-be83b2bd-4e14-4f30-bd87-c8ba5a4596c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03e5f10bf7784ba598da08aa1cd7e82e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:14.231300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-be83b2bd-4e14-4f30-bd87-c8ba5a4596c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03e5f10bf7784ba598da08aa1cd7e82e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:14.240779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-be83b2bd-4e14-4f30-bd87-c8ba5a4596c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03e5f10bf7784ba598da08aa1cd7e82e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:14.247366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1439/2854] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:14 2022] DELETE /identity/v3/users/03e5f10bf7784ba598da08aa1cd7e82e => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:45:14.713778 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85feab9-af9e-4347-9344-9c2a959da8eb admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:14.715211 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c85feab9-af9e-4347-9344-9c2a959da8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:14.728618 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85feab9-af9e-4347-9344-9c2a959da8eb admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:14.798735 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb60dc6-d61a-4351-af28-5bec482a67a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:14.799376 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60dc6-d61a-4351-af28-5bec482a67a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:14.799652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60dc6-d61a-4351-af28-5bec482a67a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:14.799930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60dc6-d61a-4351-af28-5bec482a67a5 admin admin] PATH_INFO: `/v3/projects/cd9e0f61b94745ccb38762f00d7c0742` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:14.801133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb60dc6-d61a-4351-af28-5bec482a67a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9e0f61b94745ccb38762f00d7c0742)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:14.802974 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb60dc6-d61a-4351-af28-5bec482a67a5 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:14.811377 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:14.855366 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fb60dc6-d61a-4351-af28-5bec482a67a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9e0f61b94745ccb38762f00d7c0742', 'request_id': 'req-5fb60dc6-d61a-4351-af28-5bec482a67a5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:14.862117 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fb60dc6-d61a-4351-af28-5bec482a67a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9e0f61b94745ccb38762f00d7c0742', 'request_id': 'req-5fb60dc6-d61a-4351-af28-5bec482a67a5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:14.868681 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fb60dc6-d61a-4351-af28-5bec482a67a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9e0f61b94745ccb38762f00d7c0742', 'request_id': 'req-5fb60dc6-d61a-4351-af28-5bec482a67a5'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:14.882141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fb60dc6-d61a-4351-af28-5bec482a67a5 admin admin] The token cache is being invalidate because project cd9e0f61b94745ccb38762f00d7c0742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:14.882432 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fb60dc6-d61a-4351-af28-5bec482a67a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:14.883055 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5fb60dc6-d61a-4351-af28-5bec482a67a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:14.884847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1416/2855] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:14 2022] DELETE /identity/v3/projects/cd9e0f61b94745ccb38762f00d7c0742 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:17.085989 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83b2bd-4e14-4f30-bd87-c8ba5a4596c7 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:17.087815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-be83b2bd-4e14-4f30-bd87-c8ba5a4596c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:17.100733 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83b2bd-4e14-4f30-bd87-c8ba5a4596c7 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:17.156577 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1077ee-fb00-45c0-ad86-fda33879bce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:17.157218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1077ee-fb00-45c0-ad86-fda33879bce5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:17.157496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1077ee-fb00-45c0-ad86-fda33879bce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:17.157781 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1077ee-fb00-45c0-ad86-fda33879bce5 admin admin] PATH_INFO: `/v3/users/8b5760ecd4924ed8b100a3e422cecb6e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:17.158925 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1077ee-fb00-45c0-ad86-fda33879bce5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b5760ecd4924ed8b100a3e422cecb6e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:17.160849 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1077ee-fb00-45c0-ad86-fda33879bce5 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:17.180637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:17.207397 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4b1077ee-fb00-45c0-ad86-fda33879bce5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b5760ecd4924ed8b100a3e422cecb6e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:17.214276 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4b1077ee-fb00-45c0-ad86-fda33879bce5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b5760ecd4924ed8b100a3e422cecb6e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:17.227371 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4b1077ee-fb00-45c0-ad86-fda33879bce5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b5760ecd4924ed8b100a3e422cecb6e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:17.228077 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4b1077ee-fb00-45c0-ad86-fda33879bce5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b5760ecd4924ed8b100a3e422cecb6e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:17.236783 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4b1077ee-fb00-45c0-ad86-fda33879bce5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b5760ecd4924ed8b100a3e422cecb6e'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:17.243301 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1440/2856] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:17 2022] DELETE /identity/v3/users/8b5760ecd4924ed8b100a3e422cecb6e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:17.247731 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480c022-b35d-4461-bc97-8f40ef5d5c72 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:17.248143 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480c022-b35d-4461-bc97-8f40ef5d5c72 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:17.248271 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f480c022-b35d-4461-bc97-8f40ef5d5c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:17.268807 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-f480c022-b35d-4461-bc97-8f40ef5d5c72 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:17.270092 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f480c022-b35d-4461-bc97-8f40ef5d5c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:17.336143 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1417/2857] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:17.346056 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1077ee-fb00-45c0-ad86-fda33879bce5 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:17.347584 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4b1077ee-fb00-45c0-ad86-fda33879bce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:17.408470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1077ee-fb00-45c0-ad86-fda33879bce5 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:17.412125 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c25aa-e610-4752-aafa-fc3b9c4723d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:17.412750 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c25aa-e610-4752-aafa-fc3b9c4723d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:17.413027 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c25aa-e610-4752-aafa-fc3b9c4723d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:17.413295 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2c25aa-e610-4752-aafa-fc3b9c4723d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:17.422554 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c25aa-e610-4752-aafa-fc3b9c4723d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:17.424538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2c25aa-e610-4752-aafa-fc3b9c4723d4 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:17.434373 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1441/2858] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:17.706795 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480c022-b35d-4461-bc97-8f40ef5d5c72 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:17.708408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-f480c022-b35d-4461-bc97-8f40ef5d5c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:17.720323 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f480c022-b35d-4461-bc97-8f40ef5d5c72 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:17.724927 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778e784-4956-4517-aa4b-dd1e6498805d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:17.725563 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778e784-4956-4517-aa4b-dd1e6498805d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:17.725837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778e784-4956-4517-aa4b-dd1e6498805d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:17.726103 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778e784-4956-4517-aa4b-dd1e6498805d admin admin] PATH_INFO: `/v3/projects/1e20927880e64a32aac2c8e44862cbd3` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:17.727209 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778e784-4956-4517-aa4b-dd1e6498805d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e20927880e64a32aac2c8e44862cbd3)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:17.729134 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778e784-4956-4517-aa4b-dd1e6498805d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:17.775801 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5778e784-4956-4517-aa4b-dd1e6498805d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e20927880e64a32aac2c8e44862cbd3', 'request_id': 'req-5778e784-4956-4517-aa4b-dd1e6498805d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:17.781600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5778e784-4956-4517-aa4b-dd1e6498805d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e20927880e64a32aac2c8e44862cbd3', 'request_id': 'req-5778e784-4956-4517-aa4b-dd1e6498805d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:17.787666 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5778e784-4956-4517-aa4b-dd1e6498805d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e20927880e64a32aac2c8e44862cbd3', 'request_id': 'req-5778e784-4956-4517-aa4b-dd1e6498805d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:17.800473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5778e784-4956-4517-aa4b-dd1e6498805d admin admin] The token cache is being invalidate because project 1e20927880e64a32aac2c8e44862cbd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:17.800796 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5778e784-4956-4517-aa4b-dd1e6498805d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:17.801437 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-5778e784-4956-4517-aa4b-dd1e6498805d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:17.802930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1418/2859] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:17 2022] DELETE /identity/v3/projects/1e20927880e64a32aac2c8e44862cbd3 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:17.806933 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c25aa-e610-4752-aafa-fc3b9c4723d4 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:17.816984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2c25aa-e610-4752-aafa-fc3b9c4723d4 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:17.871384 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9779c-f910-4f74-8583-9f4eb38640da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:17.872006 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9779c-f910-4f74-8583-9f4eb38640da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:17.872286 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9779c-f910-4f74-8583-9f4eb38640da admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:17.872560 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9779c-f910-4f74-8583-9f4eb38640da admin admin] PATH_INFO: `/v3/users/23b8062d286d407486338a5aa615b8bb` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:17.873699 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9779c-f910-4f74-8583-9f4eb38640da admin admin] RBAC: Authorizing `identity:delete_user(user_id=23b8062d286d407486338a5aa615b8bb)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:17.875602 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c9779c-f910-4f74-8583-9f4eb38640da admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:17.915768 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:17.921415 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-47c9779c-f910-4f74-8583-9f4eb38640da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23b8062d286d407486338a5aa615b8bb'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:17.929123 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-47c9779c-f910-4f74-8583-9f4eb38640da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23b8062d286d407486338a5aa615b8bb'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:17.942982 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-47c9779c-f910-4f74-8583-9f4eb38640da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23b8062d286d407486338a5aa615b8bb'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:17.943686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-47c9779c-f910-4f74-8583-9f4eb38640da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23b8062d286d407486338a5aa615b8bb'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:17.952805 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-47c9779c-f910-4f74-8583-9f4eb38640da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23b8062d286d407486338a5aa615b8bb'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:17.959438 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1442/2860] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:17 2022] DELETE /identity/v3/users/23b8062d286d407486338a5aa615b8bb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:18.230495 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778e784-4956-4517-aa4b-dd1e6498805d admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:18.232089 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-5778e784-4956-4517-aa4b-dd1e6498805d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:18.246919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778e784-4956-4517-aa4b-dd1e6498805d admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:18.263784 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:18.306313 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f08efc-8014-4101-a7f4-31a62ae7c11b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:18.306861 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f08efc-8014-4101-a7f4-31a62ae7c11b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:18.307142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f08efc-8014-4101-a7f4-31a62ae7c11b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:18.307414 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f08efc-8014-4101-a7f4-31a62ae7c11b admin admin] PATH_INFO: `/v3/projects/b0a515d6935c4c2db54856872beb2ef4` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:18.308558 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f08efc-8014-4101-a7f4-31a62ae7c11b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0a515d6935c4c2db54856872beb2ef4)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:18.310520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f08efc-8014-4101-a7f4-31a62ae7c11b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:18.355948 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b4f08efc-8014-4101-a7f4-31a62ae7c11b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0a515d6935c4c2db54856872beb2ef4', 'request_id': 'req-b4f08efc-8014-4101-a7f4-31a62ae7c11b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:18.361664 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b4f08efc-8014-4101-a7f4-31a62ae7c11b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0a515d6935c4c2db54856872beb2ef4', 'request_id': 'req-b4f08efc-8014-4101-a7f4-31a62ae7c11b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:18.368015 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b4f08efc-8014-4101-a7f4-31a62ae7c11b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0a515d6935c4c2db54856872beb2ef4', 'request_id': 'req-b4f08efc-8014-4101-a7f4-31a62ae7c11b'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:18.381508 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b4f08efc-8014-4101-a7f4-31a62ae7c11b admin admin] The token cache is being invalidate because project b0a515d6935c4c2db54856872beb2ef4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:18.381798 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b4f08efc-8014-4101-a7f4-31a62ae7c11b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:18.382434 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-b4f08efc-8014-4101-a7f4-31a62ae7c11b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:18.383920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1419/2861] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:18 2022] DELETE /identity/v3/projects/b0a515d6935c4c2db54856872beb2ef4 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:18.387972 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9779c-f910-4f74-8583-9f4eb38640da admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:18.389580 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-47c9779c-f910-4f74-8583-9f4eb38640da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:18.403322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c9779c-f910-4f74-8583-9f4eb38640da admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:18.467225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faad0a36-b1d5-40f7-9d84-af4954c4beda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:18.468319 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad0a36-b1d5-40f7-9d84-af4954c4beda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:18.468888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad0a36-b1d5-40f7-9d84-af4954c4beda admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:18.469299 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faad0a36-b1d5-40f7-9d84-af4954c4beda admin admin] PATH_INFO: `/v3/users/626e7c7f6d3947c780e429c0865d8a90` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:18.470548 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad0a36-b1d5-40f7-9d84-af4954c4beda admin admin] RBAC: Authorizing `identity:delete_user(user_id=626e7c7f6d3947c780e429c0865d8a90)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:18.472495 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faad0a36-b1d5-40f7-9d84-af4954c4beda admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:18.528971 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-faad0a36-b1d5-40f7-9d84-af4954c4beda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '626e7c7f6d3947c780e429c0865d8a90'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:18.537298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-faad0a36-b1d5-40f7-9d84-af4954c4beda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '626e7c7f6d3947c780e429c0865d8a90'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:18.551484 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-faad0a36-b1d5-40f7-9d84-af4954c4beda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '626e7c7f6d3947c780e429c0865d8a90'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:18.552196 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-faad0a36-b1d5-40f7-9d84-af4954c4beda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '626e7c7f6d3947c780e429c0865d8a90'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:18.560264 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-faad0a36-b1d5-40f7-9d84-af4954c4beda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '626e7c7f6d3947c780e429c0865d8a90'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:18.568945 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1443/2862] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:18 2022] DELETE /identity/v3/users/626e7c7f6d3947c780e429c0865d8a90 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:18.838230 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f08efc-8014-4101-a7f4-31a62ae7c11b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:18.839985 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-b4f08efc-8014-4101-a7f4-31a62ae7c11b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:18.853930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f08efc-8014-4101-a7f4-31a62ae7c11b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:18.910961 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f7200-5972-422a-b761-0c2762b80377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:18.911587 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f7200-5972-422a-b761-0c2762b80377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:18.911870 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f7200-5972-422a-b761-0c2762b80377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:18.912148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f7200-5972-422a-b761-0c2762b80377 admin admin] PATH_INFO: `/v3/projects/8c6c0cf135054597ac7ba92d8f38a5b2` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:18.913284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f7200-5972-422a-b761-0c2762b80377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c6c0cf135054597ac7ba92d8f38a5b2)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:18.915170 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f7200-5972-422a-b761-0c2762b80377 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:18.960394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a91f7200-5972-422a-b761-0c2762b80377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c6c0cf135054597ac7ba92d8f38a5b2', 'request_id': 'req-a91f7200-5972-422a-b761-0c2762b80377'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:18.962304 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:18.966813 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a91f7200-5972-422a-b761-0c2762b80377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c6c0cf135054597ac7ba92d8f38a5b2', 'request_id': 'req-a91f7200-5972-422a-b761-0c2762b80377'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:18.973981 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a91f7200-5972-422a-b761-0c2762b80377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c6c0cf135054597ac7ba92d8f38a5b2', 'request_id': 'req-a91f7200-5972-422a-b761-0c2762b80377'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:18.987829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a91f7200-5972-422a-b761-0c2762b80377 admin admin] The token cache is being invalidate because project 8c6c0cf135054597ac7ba92d8f38a5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:18.988141 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a91f7200-5972-422a-b761-0c2762b80377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:18.988813 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-a91f7200-5972-422a-b761-0c2762b80377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:18.990268 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1420/2863] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:18 2022] DELETE /identity/v3/projects/8c6c0cf135054597ac7ba92d8f38a5b2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:18.995429 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c7910-3eb4-4abb-8f52-8b687ce69163 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:18.995714 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c7910-3eb4-4abb-8f52-8b687ce69163 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:18.996011 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c7910-3eb4-4abb-8f52-8b687ce69163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:19.015770 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-bf3c7910-3eb4-4abb-8f52-8b687ce69163 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:19.016996 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-bf3c7910-3eb4-4abb-8f52-8b687ce69163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:19.048192 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:19.078063 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1444/2864] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:45:19.086068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9c620-98e2-48ce-9a1b-c6a60b0bc7d2 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:19.086288 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9c620-98e2-48ce-9a1b-c6a60b0bc7d2 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:19.086556 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9c620-98e2-48ce-9a1b-c6a60b0bc7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:19.106157 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-53c9c620-98e2-48ce-9a1b-c6a60b0bc7d2 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:19.107370 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-53c9c620-98e2-48ce-9a1b-c6a60b0bc7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:19.116047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1421/2865] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:19.120391 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c7910-3eb4-4abb-8f52-8b687ce69163 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:19.130620 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c7910-3eb4-4abb-8f52-8b687ce69163 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:19.135180 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c7a96-7faa-4a0b-b52e-c3664f59d4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:19.135772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c7a96-7faa-4a0b-b52e-c3664f59d4aa admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:19.136052 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c7a96-7faa-4a0b-b52e-c3664f59d4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:19.136326 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108c7a96-7faa-4a0b-b52e-c3664f59d4aa admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:19.137010 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c7a96-7faa-4a0b-b52e-c3664f59d4aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:45:19.137315 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c7a96-7faa-4a0b-b52e-c3664f59d4aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:19.138926 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108c7a96-7faa-4a0b-b52e-c3664f59d4aa admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:19.150347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1445/2866] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:45:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:45:19.154396 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9c620-98e2-48ce-9a1b-c6a60b0bc7d2 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:19.163942 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9c620-98e2-48ce-9a1b-c6a60b0bc7d2 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:19.168628 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37dcb7-7d48-49eb-86fa-9ccbc4cd9063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:19.169255 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37dcb7-7d48-49eb-86fa-9ccbc4cd9063 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:19.169537 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37dcb7-7d48-49eb-86fa-9ccbc4cd9063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:19.169818 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef37dcb7-7d48-49eb-86fa-9ccbc4cd9063 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:19.170449 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37dcb7-7d48-49eb-86fa-9ccbc4cd9063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:19.172332 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef37dcb7-7d48-49eb-86fa-9ccbc4cd9063 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:19.199076 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1422/2867] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:45:19 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:19.203178 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c7a96-7faa-4a0b-b52e-c3664f59d4aa admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:19.213723 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108c7a96-7faa-4a0b-b52e-c3664f59d4aa admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:19.269644 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72899da-e495-49fa-ab2d-a511a16e4fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:19.270248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72899da-e495-49fa-ab2d-a511a16e4fb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:19.270529 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72899da-e495-49fa-ab2d-a511a16e4fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:19.270804 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72899da-e495-49fa-ab2d-a511a16e4fb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:19.271440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72899da-e495-49fa-ab2d-a511a16e4fb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:19.273389 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72899da-e495-49fa-ab2d-a511a16e4fb0 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:19.294634 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1446/2868] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:45:19 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:45:19.298809 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37dcb7-7d48-49eb-86fa-9ccbc4cd9063 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:19.309133 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef37dcb7-7d48-49eb-86fa-9ccbc4cd9063 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:19.313721 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711d2a3-31cb-4a00-96d9-469137ad0396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:19.314829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711d2a3-31cb-4a00-96d9-469137ad0396 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:19.315088 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711d2a3-31cb-4a00-96d9-469137ad0396 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:19.315359 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7711d2a3-31cb-4a00-96d9-469137ad0396 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:19.315990 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711d2a3-31cb-4a00-96d9-469137ad0396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:19.317605 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7711d2a3-31cb-4a00-96d9-469137ad0396 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:19.327429 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1423/2869] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:19.331285 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72899da-e495-49fa-ab2d-a511a16e4fb0 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:19.341433 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72899da-e495-49fa-ab2d-a511a16e4fb0 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:19.346341 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0076f08-d866-4820-951f-ca2e61f0d2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:19.346929 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0076f08-d866-4820-951f-ca2e61f0d2ae admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:19.347209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0076f08-d866-4820-951f-ca2e61f0d2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:19.347481 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0076f08-d866-4820-951f-ca2e61f0d2ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:19.348151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0076f08-d866-4820-951f-ca2e61f0d2ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:19.349776 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0076f08-d866-4820-951f-ca2e61f0d2ae admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:19.360292 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1447/2870] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:19.364466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711d2a3-31cb-4a00-96d9-469137ad0396 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:19.374583 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7711d2a3-31cb-4a00-96d9-469137ad0396 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:19.379676 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851bbd1-c508-444b-b794-4ef25cb5617b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:19.380312 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851bbd1-c508-444b-b794-4ef25cb5617b admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:19.380620 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851bbd1-c508-444b-b794-4ef25cb5617b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:19.380928 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f851bbd1-c508-444b-b794-4ef25cb5617b admin admin] PATH_INFO: `/v3/projects/f46507a791ff4c2596f2411909e53b4c/users/ff3a127ad26849cdad7e01c72440359d/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:19.395592 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851bbd1-c508-444b-b794-4ef25cb5617b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f46507a791ff4c2596f2411909e53b4c, user_id=ff3a127ad26849cdad7e01c72440359d, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:19.398267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f851bbd1-c508-444b-b794-4ef25cb5617b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:19.410803 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1424/2871] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:45:19 2022] PUT /identity/v3/projects/f46507a791ff4c2596f2411909e53b4c/users/ff3a127ad26849cdad7e01c72440359d/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:45:19.421030 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a38e48-4921-4ac9-a88b-0464ccfb362f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:19.421490 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a38e48-4921-4ac9-a88b-0464ccfb362f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:19.421588 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a38e48-4921-4ac9-a88b-0464ccfb362f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:19.450890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d5a38e48-4921-4ac9-a88b-0464ccfb362f None None] MFA Rules not processed for user `ff3a127ad26849cdad7e01c72440359d`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:19.452182 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d5a38e48-4921-4ac9-a88b-0464ccfb362f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:19.516209 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1448/2872] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:19.520873 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851bbd1-c508-444b-b794-4ef25cb5617b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:19.581705 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f851bbd1-c508-444b-b794-4ef25cb5617b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:19.586337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68baa4f-8950-461e-8f0b-b6c57191136b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:19.586931 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68baa4f-8950-461e-8f0b-b6c57191136b admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:19.587218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68baa4f-8950-461e-8f0b-b6c57191136b admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:19.587472 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68baa4f-8950-461e-8f0b-b6c57191136b admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:19.588094 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68baa4f-8950-461e-8f0b-b6c57191136b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:19.589999 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68baa4f-8950-461e-8f0b-b6c57191136b admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:19.615960 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1425/2873] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:45:19 2022] POST /identity/v3/projects => generated 381 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:19.620240 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a38e48-4921-4ac9-a88b-0464ccfb362f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:19.630978 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a38e48-4921-4ac9-a88b-0464ccfb362f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:19.662663 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:19.690708 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a8a36-56ff-4b39-be67-3df77e791787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:19.691315 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8a36-56ff-4b39-be67-3df77e791787 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:19.691601 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8a36-56ff-4b39-be67-3df77e791787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:19.691877 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a8a36-56ff-4b39-be67-3df77e791787 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:19.692512 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a8a36-56ff-4b39-be67-3df77e791787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:19.694472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a8a36-56ff-4b39-be67-3df77e791787 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:19.715861 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1449/2874] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:45:19 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:19.719984 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68baa4f-8950-461e-8f0b-b6c57191136b admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:19.730144 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68baa4f-8950-461e-8f0b-b6c57191136b admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:19.734776 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1c248-39da-4aae-a787-6ecf8a249483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:19.735407 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c248-39da-4aae-a787-6ecf8a249483 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:19.736528 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c248-39da-4aae-a787-6ecf8a249483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:19.736969 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e1c248-39da-4aae-a787-6ecf8a249483 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:19.737615 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1c248-39da-4aae-a787-6ecf8a249483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:19.739513 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e1c248-39da-4aae-a787-6ecf8a249483 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:19.751222 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1426/2875] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:19.755968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a8a36-56ff-4b39-be67-3df77e791787 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:19.766141 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a8a36-56ff-4b39-be67-3df77e791787 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:19.771004 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7fd79-21bb-4fd5-bec1-e01e568ffbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:19.771609 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7fd79-21bb-4fd5-bec1-e01e568ffbd8 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:19.771890 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7fd79-21bb-4fd5-bec1-e01e568ffbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:19.772161 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7fd79-21bb-4fd5-bec1-e01e568ffbd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:19.772840 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7fd79-21bb-4fd5-bec1-e01e568ffbd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:19.774427 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7fd79-21bb-4fd5-bec1-e01e568ffbd8 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:19.787581 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1450/2876] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:19.788787 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1c248-39da-4aae-a787-6ecf8a249483 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:19.799112 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e1c248-39da-4aae-a787-6ecf8a249483 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:19.803847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa943a9-e6c4-4f70-8cd8-3431a9108f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:19.804503 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa943a9-e6c4-4f70-8cd8-3431a9108f9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:19.804819 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa943a9-e6c4-4f70-8cd8-3431a9108f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:19.805097 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa943a9-e6c4-4f70-8cd8-3431a9108f9f admin admin] PATH_INFO: `/v3/projects/62fd17f63cd94556b72afcf757028315/users/c92404468cdd4e099cf220966f73184a/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:19.821575 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa943a9-e6c4-4f70-8cd8-3431a9108f9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=62fd17f63cd94556b72afcf757028315, user_id=c92404468cdd4e099cf220966f73184a, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:19.824201 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa943a9-e6c4-4f70-8cd8-3431a9108f9f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:19.838173 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1427/2877] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:45:19 2022] PUT /identity/v3/projects/62fd17f63cd94556b72afcf757028315/users/c92404468cdd4e099cf220966f73184a/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:19.849695 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6891402-bd98-41f7-ae04-9a5a1bd52d1f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:19.849986 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6891402-bd98-41f7-ae04-9a5a1bd52d1f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:19.850261 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6891402-bd98-41f7-ae04-9a5a1bd52d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:19.880219 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a6891402-bd98-41f7-ae04-9a5a1bd52d1f None None] MFA Rules not processed for user `c92404468cdd4e099cf220966f73184a`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:19.881407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a6891402-bd98-41f7-ae04-9a5a1bd52d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:19.950528 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1451/2878] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:19.955909 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa943a9-e6c4-4f70-8cd8-3431a9108f9f admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:19.987369 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:20.024904 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa943a9-e6c4-4f70-8cd8-3431a9108f9f admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:20.029770 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdbb82-9d38-43e8-abe2-c3631b3bfc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:20.030380 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdbb82-9d38-43e8-abe2-c3631b3bfc25 admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:20.030659 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdbb82-9d38-43e8-abe2-c3631b3bfc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:20.030965 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdbb82-9d38-43e8-abe2-c3631b3bfc25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:20.031619 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdbb82-9d38-43e8-abe2-c3631b3bfc25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:20.034274 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdbb82-9d38-43e8-abe2-c3631b3bfc25 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:20.064598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1428/2879] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:45:19 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:20.068848 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6891402-bd98-41f7-ae04-9a5a1bd52d1f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:20.079398 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6891402-bd98-41f7-ae04-9a5a1bd52d1f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:20.141471 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24960c-c9f7-45e3-b9ad-d0c886e8fd0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:20.142089 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24960c-c9f7-45e3-b9ad-d0c886e8fd0d admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:20.142399 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24960c-c9f7-45e3-b9ad-d0c886e8fd0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:20.142672 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24960c-c9f7-45e3-b9ad-d0c886e8fd0d admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:20.143318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24960c-c9f7-45e3-b9ad-d0c886e8fd0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:20.145333 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24960c-c9f7-45e3-b9ad-d0c886e8fd0d admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:20.174329 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1452/2880] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:45:20 2022] POST /identity/v3/users => generated 299 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 06:45:20.174727 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdbb82-9d38-43e8-abe2-c3631b3bfc25 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:20.186473 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdbb82-9d38-43e8-abe2-c3631b3bfc25 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:20.191785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b128eb-54af-4233-be04-753e0976658c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:20.192457 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b128eb-54af-4233-be04-753e0976658c admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:20.192836 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b128eb-54af-4233-be04-753e0976658c admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:20.193196 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b128eb-54af-4233-be04-753e0976658c admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:20.193937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b128eb-54af-4233-be04-753e0976658c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:20.195626 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b128eb-54af-4233-be04-753e0976658c admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:20.207442 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1429/2881] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:45:20.211555 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24960c-c9f7-45e3-b9ad-d0c886e8fd0d admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:20.222390 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24960c-c9f7-45e3-b9ad-d0c886e8fd0d admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:20.227486 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee16c2b-140d-4db9-870e-228208aea726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:20.228177 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee16c2b-140d-4db9-870e-228208aea726 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:20.228452 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee16c2b-140d-4db9-870e-228208aea726 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:20.228757 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee16c2b-140d-4db9-870e-228208aea726 admin admin] PATH_INFO: `/v3/projects/1a14637ec9dd4ef3a0d209ea5d32f4db/users/2f643c7b3a9b41f988198b57ee51c33c/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:20.245886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee16c2b-140d-4db9-870e-228208aea726 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a14637ec9dd4ef3a0d209ea5d32f4db, user_id=2f643c7b3a9b41f988198b57ee51c33c, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:20.248886 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee16c2b-140d-4db9-870e-228208aea726 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:20.262236 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1453/2882] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:45:20 2022] PUT /identity/v3/projects/1a14637ec9dd4ef3a0d209ea5d32f4db/users/2f643c7b3a9b41f988198b57ee51c33c/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:20.266235 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b128eb-54af-4233-be04-753e0976658c admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:20.276774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b128eb-54af-4233-be04-753e0976658c admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:20.334905 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d7820-a2c7-4615-a235-2732c81c0523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:20.335506 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d7820-a2c7-4615-a235-2732c81c0523 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:20.335774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d7820-a2c7-4615-a235-2732c81c0523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:20.336048 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d7820-a2c7-4615-a235-2732c81c0523 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:20.336713 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d7820-a2c7-4615-a235-2732c81c0523 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:20.338385 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d7820-a2c7-4615-a235-2732c81c0523 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:20.349264 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1430/2883] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:20.353660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee16c2b-140d-4db9-870e-228208aea726 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:20.364120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee16c2b-140d-4db9-870e-228208aea726 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:20.369071 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b4216-fd88-4401-ad21-b7172226fc43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:20.369713 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b4216-fd88-4401-ad21-b7172226fc43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:20.369987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b4216-fd88-4401-ad21-b7172226fc43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:20.370259 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b4216-fd88-4401-ad21-b7172226fc43 admin admin] PATH_INFO: `/v3/projects/1a14637ec9dd4ef3a0d209ea5d32f4db/users/2f643c7b3a9b41f988198b57ee51c33c/roles/6382a06103714d068409d25cbeb48744` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:20.372168 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b4216-fd88-4401-ad21-b7172226fc43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a14637ec9dd4ef3a0d209ea5d32f4db, user_id=2f643c7b3a9b41f988198b57ee51c33c, role_id=6382a06103714d068409d25cbeb48744)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:20.374794 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b4216-fd88-4401-ad21-b7172226fc43 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:20.377022 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:20.386790 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1454/2884] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:45:20 2022] PUT /identity/v3/projects/1a14637ec9dd4ef3a0d209ea5d32f4db/users/2f643c7b3a9b41f988198b57ee51c33c/roles/6382a06103714d068409d25cbeb48744 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:20.397372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91ddc7-08fb-4aa2-943f-cc38a514cce6 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:20.397660 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91ddc7-08fb-4aa2-943f-cc38a514cce6 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:20.397937 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce91ddc7-08fb-4aa2-943f-cc38a514cce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:20.426019 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ce91ddc7-08fb-4aa2-943f-cc38a514cce6 None None] MFA Rules not processed for user `2f643c7b3a9b41f988198b57ee51c33c`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:20.427221 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ce91ddc7-08fb-4aa2-943f-cc38a514cce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:20.495660 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1431/2885] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:20.507369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b4216-fd88-4401-ad21-b7172226fc43 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:20.509167 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0c7b4216-fd88-4401-ad21-b7172226fc43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:20.567835 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b4216-fd88-4401-ad21-b7172226fc43 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:20.571711 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f7228-5bde-4355-8da6-489b2294cfbc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:20.572337 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f7228-5bde-4355-8da6-489b2294cfbc service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:20.572612 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f7228-5bde-4355-8da6-489b2294cfbc service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:20.572909 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1f7228-5bde-4355-8da6-489b2294cfbc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:20.629571 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f7228-5bde-4355-8da6-489b2294cfbc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:20.631033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1f7228-5bde-4355-8da6-489b2294cfbc service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:20.640037 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1455/2886] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:22.154460 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91ddc7-08fb-4aa2-943f-cc38a514cce6 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:22.155907 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ce91ddc7-08fb-4aa2-943f-cc38a514cce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:22.168645 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce91ddc7-08fb-4aa2-943f-cc38a514cce6 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:22.172338 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231d0bd-e304-4115-8e24-05f4052cd1fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:22.173136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231d0bd-e304-4115-8e24-05f4052cd1fa service cinder] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:22.174038 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231d0bd-e304-4115-8e24-05f4052cd1fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:22.174373 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d231d0bd-e304-4115-8e24-05f4052cd1fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:22.197869 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:22.239320 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231d0bd-e304-4115-8e24-05f4052cd1fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:22.240935 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d231d0bd-e304-4115-8e24-05f4052cd1fa service cinder] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:22.250295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1432/2887] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:22.805361 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f7228-5bde-4355-8da6-489b2294cfbc service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:22.814243 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1f7228-5bde-4355-8da6-489b2294cfbc service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:22.817881 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fded6-b261-405a-84ec-a9513687a304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:22.818598 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fded6-b261-405a-84ec-a9513687a304 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:22.818883 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fded6-b261-405a-84ec-a9513687a304 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:22.819154 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fded6-b261-405a-84ec-a9513687a304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:22.828410 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fded6-b261-405a-84ec-a9513687a304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:22.830525 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fded6-b261-405a-84ec-a9513687a304 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:22.840860 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1456/2888] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:22 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:26.726294 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231d0bd-e304-4115-8e24-05f4052cd1fa service cinder] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:26.793257 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d231d0bd-e304-4115-8e24-05f4052cd1fa service cinder] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:26.801220 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b024b-f066-41d4-a2ec-e9b2a5fdc1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:26.801853 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b024b-f066-41d4-a2ec-e9b2a5fdc1ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:26.802146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b024b-f066-41d4-a2ec-e9b2a5fdc1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:26.802416 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b024b-f066-41d4-a2ec-e9b2a5fdc1ed admin admin] PATH_INFO: `/v3/users/ff3a127ad26849cdad7e01c72440359d` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:26.803658 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b024b-f066-41d4-a2ec-e9b2a5fdc1ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff3a127ad26849cdad7e01c72440359d)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:26.805701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27b024b-f066-41d4-a2ec-e9b2a5fdc1ed admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:26.858068 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c27b024b-f066-41d4-a2ec-e9b2a5fdc1ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff3a127ad26849cdad7e01c72440359d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:26.865549 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c27b024b-f066-41d4-a2ec-e9b2a5fdc1ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff3a127ad26849cdad7e01c72440359d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:26.878363 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c27b024b-f066-41d4-a2ec-e9b2a5fdc1ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff3a127ad26849cdad7e01c72440359d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:26.885950 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c27b024b-f066-41d4-a2ec-e9b2a5fdc1ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff3a127ad26849cdad7e01c72440359d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:26.886623 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-c27b024b-f066-41d4-a2ec-e9b2a5fdc1ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff3a127ad26849cdad7e01c72440359d'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:26.893145 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1433/2889] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:26 2022] DELETE /identity/v3/users/ff3a127ad26849cdad7e01c72440359d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:26.897818 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c1a1f-9304-43d0-b0be-30b4c801755f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:26.898322 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c1a1f-9304-43d0-b0be-30b4c801755f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:26.898505 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87c1a1f-9304-43d0-b0be-30b4c801755f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:26.918039 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e87c1a1f-9304-43d0-b0be-30b4c801755f None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:26.919311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e87c1a1f-9304-43d0-b0be-30b4c801755f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:26.980496 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1457/2890] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:26.990927 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b024b-f066-41d4-a2ec-e9b2a5fdc1ed admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:26.992640 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-c27b024b-f066-41d4-a2ec-e9b2a5fdc1ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:27.045481 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:27.062444 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b024b-f066-41d4-a2ec-e9b2a5fdc1ed admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:27.066192 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adceeec0-dc76-4f29-8216-86fdc70b47f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:27.066799 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adceeec0-dc76-4f29-8216-86fdc70b47f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:27.067104 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adceeec0-dc76-4f29-8216-86fdc70b47f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:27.067381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adceeec0-dc76-4f29-8216-86fdc70b47f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:27.077208 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adceeec0-dc76-4f29-8216-86fdc70b47f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:27.078631 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adceeec0-dc76-4f29-8216-86fdc70b47f0 service neutron] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:27.088748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1434/2891] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:27.357788 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c1a1f-9304-43d0-b0be-30b4c801755f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:27.359687 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e87c1a1f-9304-43d0-b0be-30b4c801755f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:27.375032 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87c1a1f-9304-43d0-b0be-30b4c801755f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:27.381010 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69cb8d4-b43a-4855-a494-cca186b9101c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:27.381905 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cb8d4-b43a-4855-a494-cca186b9101c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:27.382343 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cb8d4-b43a-4855-a494-cca186b9101c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:27.383256 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69cb8d4-b43a-4855-a494-cca186b9101c admin admin] PATH_INFO: `/v3/projects/f46507a791ff4c2596f2411909e53b4c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:27.383968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cb8d4-b43a-4855-a494-cca186b9101c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f46507a791ff4c2596f2411909e53b4c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:27.386108 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69cb8d4-b43a-4855-a494-cca186b9101c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:27.423163 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:INSERT=1,keystone:SELECT=97,keystone:DELETE=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:27.439622 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a69cb8d4-b43a-4855-a494-cca186b9101c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f46507a791ff4c2596f2411909e53b4c', 'request_id': 'req-a69cb8d4-b43a-4855-a494-cca186b9101c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:27.449672 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a69cb8d4-b43a-4855-a494-cca186b9101c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f46507a791ff4c2596f2411909e53b4c', 'request_id': 'req-a69cb8d4-b43a-4855-a494-cca186b9101c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:27.455842 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a69cb8d4-b43a-4855-a494-cca186b9101c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f46507a791ff4c2596f2411909e53b4c', 'request_id': 'req-a69cb8d4-b43a-4855-a494-cca186b9101c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:27.467061 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a69cb8d4-b43a-4855-a494-cca186b9101c admin admin] The token cache is being invalidate because project f46507a791ff4c2596f2411909e53b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:27.467356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a69cb8d4-b43a-4855-a494-cca186b9101c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:27.468017 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-a69cb8d4-b43a-4855-a494-cca186b9101c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:27.469635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1458/2892] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:27 2022] DELETE /identity/v3/projects/f46507a791ff4c2596f2411909e53b4c => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:45:27.474292 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adceeec0-dc76-4f29-8216-86fdc70b47f0 service neutron] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:27.484578 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adceeec0-dc76-4f29-8216-86fdc70b47f0 service neutron] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:27.602461 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121644d-aa01-4474-8f61-3925cd110fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:27.603408 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121644d-aa01-4474-8f61-3925cd110fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:27.603837 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121644d-aa01-4474-8f61-3925cd110fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:27.604117 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0121644d-aa01-4474-8f61-3925cd110fe6 admin admin] PATH_INFO: `/v3/users/c92404468cdd4e099cf220966f73184a` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:27.605412 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121644d-aa01-4474-8f61-3925cd110fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92404468cdd4e099cf220966f73184a)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:27.608102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0121644d-aa01-4474-8f61-3925cd110fe6 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:27.679616 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0121644d-aa01-4474-8f61-3925cd110fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92404468cdd4e099cf220966f73184a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:27.691146 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0121644d-aa01-4474-8f61-3925cd110fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92404468cdd4e099cf220966f73184a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:27.711546 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0121644d-aa01-4474-8f61-3925cd110fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92404468cdd4e099cf220966f73184a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:27.722129 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0121644d-aa01-4474-8f61-3925cd110fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92404468cdd4e099cf220966f73184a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:27.722808 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-0121644d-aa01-4474-8f61-3925cd110fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92404468cdd4e099cf220966f73184a'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:27.732136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1435/2893] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:27 2022] DELETE /identity/v3/users/c92404468cdd4e099cf220966f73184a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:27.878234 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e5cf6-3e39-4416-8b2b-3d4949606cef None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:27.878510 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e5cf6-3e39-4416-8b2b-3d4949606cef None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:27.878916 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e5cf6-3e39-4416-8b2b-3d4949606cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:27.902043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e22e5cf6-3e39-4416-8b2b-3d4949606cef None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:27.903583 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e22e5cf6-3e39-4416-8b2b-3d4949606cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:27.976033 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1459/2894] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 13 06:45:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:28.042216 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121644d-aa01-4474-8f61-3925cd110fe6 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:28.044873 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0121644d-aa01-4474-8f61-3925cd110fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:28.150926 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:28.155948 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0121644d-aa01-4474-8f61-3925cd110fe6 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:28.167091 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e9a39-83d5-44c5-8c71-d2059aa306c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:28.168114 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e9a39-83d5-44c5-8c71-d2059aa306c3 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:28.169384 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e9a39-83d5-44c5-8c71-d2059aa306c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:28.169762 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e9a39-83d5-44c5-8c71-d2059aa306c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:28.179139 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e9a39-83d5-44c5-8c71-d2059aa306c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:28.180926 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e9a39-83d5-44c5-8c71-d2059aa306c3 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:28.190237 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1436/2895] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:45:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 06:45:28.450283 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e5cf6-3e39-4416-8b2b-3d4949606cef None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:28.452225 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e22e5cf6-3e39-4416-8b2b-3d4949606cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:28.570127 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e5cf6-3e39-4416-8b2b-3d4949606cef None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:28.578579 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbe698-b619-4bb6-a359-fb59d00d59c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:28.581172 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbe698-b619-4bb6-a359-fb59d00d59c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:28.581658 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbe698-b619-4bb6-a359-fb59d00d59c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:28.582092 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfbe698-b619-4bb6-a359-fb59d00d59c9 admin admin] PATH_INFO: `/v3/projects/62fd17f63cd94556b72afcf757028315` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:28.583981 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbe698-b619-4bb6-a359-fb59d00d59c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62fd17f63cd94556b72afcf757028315)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:28.586111 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfbe698-b619-4bb6-a359-fb59d00d59c9 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:28.662987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4cfbe698-b619-4bb6-a359-fb59d00d59c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62fd17f63cd94556b72afcf757028315', 'request_id': 'req-4cfbe698-b619-4bb6-a359-fb59d00d59c9'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:28.672274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4cfbe698-b619-4bb6-a359-fb59d00d59c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62fd17f63cd94556b72afcf757028315', 'request_id': 'req-4cfbe698-b619-4bb6-a359-fb59d00d59c9'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:28.680780 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4cfbe698-b619-4bb6-a359-fb59d00d59c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62fd17f63cd94556b72afcf757028315', 'request_id': 'req-4cfbe698-b619-4bb6-a359-fb59d00d59c9'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:28.682488 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:28.697404 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4cfbe698-b619-4bb6-a359-fb59d00d59c9 admin admin] The token cache is being invalidate because project 62fd17f63cd94556b72afcf757028315 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:28.698142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4cfbe698-b619-4bb6-a359-fb59d00d59c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:28.699244 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-4cfbe698-b619-4bb6-a359-fb59d00d59c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:28.701565 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1460/2896] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:28 2022] DELETE /identity/v3/projects/62fd17f63cd94556b72afcf757028315 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:28.707057 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e9a39-83d5-44c5-8c71-d2059aa306c3 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:28.721361 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e9a39-83d5-44c5-8c71-d2059aa306c3 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:28.798252 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecb2f8-8cab-4d83-8a5f-78018b4b690d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:28.799991 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecb2f8-8cab-4d83-8a5f-78018b4b690d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:28.800504 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecb2f8-8cab-4d83-8a5f-78018b4b690d admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:28.801013 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecb2f8-8cab-4d83-8a5f-78018b4b690d admin admin] PATH_INFO: `/v3/users/2f643c7b3a9b41f988198b57ee51c33c` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:28.802589 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecb2f8-8cab-4d83-8a5f-78018b4b690d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f643c7b3a9b41f988198b57ee51c33c)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:28.804816 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecb2f8-8cab-4d83-8a5f-78018b4b690d admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:28.880864 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d6ecb2f8-8cab-4d83-8a5f-78018b4b690d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f643c7b3a9b41f988198b57ee51c33c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:28.897241 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d6ecb2f8-8cab-4d83-8a5f-78018b4b690d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f643c7b3a9b41f988198b57ee51c33c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:28.920759 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d6ecb2f8-8cab-4d83-8a5f-78018b4b690d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f643c7b3a9b41f988198b57ee51c33c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:28.933892 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d6ecb2f8-8cab-4d83-8a5f-78018b4b690d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f643c7b3a9b41f988198b57ee51c33c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:28.934539 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-d6ecb2f8-8cab-4d83-8a5f-78018b4b690d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f643c7b3a9b41f988198b57ee51c33c'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:28.946847 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1437/2897] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:28 2022] DELETE /identity/v3/users/2f643c7b3a9b41f988198b57ee51c33c => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:29.370407 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbe698-b619-4bb6-a359-fb59d00d59c9 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:29.372635 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4cfbe698-b619-4bb6-a359-fb59d00d59c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:29.398438 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfbe698-b619-4bb6-a359-fb59d00d59c9 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:29.531753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6494a9a5-1f35-4feb-925e-c1520156c625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:29.533567 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494a9a5-1f35-4feb-925e-c1520156c625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:29.534065 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494a9a5-1f35-4feb-925e-c1520156c625 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:29.534608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6494a9a5-1f35-4feb-925e-c1520156c625 admin admin] PATH_INFO: `/v3/projects/1a14637ec9dd4ef3a0d209ea5d32f4db` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:29.536230 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494a9a5-1f35-4feb-925e-c1520156c625 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a14637ec9dd4ef3a0d209ea5d32f4db)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:29.541677 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6494a9a5-1f35-4feb-925e-c1520156c625 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:29.700160 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6494a9a5-1f35-4feb-925e-c1520156c625 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a14637ec9dd4ef3a0d209ea5d32f4db', 'request_id': 'req-6494a9a5-1f35-4feb-925e-c1520156c625'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:29.717400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6494a9a5-1f35-4feb-925e-c1520156c625 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a14637ec9dd4ef3a0d209ea5d32f4db', 'request_id': 'req-6494a9a5-1f35-4feb-925e-c1520156c625'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:29.724572 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6494a9a5-1f35-4feb-925e-c1520156c625 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a14637ec9dd4ef3a0d209ea5d32f4db', 'request_id': 'req-6494a9a5-1f35-4feb-925e-c1520156c625'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:29.752222 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6494a9a5-1f35-4feb-925e-c1520156c625 admin admin] The token cache is being invalidate because project 1a14637ec9dd4ef3a0d209ea5d32f4db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:29.752704 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6494a9a5-1f35-4feb-925e-c1520156c625 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:29.753592 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-6494a9a5-1f35-4feb-925e-c1520156c625 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:29.758120 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1461/2898] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:29 2022] DELETE /identity/v3/projects/1a14637ec9dd4ef3a0d209ea5d32f4db => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:29.763634 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f48d1-fca1-4052-b892-fb027e487a59 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:29.764430 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f48d1-fca1-4052-b892-fb027e487a59 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:29.766337 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2f48d1-fca1-4052-b892-fb027e487a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:29.804228 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-0e2f48d1-fca1-4052-b892-fb027e487a59 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:29.805500 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-0e2f48d1-fca1-4052-b892-fb027e487a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:29.912715 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1438/2899] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:29.914309 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e36768-99bb-40f3-8752-0f99abe5231d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:29.914951 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e36768-99bb-40f3-8752-0f99abe5231d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:29.915684 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e36768-99bb-40f3-8752-0f99abe5231d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:29.973009 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-c9e36768-99bb-40f3-8752-0f99abe5231d None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:29.974281 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c9e36768-99bb-40f3-8752-0f99abe5231d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:29.988853 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1462/2900] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:29.991243 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f48d1-fca1-4052-b892-fb027e487a59 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:30.018895 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2f48d1-fca1-4052-b892-fb027e487a59 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:30.026135 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b2a82-dfa4-4fd6-829a-a8d74a1ac8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:30.027047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2a82-dfa4-4fd6-829a-a8d74a1ac8ed admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:30.027445 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2a82-dfa4-4fd6-829a-a8d74a1ac8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:30.028082 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b2a82-dfa4-4fd6-829a-a8d74a1ac8ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:30.028846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b2a82-dfa4-4fd6-829a-a8d74a1ac8ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81460) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:45:30.029306 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b2a82-dfa4-4fd6-829a-a8d74a1ac8ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:30.031282 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b2a82-dfa4-4fd6-829a-a8d74a1ac8ed admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:30.044096 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:30.055144 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1439/2901] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:45:30.056224 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e36768-99bb-40f3-8752-0f99abe5231d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:30.072410 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e36768-99bb-40f3-8752-0f99abe5231d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:30.088061 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a4ebc-f72f-44d0-a6e2-6c30c050eecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:30.089400 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a4ebc-f72f-44d0-a6e2-6c30c050eecf admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:30.089697 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a4ebc-f72f-44d0-a6e2-6c30c050eecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:30.089987 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38a4ebc-f72f-44d0-a6e2-6c30c050eecf admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:30.090686 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a4ebc-f72f-44d0-a6e2-6c30c050eecf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:30.092807 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38a4ebc-f72f-44d0-a6e2-6c30c050eecf admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:30.171096 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1463/2902] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:45:30 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:30.175496 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b2a82-dfa4-4fd6-829a-a8d74a1ac8ed admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:30.189219 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b2a82-dfa4-4fd6-829a-a8d74a1ac8ed admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:30.324166 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a36a4-5355-4010-a847-099913278fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:30.324982 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a36a4-5355-4010-a847-099913278fca admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:30.325267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a36a4-5355-4010-a847-099913278fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:30.325547 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857a36a4-5355-4010-a847-099913278fca admin admin] PATH_INFO: `/v3/users` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:30.326771 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a36a4-5355-4010-a847-099913278fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:30.329300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857a36a4-5355-4010-a847-099913278fca admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:30.375132 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1440/2903] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:45:30 2022] POST /identity/v3/users => generated 284 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:30.380048 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a4ebc-f72f-44d0-a6e2-6c30c050eecf admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:30.398129 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38a4ebc-f72f-44d0-a6e2-6c30c050eecf admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:30.405366 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e399b6f-772a-4d8e-b20d-f90fba07778c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:30.406051 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e399b6f-772a-4d8e-b20d-f90fba07778c admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:30.406334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e399b6f-772a-4d8e-b20d-f90fba07778c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:30.406676 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e399b6f-772a-4d8e-b20d-f90fba07778c admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:30.407338 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e399b6f-772a-4d8e-b20d-f90fba07778c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:30.409556 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e399b6f-772a-4d8e-b20d-f90fba07778c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:30.425614 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1464/2904] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:45:30.428566 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a36a4-5355-4010-a847-099913278fca admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:30.457346 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857a36a4-5355-4010-a847-099913278fca admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:30.463886 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5cc349-3f70-4489-b746-845b051746f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:30.464826 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cc349-3f70-4489-b746-845b051746f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:30.465243 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cc349-3f70-4489-b746-845b051746f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:30.465876 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5cc349-3f70-4489-b746-845b051746f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:30.466649 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cc349-3f70-4489-b746-845b051746f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:30.469579 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5cc349-3f70-4489-b746-845b051746f7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:30.495381 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1441/2905] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:30.499142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e399b6f-772a-4d8e-b20d-f90fba07778c admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:30.518984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e399b6f-772a-4d8e-b20d-f90fba07778c admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:30.535543 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794668a-7915-48a2-b27f-43d0b18361ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:30.536446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794668a-7915-48a2-b27f-43d0b18361ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:30.536815 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794668a-7915-48a2-b27f-43d0b18361ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:30.537220 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0794668a-7915-48a2-b27f-43d0b18361ae admin admin] PATH_INFO: `/v3/projects/e6b116ee24a74761ba50046e639d8c25/users/7ed40f63ce0549a6903417e37ad4aeed/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:30.555411 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794668a-7915-48a2-b27f-43d0b18361ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b116ee24a74761ba50046e639d8c25, user_id=7ed40f63ce0549a6903417e37ad4aeed, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:30.558067 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0794668a-7915-48a2-b27f-43d0b18361ae admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:30.582534 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1465/2906] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:45:30 2022] PUT /identity/v3/projects/e6b116ee24a74761ba50046e639d8c25/users/7ed40f63ce0549a6903417e37ad4aeed/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:45:30.593378 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2eda9-6bf2-4192-b321-75d7c34c00d9 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:30.593663 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2eda9-6bf2-4192-b321-75d7c34c00d9 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:30.593953 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2eda9-6bf2-4192-b321-75d7c34c00d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:30.634631 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-9ca2eda9-6bf2-4192-b321-75d7c34c00d9 None None] MFA Rules not processed for user `7ed40f63ce0549a6903417e37ad4aeed`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:30.636846 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-9ca2eda9-6bf2-4192-b321-75d7c34c00d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:30.763419 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794668a-7915-48a2-b27f-43d0b18361ae admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:30.764028 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1442/2907] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:30.765235 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0794668a-7915-48a2-b27f-43d0b18361ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:30.817844 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:30.887380 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0794668a-7915-48a2-b27f-43d0b18361ae admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:30.892538 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11407f7f-3579-41d0-9ed5-a82d8eae5be7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ddc0c92f881e40c9abe067d3a6d4251b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:30.893392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11407f7f-3579-41d0-9ed5-a82d8eae5be7 service glance] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:30.893668 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11407f7f-3579-41d0-9ed5-a82d8eae5be7 service glance] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:30.893956 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11407f7f-3579-41d0-9ed5-a82d8eae5be7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:30.908446 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11407f7f-3579-41d0-9ed5-a82d8eae5be7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:30.911660 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11407f7f-3579-41d0-9ed5-a82d8eae5be7 service glance] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:30.924576 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1466/2908] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:30 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:40.737920 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=67,keystone:INSERT=3 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:40.919649 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=17 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:45.370466 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57a045-7466-4e37-b3ba-249be240c990 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:45.371031 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57a045-7466-4e37-b3ba-249be240c990 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:45.371194 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57a045-7466-4e37-b3ba-249be240c990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:45.420794 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-ab57a045-7466-4e37-b3ba-249be240c990 None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:45.422300 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ab57a045-7466-4e37-b3ba-249be240c990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:45.521051 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1443/2909] 10.222.0.42 () {58 vars in 967 bytes} [Tue Sep 13 06:45:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:45.534594 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11407f7f-3579-41d0-9ed5-a82d8eae5be7 service glance] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:45.536950 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-11407f7f-3579-41d0-9ed5-a82d8eae5be7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:45.668392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11407f7f-3579-41d0-9ed5-a82d8eae5be7 service glance] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:45.674119 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50467581-53fe-496e-87f8-36203b45d8d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:45.674727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50467581-53fe-496e-87f8-36203b45d8d2 service swift] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:45.675001 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50467581-53fe-496e-87f8-36203b45d8d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:45.675272 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50467581-53fe-496e-87f8-36203b45d8d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:45.684344 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50467581-53fe-496e-87f8-36203b45d8d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:45.686133 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50467581-53fe-496e-87f8-36203b45d8d2 service swift] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:45.695274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1467/2910] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:45:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 06:45:47.141902 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57a045-7466-4e37-b3ba-249be240c990 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:47.144266 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-ab57a045-7466-4e37-b3ba-249be240c990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:47.299788 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57a045-7466-4e37-b3ba-249be240c990 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:47.305568 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41b4cc-b07b-43d9-b03d-92909016d82c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84a23931b60457e865f056352a396d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:47.306664 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41b4cc-b07b-43d9-b03d-92909016d82c service placement] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:47.307052 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41b4cc-b07b-43d9-b03d-92909016d82c service placement] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:47.307460 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41b4cc-b07b-43d9-b03d-92909016d82c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:47.309653 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-be41b4cc-b07b-43d9-b03d-92909016d82c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:47.326394 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41b4cc-b07b-43d9-b03d-92909016d82c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:47.328386 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be41b4cc-b07b-43d9-b03d-92909016d82c service placement] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:47.341399 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1444/2911] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:49.610575 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d7247-33d2-43bd-8b17-23a219ebca0d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:49.611434 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d7247-33d2-43bd-8b17-23a219ebca0d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:49.611904 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10d7247-33d2-43bd-8b17-23a219ebca0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:49.635982 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b10d7247-33d2-43bd-8b17-23a219ebca0d None None] MFA Rules not processed for user `3739971aa30548d6932d7af156e1fdaf`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:49.637372 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b10d7247-33d2-43bd-8b17-23a219ebca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:49.647498 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1468/2912] 10.222.0.42 () {58 vars in 967 bytes} [Tue Sep 13 06:45:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:49.673805 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41b4cc-b07b-43d9-b03d-92909016d82c service placement] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:49.687318 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41b4cc-b07b-43d9-b03d-92909016d82c service placement] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:49.693567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c85d34-13a5-4671-8d96-36afb0b9a3f5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'de05d038c2124f43a3acc70f4fb5b44e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:49.694184 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85d34-13a5-4671-8d96-36afb0b9a3f5 service swift] REQUEST_METHOD: `GET` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:49.694464 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85d34-13a5-4671-8d96-36afb0b9a3f5 service swift] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:49.694736 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c85d34-13a5-4671-8d96-36afb0b9a3f5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:49.706349 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c85d34-13a5-4671-8d96-36afb0b9a3f5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:49.713316 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c85d34-13a5-4671-8d96-36afb0b9a3f5 service swift] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:49.733710 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1445/2913] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 13 06:45:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 06:45:51.939466 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d7247-33d2-43bd-8b17-23a219ebca0d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:51.941455 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b10d7247-33d2-43bd-8b17-23a219ebca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:52.058142 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10d7247-33d2-43bd-8b17-23a219ebca0d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:52.062794 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd753002-360f-42a1-ac27-1a5f633b22b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:52.063462 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd753002-360f-42a1-ac27-1a5f633b22b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:52.063746 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd753002-360f-42a1-ac27-1a5f633b22b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:52.064020 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd753002-360f-42a1-ac27-1a5f633b22b5 admin admin] PATH_INFO: `/v3/users/023904c12714482685c72be7e8b68fda` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:52.065190 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd753002-360f-42a1-ac27-1a5f633b22b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=023904c12714482685c72be7e8b68fda)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:52.067151 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd753002-360f-42a1-ac27-1a5f633b22b5 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:52.106600 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:52.144706 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bd753002-360f-42a1-ac27-1a5f633b22b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '023904c12714482685c72be7e8b68fda'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:52.159226 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bd753002-360f-42a1-ac27-1a5f633b22b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '023904c12714482685c72be7e8b68fda'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:52.177972 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bd753002-360f-42a1-ac27-1a5f633b22b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '023904c12714482685c72be7e8b68fda'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:52.181637 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bd753002-360f-42a1-ac27-1a5f633b22b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '023904c12714482685c72be7e8b68fda'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:52.198171 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-bd753002-360f-42a1-ac27-1a5f633b22b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '023904c12714482685c72be7e8b68fda'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:52.206549 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1469/2914] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:51 2022] DELETE /identity/v3/users/023904c12714482685c72be7e8b68fda => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:52.394821 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c85d34-13a5-4671-8d96-36afb0b9a3f5 service swift] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:52.425360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c85d34-13a5-4671-8d96-36afb0b9a3f5 service swift] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:52.442125 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=100 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:52.520651 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368a6d3-ac63-4634-93a8-5bacbd1d0f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:52.521520 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368a6d3-ac63-4634-93a8-5bacbd1d0f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:52.521925 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368a6d3-ac63-4634-93a8-5bacbd1d0f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:52.522313 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368a6d3-ac63-4634-93a8-5bacbd1d0f49 admin admin] PATH_INFO: `/v3/projects/71e17b97332b47bd88b5178f723a83e1` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:52.523922 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368a6d3-ac63-4634-93a8-5bacbd1d0f49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e17b97332b47bd88b5178f723a83e1)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:52.539266 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4368a6d3-ac63-4634-93a8-5bacbd1d0f49 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:52.619778 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4368a6d3-ac63-4634-93a8-5bacbd1d0f49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e17b97332b47bd88b5178f723a83e1', 'request_id': 'req-4368a6d3-ac63-4634-93a8-5bacbd1d0f49'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:52.632838 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4368a6d3-ac63-4634-93a8-5bacbd1d0f49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e17b97332b47bd88b5178f723a83e1', 'request_id': 'req-4368a6d3-ac63-4634-93a8-5bacbd1d0f49'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:52.640076 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4368a6d3-ac63-4634-93a8-5bacbd1d0f49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e17b97332b47bd88b5178f723a83e1', 'request_id': 'req-4368a6d3-ac63-4634-93a8-5bacbd1d0f49'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:52.655368 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4368a6d3-ac63-4634-93a8-5bacbd1d0f49 admin admin] The token cache is being invalidate because project 71e17b97332b47bd88b5178f723a83e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:52.655655 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4368a6d3-ac63-4634-93a8-5bacbd1d0f49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:52.656360 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-4368a6d3-ac63-4634-93a8-5bacbd1d0f49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:52.658327 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1446/2915] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:52 2022] DELETE /identity/v3/projects/71e17b97332b47bd88b5178f723a83e1 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:45:52.664046 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0270c6-8420-45fa-b876-a2c3987ed245 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:52.664334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0270c6-8420-45fa-b876-a2c3987ed245 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:52.664608 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0270c6-8420-45fa-b876-a2c3987ed245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:52.756298 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8b0270c6-8420-45fa-b876-a2c3987ed245 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:52.757570 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8b0270c6-8420-45fa-b876-a2c3987ed245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:52.847348 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1470/2916] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:45:52.857045 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ac1c2-77b1-402f-b007-1bf621308339 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:52.857336 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ac1c2-77b1-402f-b007-1bf621308339 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:52.857763 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3ac1c2-77b1-402f-b007-1bf621308339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:52.908823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-2c3ac1c2-77b1-402f-b007-1bf621308339 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:52.910148 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2c3ac1c2-77b1-402f-b007-1bf621308339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:52.939715 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1447/2917] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:52.940541 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0270c6-8420-45fa-b876-a2c3987ed245 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:52.952742 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0270c6-8420-45fa-b876-a2c3987ed245 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:52.959741 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae41d72-9e28-421d-a267-b224daccefbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:52.960801 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae41d72-9e28-421d-a267-b224daccefbd admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:52.961270 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae41d72-9e28-421d-a267-b224daccefbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:52.961839 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae41d72-9e28-421d-a267-b224daccefbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:52.962753 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae41d72-9e28-421d-a267-b224daccefbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 06:45:52.963231 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae41d72-9e28-421d-a267-b224daccefbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:52.966223 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae41d72-9e28-421d-a267-b224daccefbd admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:52.987819 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1471/2918] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 13 06:45:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 06:45:53.000919 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ac1c2-77b1-402f-b007-1bf621308339 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:53.005859 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3ac1c2-77b1-402f-b007-1bf621308339 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:53.021140 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930b129-89fa-4a0e-b76c-04ddb7e2a7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:53.021773 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930b129-89fa-4a0e-b76c-04ddb7e2a7ed admin admin] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:53.022077 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930b129-89fa-4a0e-b76c-04ddb7e2a7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:53.022345 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930b129-89fa-4a0e-b76c-04ddb7e2a7ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:53.025579 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930b129-89fa-4a0e-b76c-04ddb7e2a7ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:53.032383 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930b129-89fa-4a0e-b76c-04ddb7e2a7ed admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:53.075142 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1448/2919] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 13 06:45:52 2022] POST /identity/v3/projects => generated 385 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:53.080199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae41d72-9e28-421d-a267-b224daccefbd admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:53.093263 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae41d72-9e28-421d-a267-b224daccefbd admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:53.155347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ab486-77d2-476b-a94d-435e815822fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:53.155958 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ab486-77d2-476b-a94d-435e815822fc admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:53.156248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ab486-77d2-476b-a94d-435e815822fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:53.156640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ab486-77d2-476b-a94d-435e815822fc admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:53.157917 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ab486-77d2-476b-a94d-435e815822fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:53.159917 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ab486-77d2-476b-a94d-435e815822fc admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:53.168878 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930b129-89fa-4a0e-b76c-04ddb7e2a7ed admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:53.169360 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:53.170642 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-2930b129-89fa-4a0e-b76c-04ddb7e2a7ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:53.184694 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930b129-89fa-4a0e-b76c-04ddb7e2a7ed admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:53.189980 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748c1941-c677-4a88-ad87-ae988a25c135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:53.190636 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c1941-c677-4a88-ad87-ae988a25c135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:53.190918 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c1941-c677-4a88-ad87-ae988a25c135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:53.191190 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748c1941-c677-4a88-ad87-ae988a25c135 admin admin] PATH_INFO: `/v3/users/98451efd61e44eec876701952375f788` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:53.192326 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c1941-c677-4a88-ad87-ae988a25c135 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98451efd61e44eec876701952375f788)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:53.192915 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1472/2920] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 13 06:45:53 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 06:45:53.194348 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748c1941-c677-4a88-ad87-ae988a25c135 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:53.197061 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ab486-77d2-476b-a94d-435e815822fc admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:53.209682 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ab486-77d2-476b-a94d-435e815822fc admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:53.214520 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f0268-0de0-47f4-83e1-797e3bf38733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:53.215208 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f0268-0de0-47f4-83e1-797e3bf38733 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:53.215494 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f0268-0de0-47f4-83e1-797e3bf38733 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:53.215769 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98f0268-0de0-47f4-83e1-797e3bf38733 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:53.216421 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f0268-0de0-47f4-83e1-797e3bf38733 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:53.218363 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98f0268-0de0-47f4-83e1-797e3bf38733 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:53.233997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1473/2921] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 06:45:53.235518 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f0268-0de0-47f4-83e1-797e3bf38733 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:53.245504 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98f0268-0de0-47f4-83e1-797e3bf38733 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:53.247393 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-748c1941-c677-4a88-ad87-ae988a25c135 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98451efd61e44eec876701952375f788'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:53.250147 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746efbb-9080-4780-91b9-a88fb29026c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:53.250756 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746efbb-9080-4780-91b9-a88fb29026c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:53.251043 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746efbb-9080-4780-91b9-a88fb29026c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:53.251318 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d746efbb-9080-4780-91b9-a88fb29026c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:53.251949 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746efbb-9080-4780-91b9-a88fb29026c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:53.253568 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d746efbb-9080-4780-91b9-a88fb29026c5 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:53.254603 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-748c1941-c677-4a88-ad87-ae988a25c135 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98451efd61e44eec876701952375f788'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:53.264093 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1474/2922] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 13 06:45:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 06:45:53.268102 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-748c1941-c677-4a88-ad87-ae988a25c135 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98451efd61e44eec876701952375f788'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:53.268993 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746efbb-9080-4780-91b9-a88fb29026c5 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:53.269858 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:53.277121 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-748c1941-c677-4a88-ad87-ae988a25c135 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98451efd61e44eec876701952375f788'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:53.278497 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-748c1941-c677-4a88-ad87-ae988a25c135 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98451efd61e44eec876701952375f788'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:53.280470 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d746efbb-9080-4780-91b9-a88fb29026c5 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:53.286041 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2f56b-a3e4-4add-a184-da303b76c1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:53.286582 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1449/2923] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:53 2022] DELETE /identity/v3/users/98451efd61e44eec876701952375f788 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:45:53.286724 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2f56b-a3e4-4add-a184-da303b76c1fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:53.286957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2f56b-a3e4-4add-a184-da303b76c1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:53.287240 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2f56b-a3e4-4add-a184-da303b76c1fd admin admin] PATH_INFO: `/v3/projects/44bae7e16b8b412da35a525d14cc6e39/users/4e5bcae6bb1742238faee644ec92b9c7/roles/1147187a70be4f46abe9a5f8d33d98fa` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:53.308074 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2f56b-a3e4-4add-a184-da303b76c1fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=44bae7e16b8b412da35a525d14cc6e39, user_id=4e5bcae6bb1742238faee644ec92b9c7, role_id=1147187a70be4f46abe9a5f8d33d98fa)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:53.311035 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e2f56b-a3e4-4add-a184-da303b76c1fd admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:53.325334 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1475/2924] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 13 06:45:53 2022] PUT /identity/v3/projects/44bae7e16b8b412da35a525d14cc6e39/users/4e5bcae6bb1742238faee644ec92b9c7/roles/1147187a70be4f46abe9a5f8d33d98fa => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:45:53.336622 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd292e95-dc39-47ea-ba84-ebbf68a56964 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:53.336945 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd292e95-dc39-47ea-ba84-ebbf68a56964 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:53.337218 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd292e95-dc39-47ea-ba84-ebbf68a56964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:53.365505 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-cd292e95-dc39-47ea-ba84-ebbf68a56964 None None] MFA Rules not processed for user `4e5bcae6bb1742238faee644ec92b9c7`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:53.366744 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cd292e95-dc39-47ea-ba84-ebbf68a56964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:53.435758 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1450/2925] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:45:53.444959 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2f56b-a3e4-4add-a184-da303b76c1fd admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:53.446847 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a7e2f56b-a3e4-4add-a184-da303b76c1fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:53.466605 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd292e95-dc39-47ea-ba84-ebbf68a56964 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:53.468131 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-cd292e95-dc39-47ea-ba84-ebbf68a56964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:53.529443 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2f56b-a3e4-4add-a184-da303b76c1fd admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:53.533710 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26aeaa-16d7-4f3b-bc23-85c9c7447d81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8789ed5fef2148e69e9e444d7cfe1e19', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:53.534313 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26aeaa-16d7-4f3b-bc23-85c9c7447d81 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:53.534589 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26aeaa-16d7-4f3b-bc23-85c9c7447d81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:53.534859 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26aeaa-16d7-4f3b-bc23-85c9c7447d81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:53.539552 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd292e95-dc39-47ea-ba84-ebbf68a56964 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:53.543215 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26aeaa-16d7-4f3b-bc23-85c9c7447d81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:53.544640 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26aeaa-16d7-4f3b-bc23-85c9c7447d81 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:53.544796 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb4363-ae6a-4100-85c1-2f46629d9843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:53.545284 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb4363-ae6a-4100-85c1-2f46629d9843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:53.545562 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb4363-ae6a-4100-85c1-2f46629d9843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:53.545830 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feb4363-ae6a-4100-85c1-2f46629d9843 admin admin] PATH_INFO: `/v3/projects/6aa9ceb278524f1a9ab85583f1d741b9` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:53.546949 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb4363-ae6a-4100-85c1-2f46629d9843 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa9ceb278524f1a9ab85583f1d741b9)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:53.548911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feb4363-ae6a-4100-85c1-2f46629d9843 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:53.554395 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1476/2926] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:53.595930 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3feb4363-ae6a-4100-85c1-2f46629d9843 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa9ceb278524f1a9ab85583f1d741b9', 'request_id': 'req-3feb4363-ae6a-4100-85c1-2f46629d9843'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:53.602567 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3feb4363-ae6a-4100-85c1-2f46629d9843 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa9ceb278524f1a9ab85583f1d741b9', 'request_id': 'req-3feb4363-ae6a-4100-85c1-2f46629d9843'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:53.608791 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3feb4363-ae6a-4100-85c1-2f46629d9843 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa9ceb278524f1a9ab85583f1d741b9', 'request_id': 'req-3feb4363-ae6a-4100-85c1-2f46629d9843'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:53.622936 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3feb4363-ae6a-4100-85c1-2f46629d9843 admin admin] The token cache is being invalidate because project 6aa9ceb278524f1a9ab85583f1d741b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:53.623259 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3feb4363-ae6a-4100-85c1-2f46629d9843 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:53.623866 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3feb4363-ae6a-4100-85c1-2f46629d9843 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:53.626257 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1451/2927] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:53 2022] DELETE /identity/v3/projects/6aa9ceb278524f1a9ab85583f1d741b9 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:45:53.630416 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26aeaa-16d7-4f3b-bc23-85c9c7447d81 service cinder] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:53.642102 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26aeaa-16d7-4f3b-bc23-85c9c7447d81 service cinder] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:53.709676 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884590a3-eabc-4873-8243-6a0c9a9a65f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:53.710578 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884590a3-eabc-4873-8243-6a0c9a9a65f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:53.710976 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884590a3-eabc-4873-8243-6a0c9a9a65f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:53.711409 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884590a3-eabc-4873-8243-6a0c9a9a65f6 admin admin] PATH_INFO: `/v3/users/f8fdbda28a4d48f08f3632396e56ae13` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:53.712687 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884590a3-eabc-4873-8243-6a0c9a9a65f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8fdbda28a4d48f08f3632396e56ae13)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:53.715257 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884590a3-eabc-4873-8243-6a0c9a9a65f6 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:53.767015 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-884590a3-eabc-4873-8243-6a0c9a9a65f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8fdbda28a4d48f08f3632396e56ae13'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:53.768302 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:53.775157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-884590a3-eabc-4873-8243-6a0c9a9a65f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8fdbda28a4d48f08f3632396e56ae13'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:53.789081 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-884590a3-eabc-4873-8243-6a0c9a9a65f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8fdbda28a4d48f08f3632396e56ae13'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:53.789894 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-884590a3-eabc-4873-8243-6a0c9a9a65f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8fdbda28a4d48f08f3632396e56ae13'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:53.798645 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-884590a3-eabc-4873-8243-6a0c9a9a65f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8fdbda28a4d48f08f3632396e56ae13'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:53.806327 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1477/2928] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:53 2022] DELETE /identity/v3/users/f8fdbda28a4d48f08f3632396e56ae13 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:53.993829 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb4363-ae6a-4100-85c1-2f46629d9843 admin admin] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:53.995382 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-3feb4363-ae6a-4100-85c1-2f46629d9843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:54.011970 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feb4363-ae6a-4100-85c1-2f46629d9843 admin admin] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:54.021180 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:INSERT=2,keystone:DELETE=8,keystone:SELECT=90 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:54.087086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06856e80-1475-4fe5-879e-d36ac713b111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:54.087823 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06856e80-1475-4fe5-879e-d36ac713b111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:54.087993 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06856e80-1475-4fe5-879e-d36ac713b111 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:54.088312 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06856e80-1475-4fe5-879e-d36ac713b111 admin admin] PATH_INFO: `/v3/projects/24966c1db0004b29bfc66dff08e73809` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:54.089444 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06856e80-1475-4fe5-879e-d36ac713b111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24966c1db0004b29bfc66dff08e73809)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:54.091336 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06856e80-1475-4fe5-879e-d36ac713b111 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:54.148979 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-06856e80-1475-4fe5-879e-d36ac713b111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24966c1db0004b29bfc66dff08e73809', 'request_id': 'req-06856e80-1475-4fe5-879e-d36ac713b111'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:54.154617 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-06856e80-1475-4fe5-879e-d36ac713b111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24966c1db0004b29bfc66dff08e73809', 'request_id': 'req-06856e80-1475-4fe5-879e-d36ac713b111'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:54.161143 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-06856e80-1475-4fe5-879e-d36ac713b111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24966c1db0004b29bfc66dff08e73809', 'request_id': 'req-06856e80-1475-4fe5-879e-d36ac713b111'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:54.174419 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-06856e80-1475-4fe5-879e-d36ac713b111 admin admin] The token cache is being invalidate because project 24966c1db0004b29bfc66dff08e73809 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:54.174712 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-06856e80-1475-4fe5-879e-d36ac713b111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:54.175336 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-06856e80-1475-4fe5-879e-d36ac713b111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:54.177684 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1452/2929] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:53 2022] DELETE /identity/v3/projects/24966c1db0004b29bfc66dff08e73809 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:56.122290 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884590a3-eabc-4873-8243-6a0c9a9a65f6 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:56.123705 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-884590a3-eabc-4873-8243-6a0c9a9a65f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:56.136810 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884590a3-eabc-4873-8243-6a0c9a9a65f6 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:56.193169 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14c6c1-7dac-4064-ae3c-295e75c60ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:56.193789 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14c6c1-7dac-4064-ae3c-295e75c60ce2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:56.194095 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14c6c1-7dac-4064-ae3c-295e75c60ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:56.194364 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a14c6c1-7dac-4064-ae3c-295e75c60ce2 admin admin] PATH_INFO: `/v3/users/4e5bcae6bb1742238faee644ec92b9c7` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:56.195472 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14c6c1-7dac-4064-ae3c-295e75c60ce2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5bcae6bb1742238faee644ec92b9c7)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:56.197440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a14c6c1-7dac-4064-ae3c-295e75c60ce2 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:56.244968 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9a14c6c1-7dac-4064-ae3c-295e75c60ce2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5bcae6bb1742238faee644ec92b9c7'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:56.252585 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9a14c6c1-7dac-4064-ae3c-295e75c60ce2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5bcae6bb1742238faee644ec92b9c7'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:56.264282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9a14c6c1-7dac-4064-ae3c-295e75c60ce2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5bcae6bb1742238faee644ec92b9c7'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:56.264999 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9a14c6c1-7dac-4064-ae3c-295e75c60ce2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5bcae6bb1742238faee644ec92b9c7'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:56.273074 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9a14c6c1-7dac-4064-ae3c-295e75c60ce2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5bcae6bb1742238faee644ec92b9c7'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:56.279060 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1478/2930] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:45:56 2022] DELETE /identity/v3/users/4e5bcae6bb1742238faee644ec92b9c7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:45:56.283600 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12025905-f79a-4f67-adcb-5eb5c7dd18b7 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:56.284088 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12025905-f79a-4f67-adcb-5eb5c7dd18b7 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:56.284188 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12025905-f79a-4f67-adcb-5eb5c7dd18b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:56.304774 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-12025905-f79a-4f67-adcb-5eb5c7dd18b7 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:45:56.305969 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-12025905-f79a-4f67-adcb-5eb5c7dd18b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:56.363652 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1453/2931] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:45:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 06:45:56.373698 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14c6c1-7dac-4064-ae3c-295e75c60ce2 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:56.375157 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9a14c6c1-7dac-4064-ae3c-295e75c60ce2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:56.423248 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:56.459772 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a14c6c1-7dac-4064-ae3c-295e75c60ce2 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:56.463392 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84fb36-f7b2-43c7-a004-baf758f298eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:56.463984 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84fb36-f7b2-43c7-a004-baf758f298eb service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:56.464258 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84fb36-f7b2-43c7-a004-baf758f298eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:56.464524 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de84fb36-f7b2-43c7-a004-baf758f298eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:56.474162 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84fb36-f7b2-43c7-a004-baf758f298eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:56.475593 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de84fb36-f7b2-43c7-a004-baf758f298eb service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:56.485218 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1479/2932] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:45:56.773263 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12025905-f79a-4f67-adcb-5eb5c7dd18b7 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:45:56.774866 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-12025905-f79a-4f67-adcb-5eb5c7dd18b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:45:56.788281 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12025905-f79a-4f67-adcb-5eb5c7dd18b7 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:45:56.793062 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3879e49b-219d-44fb-99c9-278f7a5e5d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:45:56.793785 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879e49b-219d-44fb-99c9-278f7a5e5d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:45:56.794070 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879e49b-219d-44fb-99c9-278f7a5e5d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:45:56.794372 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3879e49b-219d-44fb-99c9-278f7a5e5d9f admin admin] PATH_INFO: `/v3/projects/44bae7e16b8b412da35a525d14cc6e39` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:45:56.795594 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879e49b-219d-44fb-99c9-278f7a5e5d9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=44bae7e16b8b412da35a525d14cc6e39)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:45:56.798464 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3879e49b-219d-44fb-99c9-278f7a5e5d9f admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:45:56.836437 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:45:56.848548 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3879e49b-219d-44fb-99c9-278f7a5e5d9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44bae7e16b8b412da35a525d14cc6e39', 'request_id': 'req-3879e49b-219d-44fb-99c9-278f7a5e5d9f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:56.854214 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3879e49b-219d-44fb-99c9-278f7a5e5d9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44bae7e16b8b412da35a525d14cc6e39', 'request_id': 'req-3879e49b-219d-44fb-99c9-278f7a5e5d9f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:56.861086 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3879e49b-219d-44fb-99c9-278f7a5e5d9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44bae7e16b8b412da35a525d14cc6e39', 'request_id': 'req-3879e49b-219d-44fb-99c9-278f7a5e5d9f'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:56.873992 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3879e49b-219d-44fb-99c9-278f7a5e5d9f admin admin] The token cache is being invalidate because project 44bae7e16b8b412da35a525d14cc6e39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:45:56.874163 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3879e49b-219d-44fb-99c9-278f7a5e5d9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:56.874711 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-3879e49b-219d-44fb-99c9-278f7a5e5d9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:45:56.876204 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1454/2933] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:45:56 2022] DELETE /identity/v3/projects/44bae7e16b8b412da35a525d14cc6e39 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 06:46:00.053927 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84fb36-f7b2-43c7-a004-baf758f298eb service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:00.055287 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-de84fb36-f7b2-43c7-a004-baf758f298eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:00.068888 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de84fb36-f7b2-43c7-a004-baf758f298eb service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:00.122347 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318cc04-c172-4a04-abd9-0fadd0cd6905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:00.122957 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318cc04-c172-4a04-abd9-0fadd0cd6905 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:00.123233 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318cc04-c172-4a04-abd9-0fadd0cd6905 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:00.123502 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9318cc04-c172-4a04-abd9-0fadd0cd6905 admin admin] PATH_INFO: `/v3/users/7ed40f63ce0549a6903417e37ad4aeed` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:00.124610 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318cc04-c172-4a04-abd9-0fadd0cd6905 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed40f63ce0549a6903417e37ad4aeed)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:00.127132 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9318cc04-c172-4a04-abd9-0fadd0cd6905 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:00.171306 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9318cc04-c172-4a04-abd9-0fadd0cd6905 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed40f63ce0549a6903417e37ad4aeed'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:46:00.178779 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9318cc04-c172-4a04-abd9-0fadd0cd6905 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed40f63ce0549a6903417e37ad4aeed'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:46:00.192497 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9318cc04-c172-4a04-abd9-0fadd0cd6905 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed40f63ce0549a6903417e37ad4aeed'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:46:00.193166 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9318cc04-c172-4a04-abd9-0fadd0cd6905 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed40f63ce0549a6903417e37ad4aeed'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:46:00.200516 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-9318cc04-c172-4a04-abd9-0fadd0cd6905 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed40f63ce0549a6903417e37ad4aeed'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:46:00.206567 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1480/2934] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 13 06:46:00 2022] DELETE /identity/v3/users/7ed40f63ce0549a6903417e37ad4aeed => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:46:00.211136 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c604f0-1038-4320-bdbd-a9c256794db1 None None] REQUEST_METHOD: `POST` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:00.211631 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c604f0-1038-4320-bdbd-a9c256794db1 None None] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:00.211748 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c604f0-1038-4320-bdbd-a9c256794db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:00.230433 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.auth.core [None req-54c604f0-1038-4320-bdbd-a9c256794db1 None None] MFA Rules not processed for user `bcb0a034a4c8491eb41145193c3db0d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81460) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 06:46:00.231625 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-54c604f0-1038-4320-bdbd-a9c256794db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:00.290039 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1455/2935] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 13 06:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 06:46:00.300311 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318cc04-c172-4a04-abd9-0fadd0cd6905 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:00.303369 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9318cc04-c172-4a04-abd9-0fadd0cd6905 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:00.358199 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:00.365282 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9318cc04-c172-4a04-abd9-0fadd0cd6905 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:00.370843 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ef260-45f3-4939-a9a3-b8270e2b2796 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a5efc921a219444bb0b45e8b4d08dcc5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:00.371450 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ef260-45f3-4939-a9a3-b8270e2b2796 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:00.371727 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ef260-45f3-4939-a9a3-b8270e2b2796 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:00.371997 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5ef260-45f3-4939-a9a3-b8270e2b2796 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:00.381659 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ef260-45f3-4939-a9a3-b8270e2b2796 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:00.383073 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5ef260-45f3-4939-a9a3-b8270e2b2796 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:00.392357 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1481/2936] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 06:46:00.657047 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c604f0-1038-4320-bdbd-a9c256794db1 None None] Authenticating user token {{(pid=81460) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:46:00.658612 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.fernet_utils [None req-54c604f0-1038-4320-bdbd-a9c256794db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81460) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:46:00.674084 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c604f0-1038-4320-bdbd-a9c256794db1 None None] Validating token access rules against request {{(pid=81460) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:46:00.679554 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a828a-c500-4734-b0fc-ce2808a8e1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcb0a034a4c8491eb41145193c3db0d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '275d03b5a7094075b5f8d560d8a5be83', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81460) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:46:00.680295 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a828a-c500-4734-b0fc-ce2808a8e1b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:46:00.680487 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a828a-c500-4734-b0fc-ce2808a8e1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:46:00.680806 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a828a-c500-4734-b0fc-ce2808a8e1b7 admin admin] PATH_INFO: `/v3/projects/e6b116ee24a74761ba50046e639d8c25` {{(pid=81460) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:46:00.682050 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a828a-c500-4734-b0fc-ce2808a8e1b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6b116ee24a74761ba50046e639d8c25)` {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:46:00.683842 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a828a-c500-4734-b0fc-ce2808a8e1b7 admin admin] RBAC: Authorization granted {{(pid=81460) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:46:00.729598 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8a5a828a-c500-4734-b0fc-ce2808a8e1b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6b116ee24a74761ba50046e639d8c25', 'request_id': 'req-8a5a828a-c500-4734-b0fc-ce2808a8e1b7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:46:00.735701 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8a5a828a-c500-4734-b0fc-ce2808a8e1b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6b116ee24a74761ba50046e639d8c25', 'request_id': 'req-8a5a828a-c500-4734-b0fc-ce2808a8e1b7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:46:00.741682 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8a5a828a-c500-4734-b0fc-ce2808a8e1b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6b116ee24a74761ba50046e639d8c25', 'request_id': 'req-8a5a828a-c500-4734-b0fc-ce2808a8e1b7'} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:46:00.753911 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8a5a828a-c500-4734-b0fc-ce2808a8e1b7 admin admin] The token cache is being invalidate because project e6b116ee24a74761ba50046e639d8c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81460) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 06:46:00.754201 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8a5a828a-c500-4734-b0fc-ce2808a8e1b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:46:00.754817 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG keystone.notifications [None req-8a5a828a-c500-4734-b0fc-ce2808a8e1b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81460) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 06:46:00.756267 dv-cinder-856385-1-smb devstack@keystone.service[81460]: [pid: 81460|app: 0|req: 1456/2937] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 13 06:46:00 2022] DELETE /identity/v3/projects/e6b116ee24a74761ba50046e639d8c25 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 06:46:10.388274 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=5 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:46:10.750929 dv-cinder-856385-1-smb devstack@keystone.service[81460]: DEBUG dbcounter [-] [81460] Writing DB stats keystone:SELECT=65,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81460) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 06:50:51.212440 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ef260-45f3-4939-a9a3-b8270e2b2796 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 06:50:51.213862 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9d5ef260-45f3-4939-a9a3-b8270e2b2796 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:50:51.283575 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5ef260-45f3-4939-a9a3-b8270e2b2796 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 06:50:51.342204 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e53801-cc09-45f3-b765-eb45b1fad1da service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b84a23931b60457e865f056352a396d0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce1c3f0aa3b746108e73737491b003e7', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 06:50:51.342803 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e53801-cc09-45f3-b765-eb45b1fad1da service placement] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 06:50:51.343083 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e53801-cc09-45f3-b765-eb45b1fad1da service placement] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 06:50:51.343356 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e53801-cc09-45f3-b765-eb45b1fad1da service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 06:50:51.345116 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-31e53801-cc09-45f3-b765-eb45b1fad1da service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 06:50:51.356300 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e53801-cc09-45f3-b765-eb45b1fad1da service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 06:50:51.357949 dv-cinder-856385-1-smb devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e53801-cc09-45f3-b765-eb45b1fad1da service placement] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 06:50:51.368832 dv-cinder-856385-1-smb devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1482/2938] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 13 06:50:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0)